Gradio

HF Token (WRITE)

If no token is provided, the quantized model will be available for direct download instead of uploading as a PR.

Source HF Repo (e.g. author/model)

Source Filename (e.g. model.safetensors)

Target HF Repo (e.g. author/model)

Target Filename Base (e.g. model-quant)

Format

fp8 int8 rowwise mxfp8

Model Layer Filter

Exclude Layers Regex (Optional)

ℹ️ For more advanced quantization modes, install and use convert-to-quant locally.

Status Log

🤗 Model Quantizer