Models

RedHatAI/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • 0.4B • Updated Oct 9, 2024 • 9

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • 0.2B • Updated Oct 9, 2024 • 7 • 1

nm-testing/SmolLM-135M-Instruct-quantized.w4a16

Text Generation • 71.6M • Updated Oct 9, 2024 • 7

nm-testing/SmolLM-360M-Instruct-quantized.w4a16

0.1B • Updated Oct 9, 2024 • 2

nm-testing/SmolLM-1.7B-Instruct-quantized.w4a16

Text Generation • 0.4B • Updated Oct 9, 2024 • 5

RedHatAI/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • 2B • Updated Oct 9, 2024 • 6 • 1

nm-testing/tinyllama-fp8-dynamic-compressed

1B • Updated Oct 9, 2024 • 295

nm-testing/tinyllama-w4a16-compressed

0.3B • Updated Oct 9, 2024 • 732

nm-testing/tinyllama-w8a8-compressed

1B • Updated Oct 9, 2024 • 620

nm-testing/tinyllama-w8a16-dense

1B • Updated Oct 9, 2024 • 285

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group

Text Generation • 0.3B • Updated Oct 9, 2024 • 534

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight

Text Generation • 0.3B • Updated Oct 9, 2024 • 2

nm-testing/DeepSeek-Coder-V2-Lite-Instruct-W8A8

16B • Updated Oct 9, 2024 • 13

nm-testing/Qwen2-VL-7B-Instruct-FP8-dynamic

8B • Updated Oct 29, 2024 • 49 • 1

nm-testing/OLMoE-1B-7B-0924-Instruct-FP8

7B • Updated Oct 9, 2024 • 11

nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf

Text Generation • 8B • Updated Sep 24, 2024 • 6

nm-testing/tinyllama-oneshot-w8a8-channel-dynamic-token-v2-asym

1B • Updated Oct 9, 2024 • 6

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test

8B • Updated Oct 9, 2024 • 7 • 1

nm-testing/asym-w8w8-int8-static-per-tensor-tiny-llama

1B • Updated Oct 9, 2024 • 1.9k

RedHatAI/Llama-3.2-11B-Vision-Instruct-FP8-dynamic

Text Generation • 11B • Updated Oct 2, 2024 • 13.4k • 24

RedHatAI/Llama-3.2-1B-Instruct-FP8-dynamic

Text Generation • 1B • Updated Oct 9, 2024 • 419k • 3

RedHatAI/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • 4B • Updated Oct 9, 2024 • 37 • 3

RedHatAI/Llama-3.2-1B-Instruct-quantized.w8a8

Text Generation • 1B • Updated Oct 16, 2024 • 8.9k • 7

RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • 4B • Updated Jul 10, 2025 • 273 • 1

RedHatAI/Llama-3.2-90B-Vision-Instruct-FP8-dynamic

Text Generation • 89B • Updated Oct 2, 2024 • 2.27k • 11

RedHatAI/Llama-3.2-1B-Instruct-FP8

Text Generation • 1B • Updated Oct 16, 2024 • 160k • 3

RedHatAI/Llama-3.2-3B-Instruct-FP8

Text Generation • 4B • Updated Oct 16, 2024 • 1.34k • 6

RedHatAI/Llama-3.2-1B-quantized.w8a8

1B • Updated Jan 16, 2025 • 8.16k • 1

RedHatAI/Llama-3.2-3B-quantized.w8a8

4B • Updated Oct 9, 2024 • 2.14k

RedHatAI/Llama-3.2-1B-FP8

1B • Updated Oct 14, 2025 • 19.7k