Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

compressed-tensors

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

3,833

Full-text search

Active filters: compressed-tensors

mratsim/Strawberrylemonade-L3-70B-v1.1-NVFP4A16

Text Generation • 41B • Updated Oct 26, 2025 • 100

RedHatAI/granite-4.0-h-small-FP8-dynamic

Text Generation • 32B • Updated Dec 3, 2025 • 35

Firworks/Hermes-4-70B-nvfp4

41B • Updated Oct 26, 2025 • 4 • 2

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-FP8-block

Text Generation • 402B • Updated Oct 27, 2025 • 11 • 1

BaoLocTown/thanh-hug-lora-awq

0.3B • Updated Oct 27, 2025 • 4

Benasd/Qwen3-30B-A3B-Instruct-2507-NVFP4-FP8-MIXED

18B • Updated Oct 27, 2025 • 6

ig1/Qwen3-Coder-30B-A3B-Instruct-NVFP4

Text Generation • 17B • Updated Oct 27, 2025 • 308 • 1

BaoLocTown/thanh-GN-gemma-lora

1B • Updated Oct 27, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4-e2e

0.7B • Updated 21 days ago • 14

nm-testing/TinyLlama-1.1B-Chat-v1.0-NVFP4A16-e2e

0.7B • Updated Dec 1, 2025 • 7

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_BLOCK-e2e

1B • Updated Dec 1, 2025 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8_DYNAMIC-e2e

1B • Updated 21 days ago • 63

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-e2e

1B • Updated Dec 3, 2025 • 97

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_channel-e2e

1B • Updated Dec 1, 2025 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8A16_tensor-e2e

1B • Updated Dec 1, 2025 • 8

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

1B • Updated Dec 2, 2025 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-e2e

1B • Updated Dec 1, 2025 • 52

nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8_tensor_weight_static_per_tensor_act-e2e

1B • Updated Dec 2, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_gptq_tinyllama-e2e

0.3B • Updated Dec 3, 2025 • 3

nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e

4B • Updated Dec 2, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e

1B • Updated Dec 2, 2025 • 15

nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_fp8_dynamic-e2e

0.7B • Updated Dec 2, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-sparse2of4_only-e2e

0.7B • Updated Dec 2, 2025 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4_channel-e2e

0.3B • Updated Dec 2, 2025 • 5

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_2of4-e2e

0.3B • Updated Dec 2, 2025 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-group-e2e

0.3B • Updated Dec 2, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-actorder-weight-e2e

0.3B • Updated Dec 2, 2025 • 4

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16_channel-e2e

0.3B • Updated Dec 2, 2025 • 3

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-e2e

0.3B • Updated Dec 2, 2025 • 95

RedHatAI/Llama-4-Maverick-17B-128E-Instruct-NVFP4

Text Generation • 229B • Updated 27 days ago • 482 • 2