-
-
-
-
-
-
Inference Providers
Active filters:
3-bit
mlx-community/MiniMax-M2.1-3bit
Text Generation
•
229B
•
Updated
•
559
•
3
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
•
8B
•
Updated
•
152k
•
32
MaziyarPanahi/SynthIA-7B-v1.3-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
231
•
1
MaziyarPanahi/NSFW_DPO_Noromaid-7b-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
313
•
4
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
7B
•
Updated
•
1.01k
•
55
MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
30
•
3
MaziyarPanahi/gemma-7b-GGUF
Text Generation
•
9B
•
Updated
•
1.35k
•
12
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
7B
•
Updated
•
169k
•
129
MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF
Text Generation
•
12B
•
Updated
•
165k
•
50
MaziyarPanahi/reader-lm-0.5b-GGUF
Text Generation
•
0.5B
•
Updated
•
1.41k
•
4
MaziyarPanahi/reader-lm-1.5b-GGUF
Text Generation
•
2B
•
Updated
•
954
•
2
MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF
Text Generation
•
1B
•
Updated
•
158k
•
17
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
4B
•
Updated
•
175k
•
14
MaziyarPanahi/gpt-oss-20b-Derestricted-GGUF
Text Generation
•
21B
•
Updated
•
75.7k
•
1
MaziyarPanahi/NVIDIA-Nemotron-Nano-9B-v2-GGUF
Text Generation
•
9B
•
Updated
•
1.11k
•
3
catalystsec/MiniMax-M2.1-3bit-DWQ
Text Generation
•
229B
•
Updated
•
372
•
1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
•
Updated
•
7
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
14
•
3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
•
Updated
•
11
•
3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
•
Updated
•
9
Text Generation
•
Updated
•
10
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
•
Updated
•
7
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
•
6B
•
Updated
•
9
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
•
6B
•
Updated
•
6
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
•
3B
•
Updated
•
6
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
•
3B
•
Updated
•
3
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
•
31B
•
Updated
•
9
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
•
65B
•
Updated
•
4
SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT
Text Generation
•
31B
•
Updated
•
5
kaitchup/Mistral-7B-v0.1-gptq-3bit
Text Generation
•
7B
•
Updated
•
7