Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Olmo-3-7B-Think-GGUF
like
0
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
experimental
target_bpw
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Olmo-3-7B-Think-GGUF
101 GB
1 contributor
History:
29 commits
eaddario
Update README.md
a7f7d0a
verified
1 day ago
imatrix
Generate imatrix
6 days ago
logits
Generate base model logits
6 days ago
scores
Add GGUF internal file structure
6 days ago
.gitattributes
Safe
1.64 kB
Update .gitattributes
6 days ago
.gitignore
Safe
6.78 kB
Add .gitignore
6 days ago
Olmo-3-7B-Think-F16.gguf
14.6 GB
xet
Convert safetensor to GGUF @ F16
6 days ago
Olmo-3-7B-Think-IQ1_L.gguf
1.6 GB
xet
Target 1.75 bpw quantization (IQ1_L)
6 days ago
Olmo-3-7B-Think-IQ2_S.gguf
2.06 GB
xet
Target 2.25 bpw quantization (IQ2_S)
6 days ago
Olmo-3-7B-Think-IQ2_XS.gguf
1.94 GB
xet
Target 2.125 bpw quantization (IQ2_XS)
6 days ago
Olmo-3-7B-Think-IQ2_XXS.gguf
1.83 GB
xet
Target 2.00 bpw quantization (IQ2_XXS)
6 days ago
Olmo-3-7B-Think-IQ3_XXS.gguf
2.74 GB
xet
Target 3.00 bpw quantization (IQ3_XXS)
6 days ago
Olmo-3-7B-Think-Q2_K.gguf
2.28 GB
xet
Target 2.50 bpw quantization (Q2_K)
6 days ago
Olmo-3-7B-Think-Q3_K.gguf
3.2 GB
xet
Target 3.50 bpw quantization (Q3_K)
6 days ago
Olmo-3-7B-Think-Q3_K_L.gguf
3.42 GB
xet
Target 3.75 bpw quantization (Q3_K_L)
6 days ago
Olmo-3-7B-Think-Q3_K_S.gguf
2.97 GB
xet
Target 3.25 bpw quantization (Q3_K_S)
6 days ago
Olmo-3-7B-Think-Q4_K.gguf
4.11 GB
xet
Target 4.50 bpw quantization (Q4_K)
6 days ago
Olmo-3-7B-Think-Q4_K_M-bpw.gguf
4.47 GB
xet
Target bpw equivalent to standard Q4_K_M
6 days ago
Olmo-3-7B-Think-Q4_K_S.gguf
3.88 GB
xet
Target 4.25 bpw quantization (Q4_K_S)
6 days ago
Olmo-3-7B-Think-Q5_K.gguf
5.02 GB
xet
Target 5.50 bpw quantization (Q5_K)
6 days ago
Olmo-3-7B-Think-Q5_K_S.gguf
4.79 GB
xet
Target 5.25 bpw quantization (Q5_K_S)
6 days ago
Olmo-3-7B-Think-Q6_K.gguf
5.93 GB
xet
Target 6.50 bpw quantization (Q6_K)
6 days ago
Olmo-3-7B-Think-Q8_0.gguf
7.76 GB
xet
Target 8.50 bpw quantization (Q8_0)
6 days ago
Olmo_3_7B_Think-87ce0b5236373a08.bpw_state
71.7 kB
xet
Generate BPW computation checkpoint
6 days ago
README.md
23.9 kB
Update README.md
1 day ago