Original model: Frozen-Tundra-12B by Naphula
Available ExLlamaV3 (release v0.0.18) quantizations
| Type | Size | CLI |
|---|---|---|
| H8-4.0BPW | 7.49 GB | Copy-paste the line / Download the batch file |
| H8-6.0BPW | 10.22 GB | Copy-paste the line / Download the batch file |
| H8-8.0BPW | 12.95 GB | Copy-paste the line / Download the batch file |
Requirements: A python installation with huggingface-hub module to use CLI.
Licensing
License detected: apache-2.0
The license for the provided quantized models is derived from the original model. For additional information see the original model's page above, or, if unavailable, the files and the page backups below.
Backups
Model tree for DeathGodlike/Frozen-Tundra-12B_EXL3
Base model
Naphula/Frozen-Tundra-12B