Hugging Face's logo

BigHuggyD
/
BigHuggyD-Grey-WizardLM-2-8x22B_exl2_6.5bpw_h8

Text Generation
Transformers
Safetensors
mixtral
conversational
text-generation-inference
exl2
Model card Files
xet
Community
1
Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

EXL2 6.5BPW Quant of BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B

Downloads last month
4
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support