MarsupialAI
/

Monstral-123B_4.0bpw_EXL2

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

4bpw EXL2 quant of https://huggingface.co/MarsupialAI/Monstral-123B

Default settings and dataset utilized for measurements.

Downloads last month: 1