iMatrix GGUFs for https://huggingface.co/nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
iMat generated using Kalomaze's groups_merged.txt
- Downloads last month
- 98
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Model tree for MarsupialAI/Llama-3.1-Nemotron-70B-Instruct_iMat_GGUF
Base model
meta-llama/Llama-3.1-70B Finetuned
meta-llama/Llama-3.1-70B-Instruct