nvidia
/

DeepSeek-V3-0324-NVFP4

Text Generation

Model Optimizer

8-bit precision

Model card Files Files and versions

Resources

View closed (1)

Fix chat_template crash when assistant message omits the `content` key

#6 opened 14 days ago by

Fix model config

#4 opened 10 months ago by

The given huggingface model architecture DeepseekV3ForCausalLM is not supported in TRT-LLM yet

#3 opened 10 months ago by

How to run model on 8xH200

#2 opened 11 months ago by

Remove quantization_config from config.json

#1 opened 11 months ago by