Inference parameter setup

#5
by ZmnL - opened

May I ask if there are any recommended settings for the model's inference parameters, such as temperature?

also interested

You can refer to the official Qwen recommendations for temperature settings.
Typically, values like 0.6, 0.7, or 1.0 work well depending on the task.

Sign up or log in to comment