xiaomi-research

/

MiLMMT-46-4B-v0.1

like 2

Follow

Xiaomi Research 21

Thanks for your interest!

There is no additional chat template. Please directly adopt the translation prompt.

Thanks for the quick reply. I'll have to figure out how to do that in MNN Chat and llama.cpp both...

Okay, for llama.cpp's llama-server, this seems to work: llama-server --chat-template "{% for message in messages %}{{ message.content }}{% endfor %}" -m MiLMMT-46-4B-v0.1.Q4_K_M.gguf (and then I just put the whole "Translate this from ..." as my chat message.)