YTan2000

/

Qwopus3.5-27B-v3-TQ3_4S

like 30

https://github.com/turbo-tan/llama.cpp-tq3

hope one day they support rpc

That's for feedback. Can you explain how you want the support for rpc?

llama.cpp already support it GGML_RPC=ON but it is fragile , you can try

llama.cpp already support it GGML_RPC=ON but it is fragile , you can try

but its doest support the TQ3

https://github.com/turbo-tan/llama.cpp-tq3

Have you tried this fork?