Install & run this model using llmpm

#15
by sarthak-saxena - opened

Install & run any hugging face model using llmpm

  • pip install llmpm
  • llmpm install Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled
  • llmpm serve Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled

LLMPMDemo_fuckwk

Website: https://llmpm.co

sarthak-saxena changed discussion title from Install & run Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled using llmpm to Install & run this model using llmpm

when serving i'm getting an error

Loading Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled… error Failed to load model: Could not import module 'Qwen3_5ForConditionalGeneration'. Are this object's requirements defined correctly?

Sign up or log in to comment