Hugging Face's logo

openchat
/
openchat_3.5

Text Generation
Transformers
PyTorch
openchat
mistral
C-RLFT
Model card Files
xet
 Community
51

Free and ready to use openchat_3.5-GGUF model as OpenAI API compatible endpoint

#7
by limcheekin - opened
Discussion
limcheekin

Hi there,

I've successfully deployed the model as an OpenAI API-compatible endpoint, which you can access via the following link: https://huggingface.co/spaces/limcheekin/openchat_3.5-GGUF.

This API has been made possible thanks to the generous contributions of the following individuals and resources:

  • The original model's publisher.
  • The TheBloke who shared the quantized models.
  • The llama-cpp-python package.
  • HuggingFace Spaces.

If you find this resource valuable and wish to show your support, we would greatly appreciate it if you could "star" the space.

Thank you for your support and interest.

Sign up or log in to comment