YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Quantization made by Richard Erkhov.
gemma-2-27b-it-abliterated - GGUF
- Model creator: https://huggingface.co/byroneverson/
- Original model: https://huggingface.co/byroneverson/gemma-2-27b-it-abliterated/
Original model description:
base_model: google/gemma-2-27b-it pipeline_tag: text-generation license: gemma language: - en tags: - gemma - gemma-2 - chat - it - abliterated library_name: transformers
gemma-2-27b-it-abliterated
Now accepting abliteration requests. If you would like to see a model abliterated, follow me and leave me a message with model link.
This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.
- Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
- Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)
Check out the jupyter notebook for details of how this model was abliterated from gemma-2-27b-it.
- Downloads last month
- 285
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support