Instructions to use trl-lib/llama-7b-se-rl-peft with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use trl-lib/llama-7b-se-rl-peft with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("trl-lib/llama-7b-se-rl-peft", dtype="auto") - Notebooks
- Google Colab
- Kaggle
Updates to Model Card noting issues with generated answers
#7
by nlothian - opened
It is very easy to generate extremely unethical answers (eg plans for genocide) using this model. This should be noted.
lvwerra changed pull request status to merged
Thanks a lot for reporting and updating the README!
