How to use jadohu/llamagen_drafter with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("jadohu/llamagen_drafter") model = AutoModelForCausalLM.from_pretrained("jadohu/llamagen_drafter")
SFconvertbot