How to use munyew/meralion-education-lora with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("C:/Projects/meralion-server/models/meralion_2_3b") model = PeftModel.from_pretrained(base_model, "munyew/meralion-education-lora")
How to use munyew/meralion-education-lora with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="munyew/meralion-education-lora")
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("munyew/meralion-education-lora", dtype="auto")
What is a pickle import?
How to fix it?
