Hugging Face's logo

microsoft
/
phi-1_5

Text Generation
Transformers
Safetensors
English
phi
nlp
code
text-generation-inference
Model card Files
xet
 Community
94

Unofficial dataset

#2
by SinanAkkoyun - opened
Discussion
SinanAkkoyun

Hey, is there an unofficial dataset available? Would love to train tinyllama with phi's dataset
breadlicker45

My best guess is your never getting the dataset
VatsaDev

Same, love a finetune for tinyllama with this data, but it looks like MS wont be releasing it.
breadlicker45

Yeah
kotyKD

https://huggingface.co/datasets/nampdn-ai/tiny-textbooks
VatsaDev

Nice
SinanAkkoyun

@kotyKD Thank you so much :) I will keep this open if others emerge
VatsaDev

https://huggingface.co/datasets/emrgnt-cmplxty/sciphi-textbooks-are-all-you-need

this too right?
SinanAkkoyun

@VatsaDev Thank you! 😍
VatsaDev

If anyone wants to see an even smaller model off this, I have a project https://github.com/VatsaDev/NanoPhi, where I'm trying to finetune GPT-2 off these unofficial datasets
gugarosa changed discussion status to closed

Sign up or log in to comment