Instructions to use KennethTM/pix2struct-base-table2html with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use KennethTM/pix2struct-base-table2html with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "image-to-text" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # 'pip install "transformers<5.0.0' from transformers import pipeline pipe = pipeline("image-to-text", model="KennethTM/pix2struct-base-table2html")# Load model directly from transformers import AutoProcessor, AutoModelForImageTextToText processor = AutoProcessor.from_pretrained("KennethTM/pix2struct-base-table2html") model = AutoModelForImageTextToText.from_pretrained("KennethTM/pix2struct-base-table2html") - Notebooks
- Google Colab
- Kaggle
Training Pipeline for Vision Transformers
#1
by MaxBolD - opened
Hi @KennethTM
I'm working on a similar task with Vision Transformers but I'm struggling to set up a training pipeline.
Would you mind sharing yours? It would help me a lot to get started! Thanks in advance!
Hi
I based my training on these notebooks:
https://github.com/NielsRogge/Transformers-Tutorials/blob/master/Pix2Struct/Fine_tune_Pix2Struct_on_key_value_pair_dataset_(PyTorch_Lightning).ipynb
https://github.com/huggingface/notebooks/blob/main/examples/image_captioning_pix2struct.ipynb
Hope that helps.
Kenneth
MaxBolD changed discussion status to closed