Instructions to use google/matcha-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/matcha-base with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "visual-question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("visual-question-answering", model="google/matcha-base")# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("google/matcha-base") model = AutoModelForMultimodalLM.from_pretrained("google/matcha-base", device_map="auto") - Notebooks
- Google Colab
- Kaggle
File size: 249 Bytes
7885c22 | 1 2 3 4 5 6 7 8 9 10 11 12 13 | {
"do_convert_rgb": true,
"do_normalize": true,
"image_processor_type": "Pix2StructImageProcessor",
"is_vqa": true,
"max_patches": 2048,
"patch_size": {
"height": 16,
"width": 16
},
"processor_class": "Pix2StructProcessor"
}
|