OpenVision
Collection
27 items • Updated • 33
How to use UCSC-VLAA/openvision-vit-small-patch16-160 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-feature-extraction", model="UCSC-VLAA/openvision-vit-small-patch16-160") # Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("UCSC-VLAA/openvision-vit-small-patch16-160", dtype="auto")This repository contains the model for extracting image features as described in OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning.
More information can be found on the project page and the Github repository.