You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Training

First, download the pretraining dataset for LLaVA-NeXT from HuggingFace.

To initiate pretraining, run the following script:

LLaVA-NeXT/scripts/train/pretrain_pangea.sh

This process will generate a mm_projector.bin file, which is required for the next stage.

After obtaining the fine-tuning data, run the following script to begin fine-tuning:

LLaVA-NeXT/scripts/train/finetune_pangea.sh

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support