Transformers How to use openpecha/aligner with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM
tokenizer = AutoTokenizer.from_pretrained("openpecha/aligner")
model = AutoModelForMultimodalLM.from_pretrained("openpecha/aligner") 
