hf-transformers-support

#1

Add a transformers PreTrainedModel for MSA Pairformer

This allows for downstream use of MSA Pairformer with HuggingFace libraries like PEFT and TRL.

msa_pairformer_tokenizer = AutoTokenizer.from_pretrained('yoakiyama/MSA-Pairformer')
msa_pairformer = MsaPairformer.from_pretrained('yoakiyama/MSA-Pairformer')

inputs = msa_pairformer_tokenizer(msa)
results = msa_pairformer(inputs['input_ids'], inputs['attention_mask'])

Github PR:
https://github.com/yoakiyama/MSA_Pairformer/pull/4

Publish this branch
This branch is in draft mode, publish it to be able to merge.

Sign up or log in to comment