Add Modeling for Jais Architecture to the Transformers repo
#2
by beratcmn - opened
Adding modelling for Jais similar to LLama models (https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py) would be very beneficial for custom engine integrations. By adding a modelling we can use engines such as VLLM and Text Generation Inference much more efficiently.
beratcmn changed discussion title from Add Modeling for Jais Architecture to Add Modeling for Jais Architecture to the Transformers repo
It is in plans. Will update next month.