Fix tokenizer: add <IMG_CONTEXT> special token and preserve chat_template

#9

This PR cleanly fixes the KeyError: <IMG_CONTEXT> issue when using vLLM by adding <IMG_CONTEXT> as an additional special token.
Resolve issue for https://huggingface.co/MediaTek-Research/Llama-Breeze2-8B-Instruct/discussions/3

Ready to merge
This branch is ready to get merged automatically.

Sign up or log in to comment