BOS Token
#1
by 1AH - opened
Is this correct?
llm_load_print_meta: BOS token = 151643 '<|endoftext|>'
Weirdly yes π€·ββοΈ in theory it can be anything, the model just sees the token ID, but this is the correct ID which maps to <|endoftext|> haha
Thanks for the sanity check (and the quant.) Model works great, but that sure looks weird at the start of a prompt.
1AH changed discussion status to closed