chatllm.cpp supports this model and the 2D-RoPE is wrong
#7
by J22 - opened
chatllm.cpp supports this model. One can run this as simple as:
server ---chat :penguin-vl
About "2D-RoPE"
When calculating "2D-RoPE", the first half ("real" part) from RoPE of height position and the second half ("imaginary" part) from RoPE of width position are combined. This is not RoPE at all.