is this model still can use 1M context window or not?
#1
by Slach - opened
I see model and files was renamed after my last download
Yes, it's compatible with the YaRN method, so you can add to the llama.cpp command line:
--rope-scaling yarn --rope-scale 4 --yarn-orig-ctx 262144 --ctx-size 1048576