Increasing the Context Length of the model.
#27
by siddharth-brightbots - opened
I want to increase the context of the model from 32k to 128k. It states in the documentation that it supports yarn. I am using the model through serverless API. Does anyone have any idea how to increase the context length, which parameter should I change?
siddharth-brightbots changed discussion status to closed