What is the recommended temperature range
#11
by patrickfleith - opened
Which temperature do you recommend by default as a range?
- I read in model card you mention 0.1 Can you elaborate on the range?
patrickfleith changed discussion status to closed
patrickfleith changed discussion status to open
Hey temperature is expected to function better between 0.05 up to 0.15-0.20. 0.10 is a good place to start, Le Chat has a similar value. This is for instruct questions where you don't expect the model to be creative.
If you're looking for creative answers such as for RP for example you should try upper values.
The use case is about generate diverse synthetic questions and answers from engineering document chunks. So while I want some diversity in the question phrasing, I must not produce incorrect Q&As. I am starting with 0.1 and may try increase it if synthetic questions have a too similar structure.
Will try to post outcomes here