Parameters (temperature) recommendation?
Hello,
Do you have any recommendation on what parameters settings are optimal for this model? Especially related to temperature.
Some tests I've tried result in returning extremely similar outcomes for few-shot experiments (0-shot seemed to work as intended...)
Thank you
Hello @anto5040 ,
Could you clarify what you mean by “extremely similar outcomes”?
We recommend those reported in the generation_config.json file. If you can provide more details about the issue you are encountering, we may be able to offer more specific recommendations.
Best
Thank you for your fast answer @OSainz
I was indeed not using the recommended parameters because I wasn't aware of that file, thank you, it seems really useful. I'll try with them.
I was trying to classify user's intents from different sentences, and was consistently (90% of the time, but not 100%) getting a response like this:
def sailkatu_asmo(esaldia, etiketak):
# Baimendutako etiketak (erabili zehazki minuskulako kateak):
etiketak = { ...
Some variations did occur on the name of the function or the arguments, but i was consistently getting python functions instead of the intents. It might have to do with some of the syntax used for the few-shot experiments, but i haven't had any problems like this with the non instruct version, nor other LLMs. Let's see what results I get with the recommended parameters.
I was using transformers 4.57.3 and temperature = 0.1.