Text Summarization
#1
by aritrasen - opened
Running the model on dialogsum dataset to generate summary of the text, response is not getting generated properly , input text is getting repeated.
Please find the attached image for the input and output.
Please let me know what I am doing wrong to fix the issue.
try using repetition_penalty=1.2 temprature
Or there might be some problem with lora
And this is the sharded version of TheBloke/Llama-2-7B-fp16
repetition_penalty=1.2 , this has worked for me, thanks a lot.
aritrasen changed discussion status to closed