What is the best sampling config?
#1
by
pootow
- opened
What is the best value for temperature, top_k, top_p, etc.?
We recommend:
top_p=0.95temperature=0.6max_tokens=64000
alpayariyak
changed discussion status to
closed