1024 in max_position_embeddings
#2
by
khtsly
- opened
i realized if "max_position_embeddings" is set to 1024 instead of 2048, which one is correct?
Good catch! the actual context length is 1024 tokens. The README incorrectly stated 2048, I've updated it to reflect the correct value. Thanks for flagging this!
codelion
changed discussion status to
closed