1024 in max_position_embeddings

by khtsly - opened 1 day ago

khtsly

1 day ago

i realized if "max_position_embeddings" is set to 1024 instead of 2048, which one is correct?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment