In-context Autoencoder for Context Compression in a Large Language Model
Paper
•
2307.06945
•
Published
•
28
This are models trained based on this paper. Pretrained on SlimPajama-6B and Fine-Tuned on SWE-smith trajectories by Claude 3.7 Sonnet. For more information see