Instructions to use princeton-nlp/AutoCompressor-Llama-2-7b-6k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use princeton-nlp/AutoCompressor-Llama-2-7b-6k with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("princeton-nlp/AutoCompressor-Llama-2-7b-6k") model = AutoModel.from_pretrained("princeton-nlp/AutoCompressor-Llama-2-7b-6k") - Notebooks
- Google Colab
- Kaggle
Commit ·
bd34c99
1
Parent(s): 40f4716
Update README.md
Browse files
README.md
CHANGED
|
@@ -5,7 +5,9 @@ license: apache-2.0
|
|
| 5 |
---
|
| 6 |
|
| 7 |
**Paper**: [Adapting Language Models to Compress Contexts](https://arxiv.org/abs/2305.14788)
|
|
|
|
| 8 |
**Code**: https://github.com/princeton-nlp/AutoCompressors
|
|
|
|
| 9 |
**Models**:
|
| 10 |
- Llama-2-7b fine-tuned models: [AutoCompressor-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-Llama-2-7b-6k/), [FullAttention-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/FullAttention-Llama-2-7b-6k)
|
| 11 |
- OPT-2.7b fine-tuned models: [AutoCompressor-2.7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-6k), [AutoCompressor-2.7b-30k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-30k), [RMT-2.7b-8k](https://huggingface.co/princeton-nlp/RMT-2.7b-8k)
|
|
|
|
| 5 |
---
|
| 6 |
|
| 7 |
**Paper**: [Adapting Language Models to Compress Contexts](https://arxiv.org/abs/2305.14788)
|
| 8 |
+
|
| 9 |
**Code**: https://github.com/princeton-nlp/AutoCompressors
|
| 10 |
+
|
| 11 |
**Models**:
|
| 12 |
- Llama-2-7b fine-tuned models: [AutoCompressor-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-Llama-2-7b-6k/), [FullAttention-Llama-2-7b-6k](https://huggingface.co/princeton-nlp/FullAttention-Llama-2-7b-6k)
|
| 13 |
- OPT-2.7b fine-tuned models: [AutoCompressor-2.7b-6k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-6k), [AutoCompressor-2.7b-30k](https://huggingface.co/princeton-nlp/AutoCompressor-2.7b-30k), [RMT-2.7b-8k](https://huggingface.co/princeton-nlp/RMT-2.7b-8k)
|