Article
Sparse Mixture of Experts Language Model from Scratch: Extending makeMoE with Expert Capacity
AviSoori1x
• • 14Thierry Herrmann
thierryh
AI & ML interests
deep learning, machine learning
Organizations
None yet
upvoted 2
articles 9 months ago
Article
makeMoE: Implement a Sparse Mixture of Experts Language Model from Scratch
AviSoori1x
• • 121 upvoted 6
articles about 1 year ago
Article
Train 400x faster Static Embedding Models with Sentence Transformers
tomaarsen
• • 230 Article
Training and Finetuning Embedding Models with Sentence Transformers
tomaarsen
• • 274 Article
Training and Finetuning Reranker Models with Sentence Transformers
tomaarsen
• • 194 Article
Faster Text Generation with Self-Speculative Decoding
- +2
ariG23498, melhoushi, pcuenq, reach-vb
• • 65 Article
Controlling Language Model Generation with NVIDIA's LogitsProcessorZoo
ariG23498, aerdem4
• • 51 Article
Visualize and understand GPU memory in PyTorch
qgallouedec
• • 270 upvoted an article over 1 year ago
Article
From PyTorch DDP to Accelerate to Trainer, mastery of distributed training with ease
muellerzr
• • 44