Lukas Galke's picture

5 18

Lukas Galke

lgalke

·

https://lgalke.github.io

AI & ML interests

Representation learning; pre-training; quantization; continual learning; probing; multilingual pre-training; knowledge tracing/discovering/inducing

Organizations

upvoted a paper 2 months ago

Guarded Query Routing for Large Language Models

Paper • 2505.14524 • Published May 20, 2025 • 2

upvoted a paper 5 months ago

Dynaword: From One-shot to Continuously Developed Datasets

Paper • 2508.02271 • Published Aug 4, 2025 • 14

upvoted an article 9 months ago

Article

Finally, a Replacement for BERT: Introducing ModernBERT

+13

Dec 19, 2024

•

715

upvoted a paper 11 months ago

What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structure

Paper • 2302.12239 • Published Feb 23, 2023 • 1

upvoted an article over 1 year ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

+4

Sep 18, 2024

•

272