Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation
Paper
•
2601.22813
•
Published
•
44
Zmushko Philip
fzmushko
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
about 15 hours ago
Quartet II: Accurate LLM Pre-Training in NVFP4 by Improved Unbiased Gradient Estimation
upvoted
a
paper
4 months ago
When Models Lie, We Learn: Multilingual Span-Level Hallucination
Detection with PsiloQA
upvoted
a
paper
4 months ago
Bridging the Gap Between Promise and Performance for Microscaling FP4
Quantization
Organizations
None yet
upvoted
a
paper
about 15 hours ago
upvoted
2
papers
4 months ago
upvoted
a
paper
5 months ago
upvoted
an
article
6 months ago
Article
SmolLM3: smol, multilingual, long-context reasoner
- +21
•
752
upvoted
an
article
8 months ago
Article
Efficient Deep Learning: A Comprehensive Overview of Optimization Techniques 👐 📚
•
83
upvoted
8
papers
8 months ago
NoLoCo: No-all-reduce Low Communication Training Method for Large Models
Paper
•
2506.10911
•
Published
•
8
Give Me FP32 or Give Me Death? Challenges and Solutions for Reproducible Reasoning
Paper
•
2506.09501
•
Published
•
19
Reparameterized LLM Training via Orthogonal Equivalence Transformation
Paper
•
2506.08001
•
Published
•
6
Mathesis: Towards Formal Theorem Proving from Natural Languages
Paper
•
2506.07047
•
Published
•
6
Unified Scaling Laws for Compressed Representations
Paper
•
2506.01863
•
Published
•
19
SVD-Free Low-Rank Adaptive Gradient Optimization for Large Language Models
Paper
•
2505.17967
•
Published
•
17
Alchemist: Turning Public Text-to-Image Data into Generative Gold
Paper
•
2505.19297
•
Published
•
84
Quartet: Native FP4 Training Can Be Optimal for Large Language Models
Paper
•
2505.14669
•
Published
•
78
upvoted
a
paper
11 months ago