UME-R1 is a framework designed to endow multimodal embedding models with the flexibility to switch between discriminative and generative embeddings
Zhibin Lan
zhibinlan
AI & ML interests
None yet
Recent Activity
new activity
about 10 hours ago
zhibinlan/UME-R1-7B:CoT data construction
upvoted
a
paper
about 1 month ago
Improving Multi-step RAG with Hypergraph-based Memory for Long-Context Complex Relational Modeling
new activity
3 months ago
zhibinlan/UME-R1-7B:CoT data construction
Organizations
None yet
LLaVE is a series of large language and vision embedding models trained on a variety of multimodal embedding datasets
-
zhibinlan/LLaVE-0.5B
Image-Text-to-Text • 0.9B • Updated • 116 • 7 -
zhibinlan/LLaVE-2B
Image-Text-to-Text • 2B • Updated • 97 • 45 -
zhibinlan/LLaVE-7B
Image-Text-to-Text • 8B • Updated • 296 • 5 -
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning
Paper • 2503.04812 • Published • 15
UME-R1 is a framework designed to endow multimodal embedding models with the flexibility to switch between discriminative and generative embeddings
LLaVE is a series of large language and vision embedding models trained on a variety of multimodal embedding datasets
-
zhibinlan/LLaVE-0.5B
Image-Text-to-Text • 0.9B • Updated • 116 • 7 -
zhibinlan/LLaVE-2B
Image-Text-to-Text • 2B • Updated • 97 • 45 -
zhibinlan/LLaVE-7B
Image-Text-to-Text • 8B • Updated • 296 • 5 -
LLaVE: Large Language and Vision Embedding Models with Hardness-Weighted Contrastive Learning
Paper • 2503.04812 • Published • 15
models
7
zhibinlan/UME-R1-7B
Image-Text-to-Text
•
8B
•
Updated
•
68
•
5
zhibinlan/UME-R1-2B
Image-Text-to-Text
•
2B
•
Updated
•
450
•
5
zhibinlan/LLaVE-7B
Image-Text-to-Text
•
8B
•
Updated
•
296
•
5
zhibinlan/LLaVE-0.5B
Image-Text-to-Text
•
0.9B
•
Updated
•
116
•
7
zhibinlan/LLaVE-2B
Image-Text-to-Text
•
2B
•
Updated
•
97
•
45
zhibinlan/AVG-LLaVA
Image-Text-to-Text
•
7B
•
Updated
•
3
•
2
zhibinlan/AVG-LLaVA-Stage3
Image-Text-to-Text
•
7B
•
Updated
•
1