OpenEnvisionLab/WorldArena
Updated • 1
HouJiadong PRO
iChubai
AI & ML interests
None yet
Recent Activity
updated a dataset about 3 hours ago
OpenEnvisionLab/WorldArena updated a dataset 2 days ago
iChubai/dsahbjkbdhsab published a dataset 5 days ago
iChubai/dsahbjkbdhsabOrganizations
updated a
dataset about 3 hours ago
updated a
dataset 2 days ago
published a
dataset 5 days ago
updated a
bucket 5 days ago
reacted to Juanxi's post with ❤️🚀🔥👍😎🤗🔥 6 days ago
Post
4370
📢 Awesome Multimodal Modeling
We introduce Awesome Multimodal Modeling, a curated repository tracing the architectural evolution of multimodal intelligence—from foundational fusion to native omni-models.
🔹 Taxonomy & Evolution:
Traditional Multimodal Learning – Foundational work on representation, fusion, and alignment.
Multimodal LLMs (MLLMs) – Architectures connecting vision encoders to LLMs for understanding.
Unified Multimodal Models (UMMs) – Models unifying Understanding + Generation via Diffusion, Autoregressive, or Hybrid paradigms.
Native Multimodal Models (NMMs) – Models trained from scratch on all modalities; contrasts early vs. late fusion under scaling laws.
💡 Key Distinction:
UMMs unify tasks via generation heads; NMMs enforce interleaving through joint pre-training.
🔗 Explore & Contribute: https://github.com/OpenEnvision/Awesome-Multimodal-Modeling
We introduce Awesome Multimodal Modeling, a curated repository tracing the architectural evolution of multimodal intelligence—from foundational fusion to native omni-models.
🔹 Taxonomy & Evolution:
Traditional Multimodal Learning – Foundational work on representation, fusion, and alignment.
Multimodal LLMs (MLLMs) – Architectures connecting vision encoders to LLMs for understanding.
Unified Multimodal Models (UMMs) – Models unifying Understanding + Generation via Diffusion, Autoregressive, or Hybrid paradigms.
Native Multimodal Models (NMMs) – Models trained from scratch on all modalities; contrasts early vs. late fusion under scaling laws.
💡 Key Distinction:
UMMs unify tasks via generation heads; NMMs enforce interleaving through joint pre-training.
🔗 Explore & Contribute: https://github.com/OpenEnvision/Awesome-Multimodal-Modeling
- 2 replies
published a
bucket 6 days ago
updated a
dataset 12 days ago
liked a
dataset 17 days ago
published 2
datasets 18 days ago
updated a
dataset 24 days ago
liked a
dataset 28 days ago
upvoted a paper 5 months ago
liked a
dataset 5 months ago