Gaia2 Leaderboard Update: New Models and New Observations
•
10
AI & ML interests
None defined yet.
Recent Activity
View all activity
Articles
Open source traces
2
#2 opened about 1 month ago
by
bhavishya2895
thomwolf
authored
a
paper
about 2 months ago
Post
2556
AI for Scientific Discovery Won't Work Without Fixing How We Collaborate.
My co-author @cgeorgiaw and I just published a paper challenging a core assumption: that the main barriers to AI in science are technical. They're not. They're social.
Key findings:
🚨 The "AI Scientist" myth delays progress: Waiting for AGI devalues human expertise and obscures science's real purpose: cultivating understanding, not just outputs.
📊 Wrong incentives: Datasets have 100x longer impact than models, yet data curation is undervalued.
⚠️ Broken collaboration: Domain scientists want understanding. ML researchers optimize performance. Without shared language, projects fail.
🔍 Fragmentation costs years: Harmonizing just 9 cancer files took 329 hours.
Why this matters: Upstream bottlenecks like efficient PDE solvers could accelerate discovery across multiple sciences. CASP mobilized a community around protein structure, enabling AlphaFold. We need this for dozens of challenges.
Thus, we're launching Hugging Science! A global community addressing these barriers through collaborative challenges, open toolkits, education, and community-owned infrastructure. Please find all the links below!
Paper: AI for Scientific Discovery is a Social Problem (2509.06580)
Join:
hugging-science
Discord: https://discord.com/invite/VYkdEVjJ5J
My co-author @cgeorgiaw and I just published a paper challenging a core assumption: that the main barriers to AI in science are technical. They're not. They're social.
Key findings:
🚨 The "AI Scientist" myth delays progress: Waiting for AGI devalues human expertise and obscures science's real purpose: cultivating understanding, not just outputs.
📊 Wrong incentives: Datasets have 100x longer impact than models, yet data curation is undervalued.
⚠️ Broken collaboration: Domain scientists want understanding. ML researchers optimize performance. Without shared language, projects fail.
🔍 Fragmentation costs years: Harmonizing just 9 cancer files took 329 hours.
Why this matters: Upstream bottlenecks like efficient PDE solvers could accelerate discovery across multiple sciences. CASP mobilized a community around protein structure, enabling AlphaFold. We need this for dozens of challenges.
Thus, we're launching Hugging Science! A global community addressing these barriers through collaborative challenges, open toolkits, education, and community-owned infrastructure. Please find all the links below!
Paper: AI for Scientific Discovery is a Social Problem (2509.06580)
Join:
hugging-science
Discord: https://discord.com/invite/VYkdEVjJ5J
RomainFroger
published
an
article
2 months ago
Article
Gaia2 Leaderboard Update: New Models and New Observations
•
10
Dataset Schema Documentation Misalignment
2
#4 opened 2 months ago
by
jhamburger-apple
Dataset Schema Documentation Misalignment
2
#4 opened 2 months ago
by
jhamburger-apple
mlcu
updated
a
dataset
2 months ago
mlcu
authored
a
paper
2 months ago
Update task category, paper, code, and project page links for Gaia2 dataset
1
#3 opened 2 months ago
by
nielsr
mortimerp9
updated
a
dataset
2 months ago
RomainFroger
updated
a
Space
2 months ago
GAIA2 only applicable to LLM evaluation not agent scaffold evaluation?
1
#1 opened 2 months ago
by
pseudotensor
dheeraj7596
authored
a
paper
2 months ago
gregmialz
authored
a
paper
2 months ago
upiter
authored
a
paper
2 months ago
RomainFroger
authored
a
paper
2 months ago
virginiedo
authored
a
paper
2 months ago
germtf
authored
a
paper
2 months ago
bamine
authored
a
paper
2 months ago
mortimerp9
authored
a
paper
2 months ago