AI & ML interests
Researching and building foundation models with improved generalization and reasoning. LAION & friends spin-off for open-sourcing foundation models with strong generalization and reasoning , including datasets necessary for their creation, to serve as common open, reproducible grounds for further research experiments.
-
open-sci/open-sci-ref-v0.01-0.13b-commoncorpus-300B-4096
0.1B • Updated • 57 -
open-sci/open-sci-ref-v0.01-0.4b-commoncorpus-300B-4096
0.4B • Updated • 7 -
open-sci/open-sci-ref-v0.01-1.3b-commoncorpus-300B-4096
1B • Updated • 9 -
open-sci/open-sci-ref-v0.01-1.7b-commoncorpus-300B-4096
2B • Updated • 75 • 1
-
open-sci/open-sci-ref-v0.01-0.13b-commoncorpus-300B-4096
0.1B • Updated • 57 -
open-sci/open-sci-ref-v0.01-0.4b-commoncorpus-300B-4096
0.4B • Updated • 7 -
open-sci/open-sci-ref-v0.01-1.3b-commoncorpus-300B-4096
1B • Updated • 9 -
open-sci/open-sci-ref-v0.01-1.7b-commoncorpus-300B-4096
2B • Updated • 75 • 1
models
68
open-sci/open-sci-ref-v0.01-1.7b-nemotron-cc-2024-hq-real-synth-mix-1T-8192
2B
•
Updated
•
8
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-1T-4096
2B
•
Updated
•
83
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-1T-16384
2B
•
Updated
•
8
open-sci/open-sci-ref-v0.01-1.7b-slimpajama-300B-4096
2B
•
Updated
•
21
open-sci/open-sci-ref-v0.01-1.7b-pile-300B-4096
2B
•
Updated
•
143
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-300B-8192
2B
•
Updated
•
5
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-300B-4096
2B
•
Updated
•
6
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-300B-16384
2B
•
Updated
•
21
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-1T-8192
2B
•
Updated
•
16
open-sci/open-sci-ref-v0.01-1.7b-nemotron-hq-1T-4096-rope_theta-100k
2B
•
Updated
•
12