M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 3 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 9 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 4 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 1 • 1
M2RNN Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models open-lm-engine/gdn-7b 7B • Updated Mar 12 • 3 • 1 open-lm-engine/m2rnn-7b 7B • Updated Mar 12 • 9 • 2 open-lm-engine/transformer-7b 7B • Updated Mar 12 • 4 • 1 open-lm-engine/hybrid-gdn-7b 7B • Updated Mar 12 • 1 • 1
