open-lm-engine/gdn-7b
7B • Updated • 5 • 1
M2RNN
Note that the 7B models are MoE with 1.1B active parameters and 400M models are dense models
-
-
open-lm-engine/m2rnn-7b
7B • Updated • 10 • 2 -
open-lm-engine/transformer-7b
7B • Updated • 4 • 1 -
open-lm-engine/hybrid-gdn-7b
7B • Updated • 22 • 1 -
open-lm-engine/hybrid-m2rnn-7b
7B • Updated • 4 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-7b
7B • Updated • 5 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-5l-7b
7B • Updated • 3 • 1 -
open-lm-engine/gdn-400m
0.4B • Updated • 60 • 1 -
open-lm-engine/m2rnn-400m
0.4B • Updated • 64 • 1 -
open-lm-engine/transformer-400m
0.4B • Updated • 15 • 1 -
open-lm-engine/hybrid-gdn-400m
0.4B • Updated • 14 • 2 -
open-lm-engine/hybrid-m2rnn-400m
0.4B • Updated • 9 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-1l-400m
0.4B • Updated • 7 • 1 -
open-lm-engine/hybrid-gdn-m2rnn-3l-400m
0.4B • Updated • 4 • 1