RxT-Beta 3B A190M - Reactive Transformer MVP - a ReactiveAI Collection

ReactiveAI 's Collections

RxT-Beta 3B A190M - Reactive Transformer MVP

Reactive Transformer PoC - RxT-Beta-Micro models

RxT-Beta Training Datasets

Reactive Transformer PoC - RxT-Alpha Supervised Models

Sparse Query Attention (SQA) Research

Interaction SFT Datasets

RxT-Beta 3B A190M - Reactive Transformer MVP

updated Feb 18

Reactive Transformer MVP model with 3B total params and 190M activated in decoder. Training in progress