Collection by 
Mar 2
Collections
Discover the best community collections!
Collections including paper arxiv:2402.16819
Collection by 
Feb 18, 2025
-
Nemotron-4 15B Technical Report
Paper • 2402.16819 • Published • 46 -
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 57 -
RWKV: Reinventing RNNs for the Transformer Era
Paper • 2305.13048 • Published • 21 -
Reformer: The Efficient Transformer
Paper • 2001.04451 • Published • 2
Collection by 
Sep 23, 2024
-
Nemotron-4 15B Technical Report
Paper • 2402.16819 • Published • 46 -
InternLM2 Technical Report
Paper • 2403.17297 • Published • 34 -
Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
Paper • 2404.04167 • Published • 13 -
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
Paper • 2402.14905 • Published • 134
Collection by 
Aug 27, 2024
-
Rethinking Optimization and Architecture for Tiny Language Models
Paper • 2402.02791 • Published • 13 -
More Agents Is All You Need
Paper • 2402.05120 • Published • 57 -
Scaling Laws for Forgetting When Fine-Tuning Large Language Models
Paper • 2401.05605 • Published -
Aligning Large Language Models with Counterfactual DPO
Paper • 2401.09566 • Published • 2
Collection by 
Mar 19, 2024
-
Scaling Instruction-Finetuned Language Models
Paper • 2210.11416 • Published • 8 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 150 -
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Paper • 2403.05530 • Published • 64 -
Yi: Open Foundation Models by 01.AI
Paper • 2403.04652 • Published • 65
Collection by 
Jun 9, 2025
Collection by 
Feb 27, 2024
Collection by 
Aug 1, 2024
-
Attention Is All You Need
Paper • 1706.03762 • Published • 120 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 26 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 10 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 22
Collection by Mar 2
Collection by Mar 19, 2024
-
Scaling Instruction-Finetuned Language Models
Paper • 2210.11416 • Published • 8 -
Mamba: Linear-Time Sequence Modeling with Selective State Spaces
Paper • 2312.00752 • Published • 150 -
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
Paper • 2403.05530 • Published • 64 -
Yi: Open Foundation Models by 01.AI
Paper • 2403.04652 • Published • 65
Collection by Feb 18, 2025
-
Nemotron-4 15B Technical Report
Paper • 2402.16819 • Published • 46 -
Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models
Paper • 2402.19427 • Published • 57 -
RWKV: Reinventing RNNs for the Transformer Era
Paper • 2305.13048 • Published • 21 -
Reformer: The Efficient Transformer
Paper • 2001.04451 • Published • 2
Collection by Jun 9, 2025
Collection by Sep 23, 2024
-
Nemotron-4 15B Technical Report
Paper • 2402.16819 • Published • 46 -
InternLM2 Technical Report
Paper • 2403.17297 • Published • 34 -
Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
Paper • 2404.04167 • Published • 13 -
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases
Paper • 2402.14905 • Published • 134
Collection by Feb 27, 2024
Collection by Aug 27, 2024
-
Rethinking Optimization and Architecture for Tiny Language Models
Paper • 2402.02791 • Published • 13 -
More Agents Is All You Need
Paper • 2402.05120 • Published • 57 -
Scaling Laws for Forgetting When Fine-Tuning Large Language Models
Paper • 2401.05605 • Published -
Aligning Large Language Models with Counterfactual DPO
Paper • 2401.09566 • Published • 2
Collection by Aug 1, 2024
-
Attention Is All You Need
Paper • 1706.03762 • Published • 120 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 26 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 10 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 22