Pretraining A Large Language Model using Distributed GPUs: A Memory-Efficient Decentralized Paradigm
Paper • 2602.11543 • Published • 6 •
4
Jinrui Zhang
zjr2000
AI & ML interests
None yet
Recent Activity
liked a Space 25 days ago
woshichaoren123/test updated a model 27 days ago
zjr2000/spes-debug published a model 27 days ago
zjr2000/spes-debugOrganizations
None yet
commented a
paper about 2 months ago