cerebras

/

Cerebras-GPT-13B

like 649

Follow

Cerebras 1.51k

Hi, this blog and documentation from Hugging Face may be helpful to get you started:

• https://huggingface.co/blog/accelerate-large-models
• https://huggingface.co/docs/transformers/big_models
• https://huggingface.co/docs/transformers/main_classes/model#large-model-loading
• https://huggingface.co/docs/accelerate/usage_guides/big_modeling