Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

typealias
/
llm-compiler-13b-ftd-mlx-4bit

MLX
Safetensors
llama
Model card Files Files and versions
xet
Community
2

Instructions to use typealias/llm-compiler-13b-ftd-mlx-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • MLX

    How to use typealias/llm-compiler-13b-ftd-mlx-4bit with MLX:

    # Download the model from the Hub
    pip install huggingface_hub[hf_xet]
    
    huggingface-cli download --local-dir llm-compiler-13b-ftd-mlx-4bit typealias/llm-compiler-13b-ftd-mlx-4bit
  • Notebooks
  • Google Colab
  • Kaggle
  • Local Apps
  • LM Studio
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

[WIP] Upload folder using huggingface_hub (multi-commit 61504a1ce0f9ceb29c706b2ad4d83a0c36cf95ab29989669d384337021285a3d)

#1 opened almost 2 years ago by
typealias
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs