Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
huggingface 's Collections
DistilBERT release

DistilBERT release

updated Apr 17, 2024

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints.

Upvote
41

  • distilbert/distilbert-base-cased

    Fill-Mask • 65.8M • Updated May 6, 2024 • 219k • • 60

  • distilbert/distilbert-base-uncased

    Fill-Mask • 67M • Updated May 6, 2024 • 7.74M • • 861

  • distilbert/distilbert-base-multilingual-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 917k • • 238

  • distilbert/distilbert-base-uncased-finetuned-sst-2-english

    Text Classification • 67M • Updated Dec 19, 2023 • 2.98M • • 888

  • distilbert/distilbert-base-uncased-distilled-squad

    Question Answering • 66.4M • Updated May 6, 2024 • 45.3k • • 119

  • distilbert/distilbert-base-cased-distilled-squad

    Question Answering • 65.2M • Updated May 6, 2024 • 203k • • 266
Upvote
41
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs