---
pipeline_tag: text-generation
tags:
  - pytorch
  - code-generation
---

# Custom GPT for Python Code Completion

## Model Details
- **Parameters:** 135.00M
- **Architecture:** Transformer (12 layers, 12 heads, 768 embedding dimension)
- **Context Length (Block Size):** 1024 tokens

## Training Metrics
- **Final Validation Loss:** `1.6620`