metadata
pipeline_tag: text-generation
tags:
- pytorch
- code-generation
Custom GPT for Python Code Completion
Model Details
- Parameters: 135.00M
- Architecture: Transformer (12 layers, 12 heads, 768 embedding dimension)
- Context Length (Block Size): 1024 tokens
Training Metrics
- Final Validation Loss:
1.6620