File size: 626 Bytes
10cbeb6 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 | model_info:
name: anemll-5a149550068a1eb93398160d8953f5f56c3603e9-ctx2048
version: 0.3.0
description: |
Demonstarates running 5a149550068a1eb93398160d8953f5f56c3603e9 on Apple Neural Engine
Context length: 2048
Batch size: 64
Chunks: 2
license: MIT
author: Anemll
framework: Core ML
language: Python
parameters:
context_length: 2048
batch_size: 64
lut_embeddings: 8
lut_ffn: 4
lut_lmhead: 6
num_chunks: 2
model_prefix: phi4
embeddings: phi4_embeddings_lut8.mlmodelc
lm_head: phi4_lm_head_lut6.mlmodelc
ffn: phi4_FFN_PF_lut4.mlmodelc
split_lm_head: 1
|