| # NTILC Normal Prototype-CE v0.1.0 | |
| NTILC tool-embedding checkpoint prepared for `OpenToolEmbeddings/ntilc-normal-prototype-ce-v0-1-0`. | |
| ## Variant | |
| - Architecture: `normal` | |
| - Loss: `prototype_ce` | |
| - Encoder: `sentence-transformers/all-MiniLM-L6-v2` | |
| - Embedding dimension: `128` | |
| - Dataset version: `oss-qwen3.5-27b-26tools-312queries-v0.1.0` | |
| - Synthetic generator: `Qwen/Qwen3.5-27B` | |
| - Tool count: `26` | |
| - Query count: `312` | |
| - Checkpoint SHA256: `3077554cde03c765a9262f04f54630304fad06fee1e9bb21d76ceb2bdd75ae06` | |
| ## Files | |
| - `best.pt`: best validation checkpoint bundle | |
| - `metrics.json`: per-epoch training and validation metrics | |
| ## Usage | |
| These are NTILC checkpoint bundles, not plain `transformers` repositories. Load them with the local helper below. | |
| ```python | |
| from training import load_checkpoint_bundle | |
| bundle = load_checkpoint_bundle("best.pt", device="cpu") | |
| print(bundle["architecture"], bundle["loss_name"], len(bundle["tool_names"])) | |
| ``` | |
| ## Metrics | |
| - `epochs`: `25` | |
| - `best_epoch`: `18` | |
| - `tool_count`: `26` | |
| - `query_count`: `312` | |
| - `best_val_retrieval_accuracy`: `0.8269` | |
| - `best_val_classification_accuracy`: `0.75` | |
| - `silhouette_score`: `0.111` | |