OpenToolEmbeddings/ntilc-hierarchical-prototype-ce-v0-1-0

NTILC Hierarchical Prototype-CE v0.1.0

NTILC tool-embedding checkpoint prepared for OpenToolEmbeddings/ntilc-hierarchical-prototype-ce-v0-1-0.

Variant

• Architecture: hierarchical
• Loss: prototype_ce
• Encoder: sentence-transformers/all-MiniLM-L6-v2
• Embedding dimension: 128
• Dataset version: oss-qwen3.5-27b-26tools-312queries-v0.1.0
• Synthetic generator: Qwen/Qwen3.5-27B
• Tool count: 26
• Query count: 312
• Checkpoint SHA256: 7eae6130003a091bef3c81d1d084b35d137974d0f4f5bc2fd61bd43684cc446f

Files

• best.pt: best validation checkpoint bundle
• metrics.json: per-epoch training and validation metrics

Usage

These are NTILC checkpoint bundles, not plain transformers repositories. Load them with the local helper below.

from training import load_checkpoint_bundle

bundle = load_checkpoint_bundle("best.pt", device="cpu")
print(bundle["architecture"], bundle["loss_name"], len(bundle["tool_names"]))

Metrics

• epochs: 25
• best_epoch: 19
• tool_count: 26
• query_count: 312
• best_val_tool_retrieval_accuracy: 0.7885
• best_val_parent_retrieval_accuracy: 0.9038
• best_val_tool_classification_accuracy: 0.7692
• best_val_parent_classification_accuracy: 0.9038
• tool_silhouette_score: 0.0825
• parent_silhouette_score: 0.069