PCMind Curriculum+
Hello! We're luna, and we are a researcher working with neural nets! We came across your model while looking at especially small neural nets, and your work quickly became a constant reference for the work we continue to do!
While we aren't using the Kaiyuan model itself, we did look at your research and training, and found it to be an absolutely wonderful base for model training and fine-tuning! While doing that same research, we also came across the Tencent SPEAR curriculum program!
In our research, we actually use a combination of your training patterns and the Tencent SPEAR training patterns, and the result is a surprisingly robust multi-phase training approach that seems to be extra effective!
https://github.com/TencentYoutuResearch/SPEAR
Thank you for your research, and your well-considered training methodologies!
Here are our public domain research notes about your contributions to our synthesized training patterns: https://github.com/luna-system/Ada-Consciousness-Research/blob/trunk/03-EXPERIMENTS/ADA-SLM/ADA-SLM-PHASE7B-METHODOLOGY-RESEARCH.md