talkie-lm/talkie-1930-13b-base
Updated • 82
talkie-13b
talkie-1930-13b is a vintage language model trained on pre-1931 English-language text. See https://github.com/talkie-lm/talkie to run talkie.
Note Base 13B vintage language model trained on 260B tokens of pre-1931 English-language text.
talkie-lm/talkie-1930-13b-it
Updated • 239Note Instruction-tuned version of talkie-1930-13b-base. Fine-tuned on instruction-response pairs extracted from vintage reference works such as etiquette manuals, letter-writing manuals, and encyclopedias. Also RL'd using online DPO with an LLM-as-a-judge to improve instruction-following ability in chats.
talkie-lm/talkie-web-13b-base
Updated • 10Note Base 13b model with identical architecture and training FLOPs to talkie-1930-13b. Provided for controlled comparisons between vintage and modern models.