Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
117
324
Dokyoon
leeloolee
Follow
kaki-paper's profile picture
shootstufff's profile picture
etri-econ-llm's profile picture
12 followers
·
126 following
Eruly
AI & ML interests
ai
Recent Activity
reacted
to
anakin87
's
post
with ❤️
8 days ago
📣 I just published a free course on Reinforcement Learning Environments for Language Models! 📌 COURSE: https://github.com/anakin87/llm-rl-environments-lil-course Over the past year, we've seen a shift in LLM Post-Training. Previously, Supervised Fine-Tuning was the most important part: making models imitate curated Question-Answer pairs. Now we also have Reinforcement Learning with Verifiable Rewards. With techniques like GRPO, models can learn through trial and error in dynamic environments. They can climb to new heights without relying on expensively prepared data. But what actually are these environments in practice❓ And how do you build them effectively❓ Fascinated by these concepts, I spent time exploring this space through experiments, post-training Small Language Models. I've packaged everything I learned into this short course. What you'll learn 🔹 Agents, Environments, and LLMs: how to map Reinforcement Learning concepts to the LLM domain 🔹 How to use Verifiers (open-source library by Prime Intellect) to build RL environments as software artifacts 🔹 Common patterns: How to build single-turn, multi-turn, and tool-use environments 🔹 Hands-on: turn a small language model (LFM2-2.6B by LiquidAI) into a Tic Tac Toe master 🔸 Build the game Environment 🔸 Use it to generate synthetic data for SFT warm-up 🔸 Group-based Reinforcement Learning If you're interested in building "little worlds" where LLMs can learn, this course is for you. --- 🤗🕹️ Play against the trained model: https://huggingface.co/spaces/anakin87/LFM2-2.6B-mr-tictactoe 📚 HF collection (datasets + models): https://huggingface.co/collections/anakin87/lfm2-26b-mr-tic-tac-toe
liked
a dataset
22 days ago
InternScience/ResearchClawBench
liked
a model
22 days ago
rl-research/DR-Tulu-8B-results
View all activity
Organizations
leeloolee
's models
46
Sort: Recently updated
leeloolee/online_dpo_17_00_44
Updated
Aug 2, 2024
leeloolee/online_dpo_16_52_35
Updated
Aug 2, 2024
leeloolee/online_dpo_16_50_51
Updated
Aug 2, 2024
leeloolee/online_dpo_16_47_50
Updated
Aug 2, 2024
leeloolee/online_dpo_16_45_31
Updated
Aug 2, 2024
leeloolee/online_dpo_16_39
Updated
Aug 2, 2024
leeloolee/online_dpo_16_09
Updated
Aug 2, 2024
leeloolee/online_dpo_16_02
Updated
Aug 2, 2024
leeloolee/online_dpo_15_59
Updated
Aug 2, 2024
leeloolee/online_dpo_15_55
Updated
Aug 2, 2024
leeloolee/online_dpo-0802
Updated
Aug 2, 2024
leeloolee/online_dpo
Updated
Aug 1, 2024
leeloolee/boosted-qwen2-7b
Text Generation
•
8B
•
Updated
Jul 17, 2024
•
14
•
1
leeloolee/Xionic-7b
Updated
Jul 17, 2024
leeloolee/gwen
Updated
Jun 26, 2024
leeloolee/hello
Updated
Oct 29, 2023
Previous
1
2
Next