Noah Lee's picture

Noah Lee

nlee-208

·

https://nlee-208.github.io/

AI & ML interests

LLM, Human Alignment, Uncertainty

Organizations

nlee-208 's models 51

nlee-208/Q3-Help-DPO

Text Generation • Updated Jul 25, 2025 • 2

nlee-208/Q25-Help-DPO

Text Generation • Updated Jul 24, 2025 • 1

nlee-208/Q25-Harm-DPO

Text Generation • Updated Jul 24, 2025 • 1

nlee-208/Q25-7B-IT-LIMO-5ep

Text Generation • 8B • Updated Feb 27, 2025 • 2

nlee-208/Q25-7B-IT-KoLIMO-5ep

Text Generation • 8B • Updated Feb 27, 2025 • 4

nlee-208/Q25-M-7B-IT-KoLIMO-5ep

Text Generation • 8B • Updated Feb 26, 2025 • 6

nlee-208/uf-qwen2-7IT-sft_bon

8B • Updated Sep 20, 2024 • 2

nlee-208/zephyr-7b-kto

Text Generation • 7B • Updated Jul 28, 2024 • 1

nlee-208/zephyr-7b-sft-kto2

Text Generation • 7B • Updated Jul 27, 2024

nlee-208/zephyr-7b-sft-kto1

Updated Jul 27, 2024

nlee-208/zephyr-7b-sft-kto

Updated Jul 27, 2024

nlee-208/uf-mistral-it-sft-g0

Text Generation • 8B • Updated Jul 22, 2024 • 3

nlee-208/uf-mistral-it-dpo-iopo-iter1

Text Generation • 7B • Updated Jul 22, 2024

nlee-208/uf-mistral-it-dpo-iopo-iter1-short

Text Generation • 7B • Updated Jul 21, 2024

nlee-208/uf-mistral-it-sft-iopo-iter1

Text Generation • 7B • Updated Jul 21, 2024

nlee-208/uf-mistral-it-sft-iopo-iter1-short

Text Generation • 7B • Updated Jul 20, 2024 • 2

nlee-208/uf-mistral-it-orpo-iopo-iter1

Text Generation • 7B • Updated Jul 20, 2024 • 11

nlee-208/uf-mistral-it-orpo-iopo-iter1-short

Text Generation • 7B • Updated Jul 20, 2024 • 1

nlee-208/uf-mistral-base-sft-g0-3e

Text Generation • 7B • Updated Jul 19, 2024 • 16

nlee-208/uf-g0-mistral-it-sft

Updated Jul 11, 2024

nlee-208/inverted-orpo-mistral-capybara

Text Generation • 7B • Updated May 8, 2024 • 7