2025-01-07 18:06:33,931 - INFO - Starting processing with 8 threads
2025-01-07 18:06:34,650 - INFO - Loaded 10 rows from data/lmsys1m_hf_inference_api.parquet
2025-01-07 18:06:34,652 - INFO - Processing row 1e53daaab9254029b805bde43e19ce2a with model Qwen/Qwen2.5-Coder-32B-Instruct
2025-01-07 18:06:34,654 - INFO - Processing row 34df72c91a3e40e0a51700daf90ed505 with model Qwen/Qwen2.5-Coder-32B-Instruct
2025-01-07 18:06:34,656 - INFO - Processing row a641e9b4115145cebc9fd93f3208b113 with model deepseek-ai/DeepSeek-V3
2025-01-07 18:06:34,657 - INFO - Processing row 7c5ada6db2cf4b78900c8d5ad20bbc12 with model meta-llama/Llama-3.3-70B-Instruct
2025-01-07 18:06:34,659 - INFO - Processing row d9410fd37ce54135a4c6e7a808ef037f with model Qwen/Qwen2.5-72B-Instruct
2025-01-07 18:06:34,660 - INFO - Processing row 8d572e08959a4bdb8afc60ee6ef19470 with model Qwen/QwQ-32B-Preview
2025-01-07 18:06:34,661 - INFO - Processing row 3dab91e72476451db0b4a6cd7610d0bc with model 01-ai/Yi-1.5-34B-Chat
2025-01-07 18:06:34,662 - INFO - Processing row b12c5aadf1774d68a57090d115c04091 with model EleutherAI/gpt-neox-20b
2025-01-07 18:06:34,703 - ERROR - Error processing row a641e9b4115145cebc9fd93f3208b113: (Request ID: x-X--HjSJxKTsl2MKdTuM)

Bad request:
Task not found for this model
2025-01-07 18:06:34,703 - INFO - Processing row 0274a35d3c45462c95ba6f68d9c03c9a with model Nexusflow/Athene-V2-Chat
2025-01-07 18:06:34,704 - INFO - Progress: 1/10 rows completed
2025-01-07 18:06:34,728 - ERROR - Error processing row b12c5aadf1774d68a57090d115c04091: 422 Client Error: Unprocessable Entity for url: https://api-inference.huggingface.co/models/EleutherAI/gpt-neox-20b/v1/chat/completions (Request ID: I4R51Zbk7fqrqxjtdRd9b)

Template error: template not found
2025-01-07 18:06:34,728 - INFO - Processing row c129f9ddaea64668a7945254b47c0613 with model HuggingFaceH4/starchat2-15b-v0.1
2025-01-07 18:06:34,728 - INFO - Progress: 2/10 rows completed
2025-01-07 18:06:34,741 - ERROR - Error processing row 0274a35d3c45462c95ba6f68d9c03c9a: (Request ID: pLefvVxybMLVOr4TKbL-U)

403 Forbidden: None.
Cannot access content at: https://api-inference.huggingface.co/models/Nexusflow/Athene-V2-Chat/v1/chat/completions.
Make sure your token has the correct permissions.
The model Nexusflow/Athene-V2-Chat is too large to be loaded automatically (145GB > 10GB). Please use Spaces (https://huggingface.co/spaces) or Inference Endpoints (https://huggingface.co/inference-endpoints).
2025-01-07 18:06:34,741 - INFO - Progress: 3/10 rows completed
2025-01-07 18:06:35,246 - INFO - Completed row 8d572e08959a4bdb8afc60ee6ef19470 in 0.59s using Qwen/QwQ-32B-Preview
2025-01-07 18:06:35,432 - INFO - Completed row 7c5ada6db2cf4b78900c8d5ad20bbc12 in 0.77s using meta-llama/Llama-3.3-70B-Instruct
2025-01-07 18:06:35,972 - INFO - Completed row c129f9ddaea64668a7945254b47c0613 in 1.24s using HuggingFaceH4/starchat2-15b-v0.1
2025-01-07 18:06:36,247 - INFO - Progress: 4/10 rows completed
2025-01-07 18:06:36,433 - INFO - Progress: 5/10 rows completed
2025-01-07 18:06:36,973 - INFO - Progress: 6/10 rows completed
2025-01-07 18:06:36,990 - INFO - Completed row 3dab91e72476451db0b4a6cd7610d0bc in 2.33s using 01-ai/Yi-1.5-34B-Chat
2025-01-07 18:06:37,992 - INFO - Progress: 7/10 rows completed
2025-01-07 18:06:38,896 - INFO - Completed row 34df72c91a3e40e0a51700daf90ed505 in 4.24s using Qwen/Qwen2.5-Coder-32B-Instruct
2025-01-07 18:06:39,898 - INFO - Progress: 8/10 rows completed
2025-01-07 18:06:49,447 - INFO - Completed row 1e53daaab9254029b805bde43e19ce2a in 14.79s using Qwen/Qwen2.5-Coder-32B-Instruct
2025-01-07 18:06:50,449 - INFO - Progress: 9/10 rows completed
2025-01-07 18:07:18,591 - INFO - Completed row d9410fd37ce54135a4c6e7a808ef037f in 43.93s using Qwen/Qwen2.5-72B-Instruct
2025-01-07 18:07:19,592 - INFO - Progress: 10/10 rows completed
2025-01-07 18:07:19,597 - INFO - Saved processed data to ./output/lmsys_1m_hf_first_20k.parquet
2025-01-07 18:07:19,671 - WARNING - Note: Environment variable`HF_TOKEN` is set and is the current active token independently from the token you've just configured.