Topic

#llm-training

1 article exploring llm-training. Expert insights and analysis from our editorial team.

Showing 1–1 of 1 articles
Related topics:
entropy-regularization grpo ppo reinforcement-learning hyperparameter-optimization

Articles

Newest first
Models & Research

Fixed Entropy Coefficients Break Down on Mixed-Difficulty Tasks: What AER Means for Teams Running LLM RL at Scale

Static entropy regularization in GRPO underperforms on mixed-difficulty tasks. Difficulty-aware allocation closes the gap by 7-10 points on pass@1 without extra compute.
Browse All Topics