이진욱님의 블로그

The release of ChatGPT in November 2022 sparked an explosion of interest in post-training and an avalanche of new preference optimization (PO) methods.These methods claim superior alignment by virtue of better correspondence with human pairwise preferences, often measured by LLM-judges.In this work, we attempt to answer the following question – do LLM-judge preferences translate to progress on o..

https://huggingface.co/papers/2410.16184https://arxiv.org/pdf/2410.16184Reward models are critical in techniques like Reinforcement Learning from Human Feedback (RLHF) and Inference Scaling Laws, where they guide language model alignment and select optimal responses. Despite their importance, existing reward model benchmarks often evaluate models by asking them to distinguish between responses g..