이진욱님의 블로그

https://arxiv.org/abs/2306.02561

https://arxiv.org/pdf/2409.15254Archon:An Architecture Search Framework for Inference-Time Techniques 논문리뷰2024년 10월 1일자 논문 challenge1) inference-time compute budge에 관한 최적의 컴퓨팅량2) 다양한 inference-time 기술 사이의 interaction에 대한 이해3) model choice의 큰 공간(범위)을 효율적으로 search해 best 답변을 내놓기에 대한 challenge가 존재 아직 taskinstruction-following tasks (MT Bench, AlpacaEval 2.0, Arena-Hard-Auto)reasoning tasks (MixEval,..

https://arxiv.org/pdf/2404.17140

https://arxiv.org/abs/2402.03746

https://arxiv.org/pdf/2309.14525 Large Multimodal Models (LMM) are built across modalities and the misalign-ment between two modalities can result in “hallucination”, generating textual out-puts that are not grounded by the multimodal information in context. To address the multimodal misalignment issue, we adapt the Reinforcement Learning from Human Feedback (RLHF) from the text domain to the ta..

https://arxiv.org/pdf/2406.07476

https://arxiv.org/pdf/2403.15377

https://arxiv.org/pdf/2402.13217

https://arxiv.org/pdf/2407.00369 Large language or multimodal model based verification has been proposed to scale up online policing mechanisms for mitigating spread of false and harmful content.

unit tests, proof checkers, majority voting를 verifier로 써서 inference scaling law를 연구