PlaylistsThe best of Paul Christiano's writing on AI Paul Christiano — Thoughts on the impact of RLHF researchPaul Christiano — Thoughts on the impact of RLHF research
Matthew van der Merwe, Pablo Stafforini
Playlist
The best of Paul Christiano's writing on AI
Narrations of Paul Christiano's papers and posts on the Alignment Forum, LessWrong, and his blogs
"In this post I’m going to describe my basic justification for working on RLHF in 2017-2020, which I still stand behind. I’ll discuss various arguments that RLHF research had an overall negative impact and explain why I don’t find them persuasive."
"I'll also clarify that I don't think research on RLHF is automatically net positive; alignment research should address real alignment problems, and we should reject a vague association between "RLHF progress" and "alignment progress."
https://www.lesswrong.com/posts/vwu4kegAEZTBtpT6p/thoughts-on-the-impact-of-rlhf-research