Second Thoughts are Best Learning to Re Align With Human Values from Text Edits

Neural Information Processing Systems 

The generated editing steps also offer better interpretability and ease for interactive error correction. Extensive human evaluations further confirm its effectiveness.