Environment Animals Wildlife Fish Self-piloting submarine set to begin historic mission to circle Earth's oceans Breakthroughs, discoveries, and DIY tips sent every weekday. An autonomous submersible named Redwing is heading out on a truly historic voyage. If successful, it will achieve the first around-the-world ocean trip made by an unpiloted underwater vehicle . Marine engineering company Teledyne Marine and researchers at Rutgers University in New Jersey are planning to launch the nearly nine-foot-long, specially outfitted Slocum Sentinel Glider on October 11 from Woods Hole Oceanographic Institution off the coast of Martha's Vineyard in Massachusetts. A livestream of the launch will be broadcast here, beginning at about 8:15 a.m. EDT on Saturday October 11.

We study how to perform unlearning, i.e. forgetting undesirable (mis)behaviors, on large language models (LLMs).

We calculate the agreement of human judgment and our automatic evaluation (i.e., ConvBenchEval()) and find it reaches 81.83% (seeing Table 3 - 6 for detailed agreement of each turn of overall). It demonstrates the effectiveness of ConvBenchEval(), which uses ChatGPT. The agreement between ChatGPT and GPT4 is very high at 87.38%. It demonstrates that using different LLMs as judges slightly influences the evaluation results. ConvBenchEval() armed with ChatGPT can is reliable and low-cost. From the above tables, we also observe that though GPT4V is expensive and can capture images, its judgment performs worse than GPT4's judgment.

Multi-turn visual conversation is an important ability of real-world AI assistants. However, the related evaluation benchmark is missed.

On one hand, the knowledge learned from public data is implicitly transferred into the private model.