Reinforcement learning with human feedback for aligning large language models (LLMs) trains a reward model typically using ranking loss with comparison pairs. However, the training procedure suffers from an inherent problem: the uncontrolled scaling of reward scores during reinforcement learning due to the lack of constraints while training the reward model. This paper proposes a Prior Constraints-based Reward Model (PCRM) training method to mitigate this problem. PCRM incorporates prior constraints--specifically, length ratio and cosine similarity between outputs of each comparison pair--during reward model training to regulate optimization magnitude and control score margins. We comprehensively evaluate PCRM by examining its rank correlation with human preferences and its effectiveness in aligning LLMs via RL. Experimental results demonstrate that PCRM significantly improves alignment performance by effectively constraining reward score scaling. As another bonus, our method is easily integrated into arbitrary rank-based alignment methods, such as direct preference optimization, and can yield consistent improvement. The code is available at https://github.com/wangclnlp/

Elon Musk casually dropped that he has another Neuralink project in the works which he says will bestow sight upon people born blind -- and the tech is already being tested on monkeys. True to form, Musk announced the project's official name, 'Blindsight,' while replying to users on his social site X, first in late January, then with fresh details Wednesday. Musk claimed the tech will be lo-rez at first, 'like early Nintendo graphics' from the 1980s era of 8-bit video games. But ultimately, he hopes it will actually'exceed normal human vision.' If Blindsight remains true to its first unnamed tease, presented during a Neuralink'Show and Tell' in late 2022, the implant will be able to repackage digital camera data into electrical impulses compatible for delivery straight into the visual cortex.

Despite a controversial history of animal testing, the first human has had a chip implanted by Elon Musk's company Neuralink. After gaining approval for human experiments, the firm has now put its first Neuralink device, called'Telepathy', inside a person's brain. Musk claims Telepathy enables control of your phone or computer, and in turn almost any other device, 'just by thinking'. The billionaire entrepreneur hopes it will allow users with disabilities like Stephen Hawking to'communicate faster than an auctioneer'. Here, MailOnline reveals everything you need to know about the contentious technology, which has seen Musk accused of'playing God'.

The US Department of Transportation (DOT) is said to be investigating Elon Musk's Neuralink over claims the company illegally transported hazardous pathogens. The probe is in response to allegations from the Physicians Committee of Responsible Medicine (PCRM), which state Musk's company unsafely packed and moved implants removed from the brains of monkeys that may have been infected. PCRM, an animal-welfare advocacy group, wrote to Secretary of Transportation Pete Buttigieg earlier on Thursday to alert it of records it obtained on the matter from the University of California (UC) Davis, according to Reuters. The letters state that the implants were not properly sanitized and packaged, thus carrying pathogens that could cause serious health issues in infected humans. The lasted investigation follows months of allegations against Neuralink, which is said to have violated animal welfare laws with'botched experiments.'

An animal-welfare organization said it plans to ask a U.S. government agency on Thursday to investigate Elon Musk's brain-implant company Neuralink over records it said show potentially illegal movement of hazardous pathogens. The Physicians Committee of Responsible Medicine (PCRM) said in a letter to the U.S. Department of Transportation, which was shared with Reuters, that it has obtained emails and other documents that suggest unsafe packaging and movement of implants removed from the brains of monkeys. These implants may have carried infectious diseases in violation of federal law, PCRM said. The letter said records that the group obtained showed instances of pathogens, such as antibiotic-resistant staphylococcus and herpes B virus, that may have been transported without proper containment measures. PCRM's letter adds to the scrutiny facing Neuralink, which is developing a brain implant it hopes will help paralyzed people walk again and cure other neurological ailments.

An advocacy group of more than 17,000 doctors has petitioned the Food and Drug Administration (FDA) to disqualify Elon Musk's Neuralink from receiving approval for its brain implant. The Physicians Committee for Responsible Medicine (PCRM) claims Neuralink has violated the'good laboratory practices' (GLP) regulations, which ensures the quality and integrity of non-clinical laboratory studies, with its'hack job' surgeries and staff'manipulating data.' Some of the animal's deaths were at the hands of Matthew McDougall, the head neurosurgeon, who administered nearly six times the amount of an unapproved'toxic' substance that led to a monkey's death, a former Neuralink employee told DailyMail.com. This was stated in messages written by John Morrison, the study director at the University of California, Davis (UC Davis), Merkley added. Elon Musk said his Neuralink is seeking FDA approval to start human trials, but a group is trying to block these efforts.

'Botched experiments' by Elon Musk's Neuralink allegedly'kept suffering animals alive for no reason and malpractice caused monkey's brains to hemorrhage' during rushed brain chip testing, a former Neuralink employee and internal lab notes reveal. The billionaire's startup is accused of violating the Animal Welfare Act with its experiments at the University of California, Davis, from 2017 through 2020, which'sacrificed all the animals involved,' a former Neuralink employee, who asked to remain anonymous, told DailyMail.com. One case stood out to them- a monkey sacrificed ahead of schedule due to errors allegedly made during surgery. 'There was no reason to use it,' the former employee, who worked as a necropsy technician, told DailyMail.com. 'BioGlue was not FDA-approved for brain surgery and would never be able to be carried over to human trials.

For the past six years, Elon Musk has been working on a chip designed to be implanted into human brains, with his neurotechnology company Neuralink. His ultimate goal is to develop a'brain-computer interface' that will initially be used to help people with paralysis or motor neurone disease to communicate. It will allegedly allow them to operate computers and mobile devices using their thoughts, but could have further uses in years to come. So what exactly is the chip? How does it work and how will it cure all medical problems?

Elon Musk's Neuralink is set to host its annual'Show and Tell' event tonight at 9 pm ET that is expected to share a progress update on its brain-machine interface. The neuroscience startup shared a teaser for the event on its Twitter account, showing a short video that spelled out the message'please join us for a show and tell,' and some users speculate the world will see a person with Neurlink's chip type on a screen. The goal is to develop a full-implanted brain-computer interface (BCI) for people with paralysis, allowing them to operate computers and mobile devices using their thoughts. The first Show and Tell event, held in 2020, demonstrated the technology with a pig and last year, Musk revealed the update with a monkey that played a video game using only its mind. Neuralink will host its annual'Show and Tell' event tonight at 9 pm ET, which is expected to share the progress of the technology.

Elon Musk plans to hold a'Show and Tell' event for his brain chip company Neuralink on November 30, but a group of physicians claims the firm is'mutilating and killing monkeys' to create a'brain-machine interface.' Musk announced the event, which the company holds each year to showcase its latest updates, on Twitter. The first Show and Tell in 2020 demonstrated the brain implant in a pig and in 2021, the world saw it used by a monkey that died months after receiving the implant. The Physicians Committee for Responsible Medicine (PCRM) recently launched a website detailing the gruesome stories of monkeys that are said to have suffered from sloppy experiments conducted at the University of California, Davis (UC Davis). PCRM shared lab notes with DailyMail.com