Goto

Collaborating Authors

 Government


"Think First, Verify Always": Training Humans to Face AI Risks

arXiv.org Artificial Intelligence

Artificial intelligence enables unprecedented attacks on human cognition, yet cybersecurity remains predominantly device-centric. This paper introduces the "Think First, Verify Always" (TFVA) protocol, which repositions humans as 'Firewall Zero', the first line of defense against AI-enabled threats. The protocol is grounded in five operational principles: Awareness, Integrity, Judgment, Ethical Responsibility, and Transparency (AIJET). A randomized controlled trial (n=151) demonstrated that a minimal 3-minute intervention produced statistically significant improvements in cognitive security task performance, with participants showing an absolute +7.87% gains compared to controls. These results suggest that brief, principles-based training can rapidly enhance human resilience against AI-driven cognitive manipulation. We recommend that GenAI platforms embed "Think First, Verify Always" as a standard prompt, replacing passive warnings with actionable protocols to enhance trustworthy and ethical AI use. By bridging the gap between technical cybersecurity and human factors, the TFVA protocol establishes human-empowered security as a vital component of trustworthy AI systems.


How Deep Is Representational Bias in LLMs? The Cases of Caste and Religion

arXiv.org Artificial Intelligence

Representational bias in large language models (LLMs) has predominantly been measured through single-response interactions and has focused on Global North-centric identities like race and gender. We expand on that research by conducting a systematic audit of GPT -4 Turbo to reveal how deeply encoded representational biases are and how they extend to less-explored dimensions of identity. We prompt GPT - 4 Turbo to generate over 7,200 stories about significant life events (such as weddings) in India, using prompts designed to encourage diversity to varying extents. Comparing the diversity of religious and caste representation in the outputs against the actual population distribution in India as recorded in census data, we quantify the presence and "stickiness" of representational bias in the LLM for religion and caste. We find that GPT -4 responses consistently overrepresent culturally dominant groups far beyond their statistical representation, despite prompts intended to encourage representational diversity. Our findings also suggest that representational bias in LLMs has a winner-take-all quality that is more biased than the likely distribution bias in their training data, and repeated prompt-based nudges have limited and inconsistent efficacy in dislodging these biases. These results suggest that diversifying training data alone may not be sufficient to correct LLM bias, highlighting the need for more fundamental changes in model development.


LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge Points

arXiv.org Artificial Intelligence

The advancement of large language models (LLMs) struggles with the scarcity of high-quality, diverse training data. To address this limitation, we propose LinkSyn, a novel knowledge point (KP) graph-based synthesis framework that enables flexible control over discipline and difficulty distributions while balancing KP coverage and popularity. LinkSyn extracts KPs from question-answering (QA) seed data and constructs a KP graph to synthesize diverse QA data from multiple seeds strongly linked by KPs and sampled from graph walks. Specifically, LinkSyn incorporates (1) a knowledge distribution value function to guide the adjustment of path sampling probability and balance KP coverage and popularity during graph walks; (2) diffusion-based synthesis via DeepSeek-R1 by leveraging multiple seeds with dense logical associations along each path; and (3) high-difficulty QA enhancement within given disciplines by flexible difficulty adjustments. By executing LinkSyn, we synthesize LinkQA, a diverse multi-disciplinary QA dataset with 50B tokens. Extensive experiments on Llama-3 8B demonstrate that continual pre-training with LinkQA yields an average improvement of 11.51% on MMLU and CMMLU, establishing new SOT A results. LinkQA consistently enhances performance across model size and initial FLOPs scales.


Fox News Politics Newsletter: Mamdani's 'Radical Positions' Alarm New Yorkers, Says Expert

FOX News

Welcome to the Fox News Politics newsletter, with the latest updates on the Trump administration, Capitol Hill and more Fox News politics content. New York City socialist mayoral candidate Zohran Mamdani's past stances on policing are a legitimate reason for New Yorkers to be concerned, despite his recent walkbacks, according to a New York City crime expert who spoke to Fox News Digital. "I think what scares a lot of New Yorkers about the policy positions taken by Zohran Mamdani over the years is that he has exhibited not just a lack of appreciation for the men and women that stand on that [police] line, but a visceral disdain for them, which has led him to push for things like defunding and dismantling the police," Rafael A. Mangual, senior fellow and head of research for policing and public safety at the Manhattan Institute, told Fox News Digital, shortly after a gunman killed four people in midtown Manhattan, including a NYPD police officer. "It's not so much as just that he said, well, I wanna allocate some of this money to other places. He has gone so far as to say that we should dismantle the entire department."โ€ฆREAD


Illinois' ban on AI therapy won't stop people from asking chatbots for help

Popular Science

Breakthroughs, discoveries, and DIY tips sent every weekday. Illinois has become the first state to enact legislation banning the use of AI tools like ChatGPT for providing therapy. The bill, signed into law by Governor J.B. Pritzker last Friday, comes amid growing research showing an increase in people experimenting with AI for mental health as the country faces a shortage of access to professional therapy services. The Wellness and Oversight for Psychological Resources Act, officially called HB 1806, prohibits healthcare providers from using AI for therapy and psychotherapy services. Specifically, it prevents AI chatbots or other AI-powered tools from interacting directly with patients, making therapeutic decisions, or creating treatment plans.


New Romanian law may have averted NATO clash with Russia after border strikes

FOX News

Russia hit pipelines in Ukraine, sparking bright flames and plumes of smoke seen from Romania. Russia narrowly avoided an armed skirmish with Romania, a member of the NATO alliance, after striking just a half mile from its border. Romanian defense officials believe the new law passed by parliament explicitly allowing its armed forces to shoot down Russian drones that fly over its territory prevented the Kremlin from incurring on its territory. Russia struck a gas distribution center in the Ismail Area of Ukraine with Shahed kamikaze drones on Tuesday and Wednesday, so close to Romania's border that Bucharest deployed F-16 aircraft to monitor. No unauthorized intrusions were reported.


Inside the Biden Administration's Unpublished Report on AI Safety

WIRED

At a computer security conference in Arlington, Virginia, last October, a few dozen AI researchers took part in a first-of-its-kind exercise in "red teaming," or stress-testing a cutting-edge language model and other artificial intelligence systems. Over the course of two days, the teams identified 139 novel ways to get the systems to misbehave including by generating misinformation or leaking personal data. More importantly, they showed shortcomings in a new US government standard designed to help companies test AI systems. The National Institute of Standards and Technology (NIST) didn't publish a report detailing the exercise, which was finished toward the end of the Biden administration. The document might have helped companies assess their own AI systems, but sources familiar with the situation, who spoke on condition of anonymity, say it was one of several AI documents from NIST that were not published for fear of clashing with the incoming administration.


Trump admin cuts red tape on commercial drones to compete with China's dominance of the market

FOX News

Retired Charlottesville Fire Chief Charles Werner joins'Fox & Friends First' to discuss drones being used as first responders as Energy Sec. Sean Duffy highlights U.S. drone dominance. Delivery drones could soon take to the skies in full force, following a landmark proposed rule by the Federal Aviation Administration (FAA). The long-anticipated rule is aimed at allowing drones to operate beyond the visual line of sight (BVLOS) -- a move designed to counter China's dominance in unmanned aviation. Currently, operators must obtain individual FAA waivers -- only 657 issued so far -- to fly drones beyond where they can physically see them, hampered by months of delay and bureaucratic setbacks. "Because of that complication, I don't think we saw the innovation that we should have in America," said Transportation Secretary Sean Duffy on Tuesday.


OpenAI Announces Massive US Government Partnership

WIRED

OpenAI is partnering with the US government to make its leading frontier models available to federal employees. Under the agreement, federal agencies can access OpenAI's models for 1 for the next year, per a Wednesday announcement from the company and the General Services Administration (GSA). The partnership is the culmination of months of effort on the part of OpenAI CEO Sam Altman and other OpenAI executives, who have been cozying up to the Trump administration since before President Donald Trump retook the White House in January. Since at least May of this year, high-ranking OpenAI employees have been meeting with the GSA and other government agencies, such as the Food and Drug Administration, to promote the company's tools, according to documents obtained by WIRED. On July 23, OpenAI chief operating officer Brad Lightcap and other OpenAI executives were invited to a private after-party hosted by the Hill and Valley Forum in Washington, DC.


These Democrats Think the Party Needs AI to Win Elections

WIRED

The 2024 election cycle saw artificial intelligence deployed by political campaigns for the very first time. While candidates largely avoided major mishaps, the tech was used with little guidance or restraint. Now, the National Democratic Training Committee (NDTC) is rolling out the first official playbook making the case that Democratic campaigns can use AI responsibly ahead of the midterms. In a new online training, the committee has laid out a plan for Democratic candidates to leverage AI to create social content, write voter outreach messages, and research their districts and opponents. Since NDTC's founding in 2016, the organization says, it has trained more than 120,000 Democrats seeking political office.