Goto

Collaborating Authors

 Government


Noise-response Analysis for Rapid Detection of Backdoors in Deep Neural Networks

arXiv.org Machine Learning

The pervasiveness of deep neural networks (DNNs) in technology, matched with the ubiquity of cloud-based training and transfer learning, is giving rise to a new frontier for cybersecurity whereby `structural malware' is manifest as compromised weights and activation pathways for unsecure DNNs. In particular, DNNs can be designed to have backdoors in which an adversary can easily and reliably fool a classifier by adding to any image a pattern of pixels called a trigger. Since DNNs are black-box algorithms, it is generally difficult to detect a backdoor or any other type of structural malware. To efficiently provide a reliable signal for the absence/presence of backdoors, we propose a rapid feature-generation step in which we study how DNNs respond to noise-infused images with varying noise intensity. This results in titration curves, which are a type of `fingerprinting' for DNNs. We find that DNNs with backdoors are more sensitive to input noise and respond in a characteristic way that reveals the backdoor and where it leads (i.e,. its target). Our empirical results demonstrate that we can accurately detect a backdoor with high confidence orders-of-magnitude faster than existing approaches (i.e., seconds versus hours). Our method also yields a titration-score that can automate the detection of compromised DNNs, whereas existing backdoor-detection strategies are not automated.


Adversarial Attacks with Multiple Antennas Against Deep Learning-Based Modulation Classifiers

arXiv.org Machine Learning

We consider a wireless communication system, where a transmitter sends signals to a receiver with different modulation types while the receiver classifies the modulation types of the received signals using its deep learning-based classifier. Concurrently, an adversary transmits adversarial perturbations using its multiple antennas to fool the classifier into misclassifying the received signals. From the adversarial machine learning perspective, we show how to utilize multiple antennas at the adversary to improve the adversarial (evasion) attack performance. Two main points are considered while exploiting the multiple antennas at the adversary, namely the power allocation among antennas and the utilization of channel diversity. First, we show that multiple independent adversaries, each with a single antenna cannot improve the attack performance compared to a single adversary with multiple antennas using the same total power. Then, we consider various ways to allocate power among multiple antennas at a single adversary such as allocating power to only one antenna, and proportional or inversely proportional to the channel gain. By utilizing channel diversity, we introduce an attack to transmit the adversarial perturbation through the channel with the largest channel gain at the symbol level. We show that this attack reduces the classifier accuracy significantly compared to other attacks under different channel conditions in terms of channel variance and channel correlation across antennas. Also, we show that the attack success improves significantly as the number of antennas increases at the adversary that can better utilize channel diversity to craft adversarial attacks.


Emotion AI researchers say overblown claims give their work a bad name

#artificialintelligence

Perhaps you've heard of AI conducting interviews. Or maybe you've been interviewed by one yourself. Companies like HireVue claim their software can analyze video interviews to figure out a candidate's "employability score." The algorithms don't just evaluate face and body posture for appearance; they also tell employers whether the interviewee is tenacious, or good at working on a team. These assessments could have a big effect on a candidate's future.


Businesses Tap New Digital Tools to Reopen the Workplace

WSJ.com: WSJD - Technology

Just getting workers to the office can be a challenge, amid ongoing travel restrictions aimed at containing the pandemic, said Gaston Silva Maldonado, project and systems analyst at Chilean food processor giant Agrosuper SA. "Our employees have been prevented from moving from one city to another, or even from one point of the city to another," Mr. Maldonado said, citing local lockdown rules. Based in Rancagua, Agrosuper employs about 3,500 office workers, in addition to thousands more in its production plants. So far, he said, only administrative staff and production plant workers deemed essential have returned to the workplace. With the Chilean government in July announcing a five-week plan to gradually ease travel restrictions within the country, the company is hoping to bring back more in the weeks ahead. To do that, Agrosuper has started using robotic process automation to scan and relay employment data on its more than 12,000 workers to a government website that issues emergency travel passes required at health checkpoints scattered throughout the country.


Shield AI Recognized As One of the Most Promising AI Companies

#artificialintelligence

Shield AI, the technology company focused on developing innovative AI technology to safeguard the lives of military service members and first responders, expressed its gratitude to Forbes for naming the company as one of the "AI 50: America's Most Promising Artificial Intelligence Companies" for 2020. The five-year-old company has developed AI technology that enables unmanned systems to interpret signals and react autonomously in dynamic environments, including on the battlefield. Shield AI's products are already being utilized by the US Department of Defense to augment and extend service members' ability to execute complex missions. Shield AI co-founder Brandon Tseng, who served in the U.S. Navy for seven years, including as a SEAL, said "Following my last deployment, I came home with the strong conviction that artificial intelligence could make a profound positive impact for our service members. This was the idea that Shield AI was founded upon, and a half-decade later, we are elated to have Forbes recognize our innovation of AI technology as both promising and meaningful." Shield AI has grown from fewer than 30 employees at the end of 2017 to nearly 150 today, while producing revenue metrics on pace with the growth trajectory of the most promising venture-backed start-ups, including doubling its revenue between 2018 and 2019.


News at a glance

Science

SCI COMMUN### Conservation A company seeking to build a controversial gold and copper mine in Alaska won a major victory on 24 July when the U.S. Army Corps of Engineers issued an environmental analysis saying the mine wouldn't endanger the world's most productive sockeye salmon fishery. The decision clears the way for the Corps to issue permits needed by promoters of the Pebble Mine, located at the headwaters of two major watersheds that form part of the Bristol Bay salmon runs, just north of the Aleutian Islands. Environmental and Native Alaskan groups and some salmon scientists blasted the new study, saying it understated risks by focusing on the mine's small, initial footprint over 20 years of mining rather than its potential impacts if it expands to become one of the world's largest gold and copper mines, as its promoters hope. Mine backers have said such an expansion would get a closer environmental review later if they pursue it. Scientists have raised concerns that even the smaller mine could have wide impacts, because the resilience of the salmon runs hinges on access to a wide variety of spawning habitats. Environmental groups have vowed to file lawsuits to block the project. 90% โ€”Accuracy of a new artificial intelligence system trained to identify individual weaver birds, which human birders generally cannot tell apart unless they are tagged ( Methods in Ecology and Evolution ). ### Planetary science China's first independent mission to Mars blasted off from the Xichang Satellite Launch Center on 23 July. To arrive in February 2021, Tianwen-1, a โ€œquest for heavenly truth,โ€ comprises an orbiter, lander, and rover. Only the United States and the Soviet Union have successfully landed on Mars. Instruments on the three Tianwen-1 craft will study the planet's magnetic field and atmosphere, map its surface, and characterize its geology. Tianwen-1 is the second in a trio of fresh martian missions: The United Arab Emirates launched its Hope orbiter on 19 July, and NASA planned to launch its Perseverance rover as early as 30 July, after Science went to press. ### Funding A bill in France would increase research spending over the next 10 years and add tenure-track faculty positions, a novelty in France. But critics say the plan's increases would be too small and slow. By 2030, the annual public research budget would rise by about one-third, to โ‚ฌ20 billion, toward a goal of lifting overall R&D spending from 2.2% of gross domestic product to 3%. The National Research Agency, which funds researchers through competitive calls, would get โ‚ฌ1 billion more over 7 years, reaching about โ‚ฌ1.7 billion in 2027, to help raise its grant success rates from 16% to a target of 30%. The new, nonpermanent tenure-track positions would complement the permanent entry-level research positions traditionally offered by the French system, but critics fear the growth may lead to a decline in the permanent ones. Parliament is expected to approve the bill. ### Drug trials A monoclonal antibody given to babies has strongly protected them from severe disease caused by respiratory syncytial virus (RSV), a leading cause of infant death. As reported this week in The New England Journal of Medicine , a placebo-controlled study of nearly 1500 babies born pretermโ€”who are at higher risk of severe symptoms of RSVโ€”in 23 countries found that a single injection of the antibody before RSV season starts in the fall led to 78.4% fewer hospitalizations for lower respiratory infections associated with the disease. The antibody, being developed by AstraZeneca and Sanofi Pasteur, could replace one now on the market that is rarely used. (It is recommended only for infants at highest risk, requires five shots, and is very expensive.) The companies plan to seek regulatory approval of the new prophylaxis if larger studies now underway in preterm and full-term infants confirm that it is safe and effective. ### Graduate studies The American Astronomical Society last week launched the Astronomy Genealogy Project, which maps 5000 astronomers to their academic โ€œdescendantsโ€โ€”the 28,000 doctorate recipients they supervised. The discipline's family tree, at astrogen.aas.org, stretches back to 1766, but half of the listed doctorates were awarded since 2002. Organizers hope the data will help historians and sociologists of science analyze patterns across countries, universities, and subfields. U.S. universities awarded slightly more than half of the doctorates listed, and about two-thirds of the theses are online. ### Climate Environmental groups last week denounced as weak a plan announced by the U.S. Environmental Protection Agency (EPA) to limit greenhouse gas emissions from aircraft. The new standard would match an existing one adopted in 2016 by a U.N. body, the International Civil Aviation Organization (ICAO), that required emissions cuts by 2028. But recently manufactured planes already meet the standard, and EPA conceded its new rule would not reduce overall airplane emissions. Manufacturers have supported such a U.S. regulation to help them meet ICAO certification requirements. IACO has predicted that even under its standard, airplane emissions will grow by at least 3% a year globally. U.S. aviation accounts for 3% of the country's greenhouse gas emissions. ### Extreme life Bacteria from seafloor sediments buried 101 million years ago have been grown in the lab, raising the possibility they are as old as their muddy home. They had somehow survived in an area of the Pacific Ocean almost devoid of organic matter or other nutrients most bacteria need, although the sediments recovered do contain oxygen, the researchers report in Nature Communications . The finding pushes back the documented age of bacteria living in marine sediment from 15 million years and provides new insights on the limits of life under extreme conditions. A team led by researchers from the Japan Agency for Marine-Earth Science and Technology harvested the microbes from core samples drilled up to 5700 meters below sea level and took precautions against contaminating them with modern bacteria. The group argues the microbes likely didn't have enough food to keep replicating, and instead may have survived for eons without dividing by repairing age-related cellular damage. The microbes identified are known members of more than eight bacterial groups, many of which are commonly found elsewhere on Earth. ### Biotechnology Scientists announced last week that they used CRISPR gene editing to modify a cow embryo so that the resulting calf, named Cosmo, should produce more offspring bearing male traits. Bulls are 15% more efficient than cows at converting feed into weight gain, so the new method may allow cattle farmers to raise fewer cattle, benefiting the environment, say the researchers at the University of California, Davis. The researchers inserted a gene called SRY , which initiates male development and is normally found on the male sex chromosome, into an embryo's chromosome 17. Next, the researchers plan to determine whether Cosmo's offspring that inherit the SRY gene look and grow like males. Fifty percent of the calf's progeny will naturally be male; another 25% will be genetically female but will carry the SRY gene. ### Conservation Florida's governor this month signed a bill to establish a 162,000-hectare marine sanctuary in the Gulf of Mexico and protect one of the state's last remaining stretches of seagrass. Florida's coast boasts the most continuous expanse of seagrass beds in the United States, but these diverse habitats, home to blue crabs and manatees, have been damaged by nutrient-driven algal blooms and boat propellers. Authorities plan to create a management plan for the new Nature Coast Aquatic Preserve to balance protection with ecotourism, boating, and fishing. ### A magic ride for science In 1984, artist Bruce Degen met writer Joanna Cole at a publisher's office in New York City to discuss creating a children's book about science. They went on to collaborate and publish 13 colorful, zany books in The Magic School Bus series, featuring the ebullient, intrepid teacher Ms. Frizzle (above, right), who takes her students on fantastic adventures into the ocean, across the Solar System, and through the human body, for example. Cole died on 12 July at age 75. But the series continues to teach young readers and their parents about the natural world. > Q: Did you expect to create such a legacy? > A: I was in art school doing very serious art, and I realized that, in my heart of hearts, I wanted to do children's books. In the beginning, it was darn hard work. Some book sketch dummies have five layers of rewrites and reillustrations. The first book was a one-book contract to see if this would work. [The reception] was like the world was waiting for somebody to make this happen. People say, โ€œ[As a child,] I [used to] read these books, now I read them to my kids!โ€ I could never have imagined it. > Q: Does scientific accuracy get in the way of storytelling? > A: Frequently. You have to tell kids what is true, but you can't give them all the truthโ€”it's too much. For example, the evolution book goes from now [back] to the beginning of the Earth. I [initially] tried to show every era, year, and life form. It was too complicated. So it ended up as a nice, open spiral with a few representations of each era. > Q: Why use the format of adventures? > A: By following the story, it gave kids a mental filing systemโ€”they could retrieve and remember information because it was given to them in a memorable trip. ### Dispatches from the pandemic Read additional Science coverage of the pandemic at [sciencemag.org/tags/coronavirus][1]. #### U.S. vaccine efficacy trials begin The first large-scale efficacy trials of COVID-19 vaccines in the United States began last week. On 27 July, the National Institutes of Health, working with Moderna, announced the start of one that aims to recruit 30,000 people. Later that day, a partnership between Pfizer and BioNTech announced separately it was launching a similarly sized study at sites in the United States and elsewhere. Both the Moderna and the Pfizer/BioNTech vaccines contain messenger RNA that prompts cells to make a protein that studs the surface of the COVID-19 virus. If the vaccines work, this viral protein will safely teach the immune system how to battle the virus if a person later is exposed to it. Operation Warp Speed, the Trump administration's push to accelerate development of a COVID-19 vaccine, has committed nearly $3 billion to these two R&D projects, about half its total investment. Other efficacy trials of various COVID-19 vaccines have begun in Brazil, the United Arab Emirates, and the United Kingdom. Results are expected in late fall at the earliest. #### CDC slammed over school rules Guidance issued by the U.S. Centers for Disease Control and Prevention (CDC) last week for safely reopening schools downplays risks that teachers, other staff members, and students will spread or contract COVID-19, many public health specialists say. Provoking claims that CDC's advice had been politicized, the agency revised an earlier draft that President Donald Trump had panned as โ€œvery tough and expensive.โ€ The nonbinding recommendations, released 23 July, emphasize the social and developmental benefits of in-person schooling and highlight that young children are at low risk for contracting the disease and transmitting the virus that causes it. The document also recommends against screening students for symptoms. Nevertheless, the Trump administration did advise communities with high infection rates to consider not beginning in-person classes. Large school districts, such as those in Atlanta, Houston, Los Angeles, and San Diego, have already announced that they will begin the 2020โ€“21 school year with online instruction only. #### Anti-Fauci TV segment canceled Following heavy criticism from scientists and others, Sinclair Broadcast Corp. this week canceled plans for its chain of local TV stations to air a segment featuring widely challenged accusations that Anthony Fauci, director of the National Institute of Allergy and Infectious Diseases, intentionally created the virus responsible for COVID-19 and sent it to China. Fauci has helped lead the U.S. effort to control the pandemic despite tangling with President Donald Trump. The allegation came from Judy Mikovits, a virologist and antivaccine activist who appears in a documentary about the coronavirus that was also widely debunked as false and misleading (). The Sinclair segment, a new interview with Mikovits, was available online until the company pulled it for review on 25 July, after Media Matters reported its existence. Sinclair announced on 27 July that it would not air the segment on the nearly 200 TV stations it owns or operates in 89 U.S. marketsโ€”but not before one in Charleston, West Virginia, had broadcast it. [1]: http://sciencemag.org/tags/coronavirus


What's This? A Bipartisan Plan for AI and National Security

WIRED

US representatives Will Hurd and Robin Kelly are from opposite sides of the ever-widening aisle, but they share a concern that the US may lose its grip on artificial intelligence, threatening the American economy and the balance of world power. Thursday, Hurd (R-Texas) and Kelly (D-Illinois) offered suggestions to prevent the US from falling behind China, especially, on applications of AI to defense and national security. They want to cut off China's access to AI-specific silicon chips and push Congress and federal agencies to devote more resources to advancing and safely deploying AI technology. Although Capitol Hill is increasingly divided, the bipartisan duo claim to see an emerging consensus that China poses a serious threat and that supporting US tech development is a vital remedy. "American leadership and advanced technology has been critical to our success since World War II, and we are in a race with the government of China," Hurd says. "It's time for Congress to play its role."


New artificial intelligence institute strengthens Clemson University's abilities in competitive field

#artificialintelligence

Clemson University is strengthening its ability to conduct research and offer courses in artificial intelligence, a fast-rising technology that is beginning to revolutionize industries ranging from advanced manufacturing to healthcare. About 80 faculty members are banding together to launch the new Clemson Artificial Intelligence Research Institute for Science and Engineering, or AIRISE. Feng Luo meets (center) is the director and founder of the new Clemson Artificial Intelligence Research Institute for Science and Engineering. Clemson researchers have been developing and using artificial intelligence for years, and the institute will build on projects already underway. Artificial intelligence is widely regarded as crucial to enhancing economic and national security.


Tesla's Model 3 under investigation in South Korean safety probe

Engadget

South Korea has launched a safety probe into Tesla, focusing on braking and steering systems including Autopilot, according to Reuters. The transport ministry is specifically looking at the the Model 3 in an investigation that could take from six months to a year, according to Reuters' sources. The news casts a bit of a shadow on Tesla's huge sales surge in the nation, spurred by the Model 3. Tesla has an excellent safety record overall, but the autopilot system has drawn criticism from the the US National Transportation Safety Board (NTSB). More recently, Tesla's Autopilot marketing was decried as "misleading" by Korea's Fair Trade Commission. Tesla will cooperate with the investigation, according to a South Korean transport ministry official.


Artificial Intelligence and Satellite Technology to Enhance Carbon Tracking Measures

#artificialintelligence

New carbon emission tracking technology will quantify emissions of greenhouse gas, holding the energy industry accountable for its CO2 output. Backed by Google, this cutting-edge initiative will be known as Climate TRACE (Tracking Real-Time Atmospheric Carbon Emissions). Advanced AI and machine learning now make it possible to trace greenhouse gas (GHG) emissions from factories, power plants and more. By using image processing algorithms to detect carbon emissions from power plants, AI technology makes use of the growing global satellite network to develop a more comprehensive global database of power plant activity. Because most countries self-report emissions and manually compile results, scientists often rely on data that is several years out of date.