As machine learning gets deployed more and more widely, and model sizes continue to grow, improving computational efficiency during model inference has become a key challenge. In many commonly used model architectures, including Transformers, a significant portion of the inference computation is comprised of exponential non-linearities such as Softmax. In this work, we develop QuAKE, a collection of novel operators that leverage certain properties of IEEE-754 floating point representations to quickly approximate the exponential function without requiring specialized hardware, extra memory, or precomputation. We propose optimizations that enhance the efficiency of QuAKE in commonly used exponential non-linearities such as Softmax, GELU, and the Logistic function. Our benchmarks demonstrate substantial inference speed improvements between 10% and 35% on server CPUs, and 5% and 45% on embedded and mobile-scale CPUs for a variety of model architectures and sizes. Evaluations of model performance on standard datasets and tasks from various domains show that QuAKE operators are able to provide sizable speed benefits with little to no loss of performance on downstream tasks.

The first-person shooter was born in silence. Before Sega's Heavyweight Champ would spawn the fighting genre or an Arpanet contractor and outdoorsman would invent the text adventure, networked, multiplayer matches took place in the barren halls of Maze War, bounded by vectors, given form only in the imagination of those with access to a terrifically expensive PDS-1 computer. Updates eventually added spectator functionality, computer-controlled enemies, up to eight simultaneous players, and a level editor--essentially everything that would come to define the deathmatch. Few people today remember, let alone can claim to have played, Maze War. But you'd be hard-pressed to find anyone who hasn't heard of Pong, which came out the year prior, and despite its considerably less impressive graphics and features was among the first games to include sound.

NASA's InSight lander has measured one of the biggest and longest marsquakes yet, which featured tremors of 4.2 magnitude lasting nearly an hour and a half, the space agency said. The robotic seismometre celebrated 1,000 days on the Red Planet on September 18, when it detected the largest tremor since it arrived at the Elysium Planitia in 2018. The 4.2 magnitude quake equals the largest detected so far on Mars, but on Earth that would be considered'light', with more than 10,000 earthquakes of that level detected every year, feeling like a light rumble that would make dishes shake. The lander was only able to make the measurement after efforts to clear dust from its solar panels earlier in the year - keeping the seismometre operating. The team took a counterintuitive approach to achieving this by sprinkling one solar panel with larger sand grains in the hope wind would blow it across the other panel and result in clearing enough of the dust to allow power to enter the device.

Every time you search for something in Google, artificial intelligence is working behind the scenes to generate responses to your query. A deep learning system called RankBrain has changed the way the search engine functions. In many cases, RankBrain handles search queries better than traditional algorithmic rules that were hand-coded by human engineers, and Google realized a long time ago that AI is the future of their search platform. AI will try to understand exactly what we are searching for and then deliver personalized results to us, based on what it knows about us. You may not realize it, but AI is already deeply integrated into many of the Google products you are using today.

Circulating groundwater triggered a four-year-long swarm of tiny earthquakes that rumbled beneath the Southern California town of Cahuilla, researchers report in the June 19 Science. By training computers to recognize such faint rumbles, the scientists were able not only to identify the probable culprit behind the quakes, but also to track how such mysterious swarms can spread through complex fault networks in space and time. Seismic signals are constantly being recorded in tectonically active Southern California, says seismologist Zachary Ross of Caltech. Using that rich database, Ross and colleagues have been training computers to distinguish the telltale ground movements of minute earthquakes from other things that gently shake the ground, such as construction reverberations or distant rumbles of the ocean (SN: 4/18/19). The millions of tiny quakes revealed by this machine learning technique, he says, can be used to create high-resolution, 3-D images of what lies beneath the ground's surface in a particular region.

Three distinct sounds were detected by NASA's Insight Lander while sitting on Mars' surface. The first "Mars quake" has been detected, NASA announced Tuesday. The finding "officially kicks off a new field: Martian seismology!," said Bruce Banerdt of NASA's Jet Propulsion Laboratory. NASA said this is the first trembling that appears to have come from inside the planet, as opposed to being caused by forces above the surface, such as wind. The sound was detected by NASA's Insight Lander, a robot spacecraft that's now sitting on the Martian surface.

Mars is about to get its first U.S. visitor in years: a three-legged, one-armed geologist to dig deep and listen for quakes. NASA's InSight makes its grand entrance through the rose-tinted Martian skies on Monday, after a six-month, 300 million-mile (480 million-kilometer) journey. It will be the first American spacecraft to land since the Curiosity rover in 2012 and the first dedicated to exploring underground. The illustration shows the InSight lander drilling into the surface of Mars. InSight, short for Interior Exploration using Seismic Investigations, Geodesy and Heat Transport, is scheduled to arrive at the planet on Monday, Nov. 26 NASA is going with a tried-and-true method to get this mechanical miner to the surface of the red planet. Engine firings will slow its final descent and the spacecraft will plop down on its rigid legs, mimicking the landings of earlier successful missions.

SAPPORO – A Hokkaido newspaper company tested delivery by drone on Friday to determine whether the unmanned aircraft can be relied on to bring news to the public in times of disaster. Two weeks after a level 7 earthquake caused deadly landslides and a prefecture-wide blackout, a group comprising operators of the daily Hokkaido Shimbun's delivery shops successfully flew a drone carrying 10 copies of its newspaper 200 meters across a river in the city of Asahikawa under a hypothetical scenario in which a major quake damages a bridge and severs roads. The magnitude 6.7 quake on Sept. 6 triggered landslides that engulfed homes and shattered roads, while the blackout cut off access to information via TV, computers and mobile devices. "I'm glad we were able to deliver them successfully, as newspapers are an information infrastructure that is necessary when something drastic happens," Takuma Banno, 41-year-old head of the daily's distribution shop in Sapporo, said of the one-minute flight. The idea for the test was hatched in May and planned out before the quake struck.

Istanbul, a city of 14 million people and a crossroads of cultural exchange dating back millennia, may also be where Turkey's next major earthquake strikes. Cities along the North Anatolian Fault, which stretches from eastern Turkey to the Aegean Sea, have experienced an advancing series of strong quakes during the past 80 years, beginning in 1939 when a devastating 7.8-magnitude rupture leveled the city of Erzincan and killed 33,000 people. Most recently, in 1999, 7.4-magnitude quake near the city of İzmit left 17,000 dead and half a million homeless. A few months later, another shock hit Düzce, 60 miles away. Brendan Meade, an applied computational scientist and associate professor of earth and planetary sciences, recently built a computer model of conditions in the North Anatolian Fault.

Welcome to California Inc., the weekly newsletter of the L.A. Times Business Section. Data breaches remain a dark cloud over the business world. On Friday, Whole Foods became the latest company to report getting hacked. Days earlier, the burger chain Sonic said it too had been hit. And Equifax continues making news with its mega-breach involving 143 million consumers.