Europe
XFlow: 1D-2D Cross-modal Deep Neural Networks for Audiovisual Classification
Cangea, Cătălina, Veličković, Petar, Liò, Pietro
Abstract-- We propose two multimodal deep learning architectures that allow for cross-modal dataflow (XFlow) between the feature extractors, thereby extracting more interpretable features and obtaining a better representation than through unimodal learning, for the same amount of training data. These models can usefully exploit correlations between audio and visual data, which have a different dimensionality and are therefore nontrivially exchangeable. Our work improves on existing multimodal deep learning metholodogies in two essential ways: (1) it presents a novel method for performing cross-modality (before features are learned from individual modalities) and (2) extends the previously proposed cross-connections [1], which only transfer information between streams that process compatible data. Both cross-modal architectures outperformed their baselines (by up to 7.5%) when evaluated on the AVletters dataset. I. INTRODUCTION An interesting extension of unimodal learning consists of deep models which "fuse" several modalities (for example, sound, image or text) and thereby learn a shared representation, outperforming previous architectures on discriminative tasks.
A Generalised Quantifier Theory of Natural Language in Categorical Compositional Distributional Semantics with Bialgebras
Hedges, Jules, Sadrzadeh, Mehrnoosh
Categorical compositional distributional semantics is a model of natural language; it combines the statistical vector space models of words with the compositional models of grammar. We formalise in this model the generalised quantifier theory of natural language, due to Barwise and Cooper. The underlying setting is a compact closed category with bialgebras. We start from a generative grammar formalisation and develop an abstract categorical compositional semantics for it, then instantiate the abstract setting to sets and relations and to finite dimensional vector spaces and linear maps. We prove the equivalence of the relational instantiation to the truth theoretic semantics of generalised quantifiers. The vector space instantiation formalises the statistical usages of words and enables us to, for the first time, reason about quantified phrases and sentences compositionally in distributional semantics.
Dating apps fuelling rise in cancer-causing STI HPV
Dating apps such as Tinder are increasing people's risk of catching a cancer-causing virus passed on through oral sex, dentists warn. Experts say almost half of adults will be infected with the human papilloma virus (HPV) at some point in their life. And while most infections disappear on their own, without even displaying symptoms, some strains can lead to cancer, notably cervical, which in around 90 per cent of cases is caused by HPV. It is also linked to penile, anal, throat, head and neck cancer, as well as genital warts. Hollywood actor Michael Douglas, 72, blamed oral sex for giving him throat cancer in 2010.
Meet These Incredible Women Advancing A.I. Research
A world renowned pioneer in social robotics, Cynthia Breazeal splits her time as an Associate Professor at MIT, where she received her PhD and founded the Personal Robots Group, and Founder and Chief Scientist of Jibo, a personal robotics company with over $85 million in funding. While Breazeal's work has won numerous academic awards, industry accolades, and media attention, she had to fight early skepticism in the 1990s from other experts in robotics and AI. At the time, robots were seen as physical and industrial tools, not social or emotional companions. Her first social robot, Kismet, was unfairly called out in popular press as "useless". Breazeal bucked the trend with a very different vision: "I wanted to create robots with social and emotional intelligence that could work in collaborative partnership with people. In 2-5 years, I see social robots helping families with things that really matter, like education, health, eldercare, entertainment, and companionship." She hopes her work and influence will inspire others to create robots "not only with smarts, but with heart, too."
Robot Spies Could Read Your Lips
As technology advances, making AI (artificial intelligence) and cybercrime tools such as malwarecommonplace, the future landscape of attacks is likely to involve a highly advanced merger of the two. Joon Son Chung of Oxford University, Andrew Senior, Oriol Vinyals and Andrew Zisserman of Google developed an AI-powered lip reading algorithm that is capable of deciphering nearly double the amount of words as a professional human lip reader. Google and Oxford University researchers, in their paper titled Lip Reading Sentences in the Wild, detailed how they created a lip reading neural network that actually outperformed a human professional. The researchers used Google's DeepMind neural network, training it to lip read by using thousands of hours of BBC TV videos, which showed the AI a wide variety of people speaking in different ways. Newsweek is hosting a Structure Security event Sept. 26-27 in San Francisco.
Video Friday: Powered Exoskeleton, Drone Shows, and Soft Robotic Mask
Video Friday is your weekly selection of awesome robotics videos, collected by your Automaton bloggers. We'll also be posting a weekly calendar of upcoming robotics events for the next two months; here's what we have so far (send us your events!): Let us know if you have suggestions for next week, and enjoy today's videos. I don't know much about this powered partial exoskeleton called KOMA, except that the company behind it (ATOUN, from Japan) says that it's designed to help you carry very heavy objects in a way that won't interfere with your natural movements. Jiří Zemánek and Martin Gurtner from the Czech Technical University in Prague won first place in the IEEE CSS video contest (awarded at the IEEE CCTA 2017 conference) for their video demonstrating numerical optimal control on a "flying ball in a hoop" system: The IEEE CCTA Conference, incidentally, was held on the Kohala Coast in Hawaii, where as far as I know we have not had a major robotics conference recently.
Putin says whoever cracks AI will 'rule the world'
Russian President Vladimir Putin says that whoever reaches a breakthrough in developing artificial intelligence will come to dominate the world. Putin, speaking Friday at a meeting with students, said the development of AI raises'colossal opportunities and threats that are difficult to predict now.' He warned that'the one who becomes the leader in this sphere will be the ruler of the world.' Russian President Vladimir Putin, right, attends a meeting with students in Yaroslavl, Russia, Friday, Sept. 1, 2017. Putin, speaking Friday at a meeting with students, said the development of AI raises'colossal opportunities and threats that are difficult to predict now' 'Artificial intelligence is the future, not only for Russia, but for all humankind,' Putin said during the discussion, according to RT.
These are the 9 video games people will talk about this fall
Check out the worlds of Destiny 2. Time Fall is approaching, which means we're about to the reach the most wonderful time of year to be a video game player. In late August, Electronic Arts launched its pro-football simulation Madden NFL 18, which has become the unofficial beginning to the holiday video game season. Between now and December, video game publishers will release some of their biggest hits. Here's a look at the nine games players will talk about a lot this fall (Bonus: if you're a parent of a gamer, or have friends who play, consider these for the holiday shopping list). Where can I play it?
Putin: Leader in Artificial Intelligence Will Rule World
Russian President Vladimir Putin, center, applauds during a meeting with students in Yaroslavl, Russia, Friday, Sept. 1, 2017. Putin said that whoever reaches a breakthrough in developing artificial intelligence will come to dominate the world. Putin, speaking Friday at a meeting with students, said the development of AI raises "colossal opportunities and threats that are difficult to predict now."