South America
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style
von Kügelgen, Julius, Sharma, Yash, Gresele, Luigi, Brendel, Wieland, Schölkopf, Bernhard, Besserve, Michel, Locatello, Francesco
Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek to understand the empirical success of this approach from a theoretical perspective. We formulate the augmentation process as a latent variable model by postulating a partition of the latent representation into a content component, which is assumed invariant to augmentation, and a style component, which is allowed to change. Unlike prior work on disentanglement and independent component analysis, we allow for both nontrivial statistical and causal dependencies in the latent space. We study the identifiability of the latent representation based on pairs of views of the observations and prove sufficient conditions that allow us to identify the invariant content partition up to an invertible mapping in both generative and discriminative settings. We find numerical simulations with dependent latent variables are consistent with our theory. Lastly, we introduce Causal3DIdent, a dataset of high-dimensional, visually complex images with rich causal dependencies, which we use to study the effect of data augmentations performed in practice.
No vaccines for young children, but schools can reopen safely in the fall, a study shows
The masks, the social distancing, the stick-up-the-nose testing: Those unpleasant coronavirus-controlling measures are far from over for K-12 kids returning to in-school learning after summer vacation ends. It's unlikely that a COVID-19 vaccine will be available for children under 12 before classes resume in the fall. But a new study has found that when elementary-school children mask up and maintain some distance from one another over the course of the school day, a single infected child will likely pass the infection to fewer than one other student, on average, over the course of 30 days. But if schools ditch the masks, abandon efforts to reduce mixing among children, and fail to detect and isolate those who may be infected, outbreaks can certainly happen, a modeling exercise shows. Those outbreaks won't necessarily be large, however, and that leaves local school boards and mayors with difficult choices.
Why Machines Don't Speak Spanish Well (and Why They Should)
Every day people talk more naturally about artificial intelligence (AI). We are getting used to this label - with a meaning for many still surrounded by an enigmatic halo - penetrating our routine more frequently. Without being barely conscious, we smile to unlock the mobile phone without knowing that after that second in front of the camera, thousands of pixels converted into data feed deep learning algorithms at high speed. These are today capable of automating facial recognition in percentages greater than 98% accuracy. The hatching has been stellar.
A generation of seabirds was wiped out by a drone at an O.C. reserve. Now, scientists fear for their future
Eggs littered the sand, but there was no sign of life around or in them. The seabirds that should have been keeping watch had taken off, terrified by a drone that crash-landed into their nesting grounds on an island at the Bolsa Chica Ecological Reserve. "We've never seen such devastation here," said Melissa Loebl, an environmental scientist who manages the Huntington Beach reserve. "This has been really hard for me as a manager." Some 3,000 elegant terns fled the reserve after the drone crashed May 12, leaving behind 1,500 to 2,000 eggs, none of them viable.
Robot paramedic carries out CPR in ambulance in UK first / Humans + Tech - #83
As humans, it seems we are putting too much trust in AI, and business leaders are disinterested in ensuring that the systems they use are ethical and responsible. When humans administer cardiopulmonary resuscitation (CPR), they get fatigued relatively quickly, affecting the quality of CPR they can deliver. LUCAS 3 is a mechanical system that can administer high-quality CPR consistently without a break. South Central Ambulance Service, an NHS ambulance service in the UK for four counties, is the first to take LUCAS 3 onboard its vehicles [E&T Editorial staff, The Institution of Engineering and Technology]. The system uses wireless Bluetooth connectivity, allowing it to configure the compression rate, depth, and alerts specific to an organisation's resuscitation guidelines.
Hybrid Method Based on NARX models and Machine Learning for Pattern Recognition
Silva, P. H. O., Cerqueira, A. S., Nepomuceno, E. G.
Therefore, if the input variables (features) have a larger number The progressive development of modern technology, comprised compared to the number of training data, in some cases of computer and internet applications, generates it can result in complex and ineffective models. Basically, large amounts of data at an unprecedented speed, such the generalizability of the classifier may not be enough, as videos, photos, texts, voices, and data obtained from being necessary to extract and select features to improve the emergence of the Internet of Things (IoT) and cloud the generalizability.
Learning to Guide a Saturation-Based Theorem Prover
Abdelaziz, Ibrahim, Crouse, Maxwell, Makni, Bassem, Austil, Vernon, Cornelio, Cristina, Ikbal, Shajith, Kapanipathi, Pavan, Makondo, Ndivhuwo, Srinivas, Kavitha, Witbrock, Michael, Fokoue, Achille
Traditional automated theorem provers have relied on manually tuned heuristics to guide how they perform proof search. Recently, however, there has been a surge of interest in the design of learning mechanisms that can be integrated into theorem provers to improve their performance automatically. In this work, we introduce TRAIL, a deep learning-based approach to theorem proving that characterizes core elements of saturation-based theorem proving within a neural framework. TRAIL leverages (a) an effective graph neural network for representing logical formulas, (b) a novel neural representation of the state of a saturation-based theorem prover in terms of processed clauses and available actions, and (c) a novel representation of the inference selection process as an attention-based action policy. We show through a systematic analysis that these components allow TRAIL to significantly outperform previous reinforcement learning-based theorem provers on two standard benchmark datasets (up to 36% more theorems proved). In addition, to the best of our knowledge, TRAIL is the first reinforcement learning-based approach to exceed the performance of a state-of-the-art traditional theorem prover on a standard theorem proving benchmark (solving up to 17% more problems).
The effect of phased recurrent units in the classification of multiple catalogs of astronomical lightcurves
Donoso-Oliva, C., Cabrera-Vives, G., Protopapas, P., Carrasco-Davis, R., Estevez, P. A.
In the new era of very large telescopes, where data is crucial to expand scientific knowledge, we have witnessed many deep learning applications for the automatic classification of lightcurves. Recurrent neural networks (RNNs) are one of the models used for these applications, and the LSTM unit stands out for being an excellent choice for the representation of long time series. In general, RNNs assume observations at discrete times, which may not suit the irregular sampling of lightcurves. A traditional technique to address irregular sequences consists of adding the sampling time to the network's input, but this is not guaranteed to capture sampling irregularities during training. Alternatively, the Phased LSTM unit has been created to address this problem by updating its state using the sampling times explicitly. In this work, we study the effectiveness of the LSTM and Phased LSTM based architectures for the classification of astronomical lightcurves. We use seven catalogs containing periodic and nonperiodic astronomical objects. Our findings show that LSTM outperformed PLSTM on 6/7 datasets. However, the combination of both units enhances the results in all datasets.
Enzolytics, Inc. (ENZC) Running Hard As Co Partners With Intel to Publish White Paper on AI Artificial Intelligence Targeting Monoclonal Antibodies
Enzolytics, Inc. (ENZC) is making a powerful move up the charts in recent days since a brief dip below the $0.10 mark. ENZC is a major league runner and powerhouse stock; over the past few months ENZC has seen a legendary run to recent highs of 0.958 per share as it completes the historic merger between BioClonetics and Enzolytics; the new biotech is getting noticed as its technology for producing fully human monoclonal antibodies is currently being employed to produce anti-SARS-CoV-2 (CoronaVirus) monoclonal antibodies for treating COVID-19. With each day of progression of the Coronavirus pandemic, the dire need for multiple active therapeutics becomes more evident. ENZC is a pioneer in using monoclonal antibodies for treating COVID-19. ENZC has partnered with Intel to publish a white paper titled, "Optimizing Empathetic A.I. to Cure Deadly Diseases," highlighting Intel's Artificial Intelligence Analytic tools and Enzolytic's innovative approach and groundbreaking contributions to create universal, durable, and broadly effective treatment targeting all virus variants.
3D UAV Trajectory and Data Collection Optimisation via Deep Reinforcement Learning
Nguyen, Khoi Khac, Duong, Trung Q., Do-Duy, Tan, Claussen, Holger, Hanzo, and Lajos
Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. However, due to the limitation of their on-board power and flight time, it is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT). In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices. Then, a deep reinforcement learning-based technique is conceived for finding the optimal trajectory and throughput in a specific coverage area. After training, the UAV has the ability to autonomously collect all the data from user nodes at a significant total sum-rate improvement while minimising the associated resources used. Numerical results are provided to highlight how our techniques strike a balance between the throughput attained, trajectory, and the time spent. More explicitly, we characterise the attainable performance in terms of the UAV trajectory, the expected reward and the total sum-rate.