Goto

Collaborating Authors

 Africa


Efficient Search-Based Weighted Model Integration

arXiv.org Artificial Intelligence

Weighted model integration (WMI) extends Weighted model counting (WMC) to the integration of functions over mixed discrete-continuous domains. It has shown tremendous promise for solving inference problems in graphical models and probabilistic programming. Yet, state-of-the-art tools for WMI are limited in terms of performance and ignore the independence structure that is crucial to improving efficiency. To address this limitation, we propose an efficient model integration algorithm for theories with tree primal graphs. We exploit the sparse graph structure by using search to performing integration. Our algorithm greatly improves the computational efficiency on such problems and exploits context-specific independence between variables. Experimental results show dramatic speedups compared to existing WMI solvers on problems with tree-shaped dependencies.


Individualized Multilayer Tensor Learning with An Application in Imaging Analysis

arXiv.org Machine Learning

This work is motivated by multimodality breast cancer imaging data, which is quite challenging in that the signals of discrete tumor-associated microvesicles (TMVs) are randomly distributed with heterogeneous patterns. This imposes a significant challenge for conventional imaging regression and dimension reduction models assuming a homogeneous feature structure. We develop an innovative multilayer tensor learning method to incorporate heterogeneity to a higher-order tensor decomposition and predict disease status effectively through utilizing subject-wise imaging features and multimodality information. Specifically, we construct a multilayer decomposition which leverages an individualized imaging layer in addition to a modality-specific tensor structure. One major advantage of our approach is that we are able to efficiently capture the heterogeneous spatial features of signals that are not characterized by a population structure as well as integrating multimodality information simultaneously. To achieve scalable computing, we develop a new bi-level block improvement algorithm. In theory, we investigate both the algorithm convergence property, tensor signal recovery error bound and asymptotic consistency for prediction model estimation. We also apply the proposed method for simulated and human breast cancer imaging data. Numerical results demonstrate that the proposed method outperforms other existing competing methods.


Representing ill-known parts of a numerical model using a machine learning approach

arXiv.org Machine Learning

In numerical modeling of the Earth System, many processes remain unknown or ill represented (let us quote sub-grid processes, the dependence to unknown latent variables or the non-inclusion of complex dynamics in numerical models) but sometimes can be observed. This paper proposes a methodology to produce a hybrid model combining a physical-based model (forecasting the well-known processes) with a neural-net model trained from observations (forecasting the remaining processes). The approach is applied to a shallow-water model in which the forcing, dissipative and diffusive terms are assumed to be unknown. We show that the hybrid model is able to reproduce with great accuracy the unknown terms (correlation close to 1). For long term simulations it reproduces with no significant difference the mean state, the kinetic energy, the potential energy and the potential vorticity of the system. Lastly it is able to function with new forcings that were not encountered during the training phase of the neural network.


Deep Gaussian Processes for Multi-fidelity Modeling

arXiv.org Machine Learning

Multi-fidelity methods are prominently used when cheaply-obtained, but possibly biased and noisy, observations must be effectively combined with limited or expensive true data in order to construct reliable models. This arises in both fundamental machine learning procedures such as Bayesian optimization, as well as more practical science and engineering applications. In this paper we develop a novel multi-fidelity model which treats layers of a deep Gaussian process as fidelity levels, and uses a variational inference scheme to propagate uncertainty across them. This allows for capturing nonlinear correlations between fidelities with lower risk of overfitting than existing methods exploiting compositional structure, which are conversely burdened by structural assumptions and constraints. We show that the proposed approach makes substantial improvements in quantifying and propagating uncertainty in multi-fidelity set-ups, which in turn improves their effectiveness in decision making pipelines.


Training Over-parameterized Deep ResNet Is almost as Easy as Training a Two-layer Network

arXiv.org Machine Learning

Although deep neural networks have achieved revolutionary success over various tasks, i.e., computer vision [He et al., 2016] and natural language understanding [Hochreiter and Schmidhuber, 1997], they are still in lack of a rigorous theoretical study of the optimization and generalization properties. Specifically for the optimization, because the loss of deep neural network is highly nonconvex, local search algorithms like gradient descent is hard to analyze with performance guarantee. Many recent works [Choromanska et al., 2015, Kawaguchi, 2016, Nguyen and Hein, 2017, Soudry and Hoffer, 2017] have studied the loss surface of the neural networks and a common claim is that (deep) neural networks have H. Zhang, W. Chen and TY Liu are with Microsoft Research Asia, Beijing, 100080 China (email: {huzhang, wche, tyliu}@microsoft.com); D. Yu is with School of Data and Computer Science at Sun Yat-sen University, Guangzhou, 510275, China (email: yuda3@mail2.sysu.edu.cn).


Video Friday: MIT's Origami Magic-Ball Gripper

IEEE Spectrum Robotics

Video Friday is your weekly selection of awesome robotics videos, collected by your Automaton bloggers. We'll also be posting a weekly calendar of upcoming robotics events for the next few months; here's what we have so far (send us your events!): Let us know if you have suggestions for next week, and enjoy today's videos. This soft gripper from MIT is based on an origami "magic-ball." It's a "magic-ball gripper," and that hyphen placement is absolutely critical to it functioning appropriately.


9 Artificial Intelligence Startups in Lebanon - Nanalyze

#artificialintelligence

With roughly the same population as the State of Missouri, Lebanon is a small country of six million people that borders Syria and Israel. Due to its location, the country has been subjected to a multitude of political and religious factions inhabiting the state. People frequently fight over whose invisible friend is better, and the country has faced long periods of instability including wars with Israel, civil wars and internal conflicts, and most recently some spillover from the Syrian war โ€“ which means lots of Syrians flying around on motorcycles. All of this turmoil has contributed to structural problems in the economy such as chronic fiscal deficits that have increased Lebanon's debt-to-GDP ratio to the third highest in the world. Economic growth has slowed to 1-2% over the past decade which constrains government investments in necessary infrastructure improvements. Notwithstanding these challenges, day to day life in Lebanon is pretty awesome.


The Bizarre and Terrifying Case of the "Deepfake" Video that Helped Bring an African Nation to the Brink

Mother Jones

This fall, Gabon was facing an odd and tenuous political situation. President Ali Bongo had been out of the country since October receiving medical treatment in Saudi Arabia and London and had not been seen in public. People in Gabon and observers outside the country were growing suspicious about the president's well being, and the government's lack of answers only fueled doubts; some even said he was dead. After months of little information, on December 9th, the country's vice president announced that Bongo had suffered a stroke in the autumn, but remained in good shape. Despite such assurances, civil society groups and many members of the public wondered why Bongo, if he was well, had not made any public appearances, save for a few pictures of him released by the government along with a silent video.


African AI pioneer and Cortex Logic CEO awarded AI leader of the year - Screen Africa

#artificialintelligence

South African-based Artificial Intelligence (AI) software & solutions veteran and founder of Cortex Logic โ€“ Dr. Jacques Ludik โ€“ has been awarded a premium accolade at Africa's Tech Week event, underlying a life dedicated to AI and Data Science Innovation. Ludik, an Africa-based smart technology entrepreneur and AI investor/ AI ecosystem builder, holds a PhD in Computer Science and has amassed 25 years' experience in the study and exploitation of AI & Data Science in real world applications. Ludik was formally a founder of Bennit AI, Mosaic, SynerG and CSense Systems, the latter being Africa's first AI company sold to General Electric in 2011. Over the course of his career Ludik has published a wide range of papers on AI, Advanced Analytics, Machine Learning and Data Science and is a big supporter of AI for social good. He is currently founder & CEO of Cortex Logic as well as founder & president of the Machine Intelligence Institute of Africa (MIIA).


Why AI will make healthcare personal

#artificialintelligence

For generations healthcare has been episodic โ€“ someone gets sick or breaks a bone, they see a doctor, and then they might not see another one until the next time they get sick or injured. Now, as emerging technologies such as artificial intelligence open up new possibilities for the healthcare industry in the Fourth Industrial Revolution, policymakers and practitioners are developing new ways to deliver continuous healthcare for better outcomes. Consumers already expect access to healthcare providers to be as smart and easy as online banking, retrieving boarding passes and making restaurant reservations, according to Kaiser Permanente CEO Bernard J Tyson. Nearly three-quarters of Americans with health insurance (72%), for example, say it's important that their health insurance provider uses modern communication tools, such as instant message and two-way video. Innovative healthcare organizations such as Kaiser Permanente are listening.