Africa
ISLET: Fast and Optimal Low-rank Tensor Regression via Importance Sketching
Zhang, Anru, Luo, Yuetian, Raskutti, Garvesh, Yuan, Ming
In this paper, we develop a novel procedure for low-rank tensor regression, namely \underline{I}mportance \underline{S}ketching \underline{L}ow-rank \underline{E}stimation for \underline{T}ensors (ISLET). The central idea behind ISLET is \emph{importance sketching}, i.e., carefully designed sketches based on both the responses and low-dimensional structure of the parameter of interest. We show that the proposed method is sharply minimax optimal in terms of the mean-squared error under low-rank Tucker assumptions and under randomized Gaussian ensemble design. In addition, if a tensor is low-rank with group sparsity, our procedure also achieves minimax optimality. Further, we show through numerical studies that ISLET achieves comparable or better mean-squared error performance to existing state-of-the-art methods whilst having substantial storage and run-time advantages including capabilities for parallel and distributed computing. In particular, our procedure performs reliable estimation with tensors of dimension $p = O(10^8)$ and is $1$ or $2$ orders of magnitude faster than baseline methods.
Tensor Regression Using Low-rank and Sparse Tucker Decompositions
Ahmed, Talal, Raja, Haroon, Bajwa, Waheed U.
This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in $\mathbb{R}^{n_1 \times n_2 \times \cdots \times n_d}$. This work focuses on the task of estimating the regression tensor from $m$ realizations of the response variable and the predictors where $m\ll n = \prod \nolimits_{i} n_i$. Despite the ill-posedness of this estimation problem, it can still be solved if the parameter tensor belongs to the space of sparse, low Tucker-rank tensors. Accordingly, the estimation procedure is posed as a non-convex optimization program over the space of sparse, low Tucker-rank tensors, and a tensor variant of projected gradient descent is proposed to solve the resulting non-convex problem. In addition, mathematical guarantees are provided that establish the proposed method converges to the correct solution under the right set of conditions. Further, an upper bound on sample complexity of tensor parameter estimation for the model under consideration is characterized for the special case when the individual (scalar) predictors independently draw values from a sub-Gaussian distribution. The sample complexity bound is shown to have a polylogarithmic dependence on $\bar{n} = \max \big\{n_i: i\in \{1,2,\ldots,d \} \big\}$ and, orderwise, it matches the bound one can obtain from a heuristic parameter counting argument. Finally, numerical experiments demonstrate the efficacy of the proposed tensor model and estimation method on a synthetic dataset and a neuroimaging dataset pertaining to attention deficit hyperactivity disorder. Specifically, the proposed method exhibits better sample complexities on both synthetic and real datasets, demonstrating the usefulness of the model and the method in settings where $n \gg m$.
Preservation of Anomalous Subgroups On Machine Learning Transformed Data
Maina, Samuel C., Bryant, Reginald E., Goal, William O., Samoilescu, Robert-Florian, Varshney, Kush R., Weldemariam, Komminist
In this paper, we investigate the effect of machine learning based anonymization on anomalous subgroup preservation. In particular, we train a binary classifier to discover the most anomalous subgroup in a dataset by maximizing the bias between the group's predicted odds ratio from the model and observed odds ratio from the data. We then perform anonymization using a variational autoencoder (VAE) to synthesize an entirely new dataset that would ideally be drawn from the distribution of the original data. We repeat the anomalous subgroup discovery task on the new data and compare it to what was identified pre-anonymization. We evaluated our approach using publicly available datasets from the financial industry. Our evaluation confirmed that the approach was able to produce synthetic datasets that preserved a high level of subgroup differentiation as identified initially in the original dataset. Such a distinction was maintained while having distinctly different records between the synthetic and original dataset. Finally, we packed the above end to end process into what we call Utility Guaranteed Deep Privacy (UGDP) system. UGDP can be easily extended to onboard alternative generative approaches such as GANs to synthesize tabular data.
Eye in the sky: Japan seeks AI-guided surveillance for patrol planes
Japan will begin research on using artificial intelligence to bolster surveillance by naval patrol aircraft, as a changing national security environment forces the Self-Defense Forces to take on wider roles despite a personnel shortage. The AI would help ascertain whether a target spotted by conventional radar is an enemy vessel or some other threat. Machine learning through previous data would be used to develop the ability to identify a vessel from images that are difficult for the human eye to decipher. Currently, radar data converted to black-and-white images are scrutinized by experienced SDF personnel. The Defense Ministry will use a budget of about 900 million yen ($8.25 million) for development in the fiscal year starting in April, with the goal of outfitting Maritime SDF patrol planes with the technology as early as fiscal 2024.
Asia Times America's misguided war on Chinese technology Opinion
The worst foreign-policy decision by the United States of the last generation – and perhaps longer – was the "war of choice" that it launched in Iraq in 2003 for the stated purpose of eliminating weapons of mass destruction that did not, in fact, exist. Understanding the illogic behind that disastrous decision has never been more relevant, because it is being used to justify a similarly misguided US policy today. The decision to invade Iraq followed the illogic of then-US vice-president Richard Cheney, who declared that even if the risk of WMD falling into terrorist hands was tiny – say, 1% – we should act as if that scenario would certainly occur. Such reasoning is guaranteed to lead to wrong decisions more often than not. Yet the US and some of its allies are now using the Cheney Doctrine to attack Chinese technology.
A List of Chip/IP for Deep Learning
Machine Learning, especially Deep Learning technology is driving the evolution of artificial intelligence (AI). At the beginning, deep learning has primarily been a software play. Start from the year 2016, the need for more efficient hardware acceleration of AI/ML/DL was recognized in academia and industry. This year, we saw more and more players, including world's top semiconductor companies as well as a number of startups, even tech giants Google, have jumped into the race. I believe that it could be very interesting to look at them together. So, I build this list of AI/ML/DL ICs and IPs on Github and keep updating. If you have any suggestion or new information, please let me know. The companies and products in the list are organized into five categories as shown in the following table. Intel purchased Nervana Systems who was developing both a GPU/software approach in addition to their Nervana Engine ASIC. Intel is also planning in integrating into the Phi platform via a Knights Crest project.
Read My Honor 10 Long Term Review - Fabulous AI
I had more than a month to try out the new Honor 10 and here is my honest review on what I think of the phone. Hint – AI camera is awesome! I got the chance to review the Honor 10 over the period of more than a month recently and there are tons of stuffs that I like about it. Of course there are some misses along the way but I feel those are forgivable. But when it comes to AI features in the camera, the Honor 10 scores high in my books.
Advances in Machine Learning for the Behavioral Sciences
Kliegr, Tomáš, Bahník, Štěpán, Fürnkranz, Johannes
This is most apparent when auto-encoders are trained, where a network is trained to map the input data upon itself but is forced to project them into a lower-dimensional embedding space on the way (Vincent et al., 2010). In addition to the conventional fully connected layers, there are various special types of network connections. For example, in computer vision, convolu-tional layers are commonly used, which train multiple sliding windows that move over the image data and process just a part of the image at a time, thereby learning to recognize local features. These layers are subsequently abstracted into more and more complex visual patterns (Krizhevsky et al., 2017). For temporal data, one can use recurrent neural networks, which do not make predictions for individual input vectors, but for a sequence of input vectors. To do so, they allow feeding abstracted information from previous data points forward to the next layers.
Ground Metric Learning on Graphs
Heitz, Matthieu, Bonneel, Nicolas, Coeurjolly, David, Cuturi, Marco, Peyré, Gabriel
Optimal transport (OT) distances between probability distributions are parameterized by the ground metric they use between observations. Their relevance for real-life applications strongly hinges on whether that ground metric parameter is suitably chosen. Selecting it adaptively and algorithmically from prior knowledge, the so-called ground metric learning GML) problem, has therefore appeared in various settings. We consider it in this paper when the learned metric is constrained to be a geodesic distance on a graph that supports the measures of interest. This imposes a rich structure for candidate metrics, but also enables far more efficient learning procedures when compared to a direct optimization over the space of all metric matrices. We use this setting to tackle an inverse problem stemming from the observation of a density evolving with time: we seek a graph ground metric such that the OT interpolation between the starting and ending densities that result from that ground metric agrees with the observed evolution. This OT dynamic framework is relevant to model natural phenomena exhibiting displacements of mass, such as for instance the evolution of the color palette induced by the modification of lighting and materials.