Since the introduction and the public availability of the \textsc{ucr} time series benchmark data sets, numerous Time Series Classification (TSC) methods has been designed, evaluated and compared to each others. We suggest a critical view of TSC performance evaluation protocols put in place in recent TSC literature. The main goal of this `position' paper is to stimulate discussion and reflexion about performance evaluation in TSC literature.

Distant supervision for relation extraction heavily suffers from the wrong labeling problem. To alleviate this issue in news data with the timestamp, we take a new factor time into consideration and propose a novel time-aware distant supervision framework (Time-DS). Time-DS is composed of a time series instance-popularity and two strategies. Instance-popularity is to encode the strong relevance of time and true relation mention. Therefore, instance-popularity would be an effective clue to reduce the noises generated through distant supervision labeling. The two strategies, i.e., hard filter and curriculum learning are both ways to implement instance-popularity for better relation extraction in the manner of Time-DS. The curriculum learning is a more sophisticated and flexible way to exploit instance-popularity to eliminate the bad effects of noises, thus get better relation extraction performance. Experiments on our collected multi-source news corpus show that Time-DS achieves significant improvements for relation extraction.

Ahead of the 2019 TensorFlow Dev Summit, Google is announcing a new way for third-party developers to adopt differential privacy when training machine learning models. TensorFlow Privacy is designed to be easy to implement for developers already using the popular open-source ML library. The goal (via The Verge) of differential privacy for machine learning is to only "encode general patterns rather than facts about specific training examples." This allows user data to remain private, while the system overall still learns and can advance from general behavior. In particular, when training on users' data, those techniques offer strong mathematical guarantees that models do not learn or remember the details about any specific user.

Today, we're excited to announce TensorFlow Privacy (GitHub), an open source library that makes it easier not only for developers to train machine-learning models with privacy, but also for researchers to advance the state of the art in machine learning with strong privacy guarantees. Modern machine learning is increasingly applied to create amazing new technologies and user experiences, many of which involve training machines to learn responsibly from sensitive data, such as personal photos or email. Ideally, the parameters of trained machine-learning models should encode general patterns rather than facts about specific training examples. To ensure this, and to give strong privacy guarantees when the training data is sensitive, it is possible to use techniques based on the theory of differential privacy. In particular, when training on users' data, those techniques offer strong mathematical guarantees that models do not learn or remember the details about any specific user.

Yang et al. [7] used Fisher widely advocated for image classification problems. To further Information criterion in their class-specific reconstruction errors sharpen their discriminative capabilities, most state-ofthe-art to compose their approach. DL methods have additional constraints included in Besides SDL, Analysis Dictionary Learning (ADL) [8, 9] the learning stages. These various constraints, however, lead has recently been of interest on account of its fast encoding to additional computational complexity. We hence propose an and stability attributes. ADL provides a linear transformation efficient Discriminative Convolutional Analysis Dictionary of a signal to a nearly sparse representation. Inspired by Learning (DCADL) method, as a lower cost Discriminative the SDL methodology in image classification, ADL has also DL framework, to both characterize the image structures and been adapted to the supervised learning problems by promoting refine the interclass structure representations. The proposed discriminative sparse representations [10, 11]. In [10], DCADL jointly learns a convolutional analysis dictionary and Guo et al. incorporated both a topological structure and a representation a universal classifier, while greatly reducing the time complexity similarity constraint to encourage a suitable classselective in both training and testing phases, and achieving a representation for a 1-Nearest Neighbor classifier.

Over the past 10 years, commercial AI has enjoyed what we at Amazon call the flywheel effect: customer interactions with AI systems generate data; with more data, machine learning algorithms perform better, which leads to better customer experiences; better customer experiences drive more usage and engagement, which in turn generate more data. Those data are used to train machine learning systems in three chief ways. The first is supervised learning, in which the training data are hand-labeled (with, say, words' parts of speech or the names of objects in an image) and the system learns to apply labels to unlabeled data. A variation of this is weakly supervised learning, which uses easily acquired but imprecise labels to enable machine learning at scale. If a website visitor performs a search, for instance, the links she clicks indicate which search results should have been at the top of the list; that kind of implicit information can be used to automatically label data. Training with entirely unlabeled data is called unsupervised learning.

We study the interplay between surrogate methods for structured prediction and techniques from multitask learning designed to leverage relationships between surrogate outputs. We propose an efficient algorithm based on trace norm regularization which, differently from previous methods, does not require explicit knowledge of the coding/decoding functions of the surrogate framework. As a result, our algorithm can be applied to the broad class of problems in which the surrogate space is large or even infinite dimensional. We study excess risk bounds for trace norm regularized structured prediction, implying the consistency and learning rates for our estimator. We also identify relevant regimes in which our approach can enjoy better generalization performance than previous methods. Numerical experiments on ranking problems indicate that enforcing low-rank relations among surrogate outputs may indeed provide a significant advantage in practice.

Graph Convolutional Networks(GCNs) play a crucial role in graph learning tasks, however, learning graph embedding with few supervised signals is still a difficult problem. In this paper, we propose a novel training algorithm for Graph Convolutional Network, called Multi-Stage Self-Supervised(M3S) Training Algorithm, combined with self-supervised learning approach, focusing on improving the generalization performance of GCNs on graphs with few labeled nodes. Firstly, a Multi-Stage Training Framework is provided as the basis of M3S training method. Then we leverage DeepCluster technique, a popular form of self-supervised learning, and design corresponding aligning mechanism on the embedding space to refine the Multi-Stage Training Framework, resulting in M3S Training Algorithm. Finally, extensive experimental results verify the superior performance of our algorithm on graphs with few labeled nodes under different label rates compared with other state-of-the-art approaches.

Deep structured-prediction energy-based models combine the expressive power of learned representations and the ability of embedding knowledge about the task at hand into the system. A common way to learn parameters of such models consists in a multistage procedure where different combinations of components are trained at different stages. The joint end-to-end training of the whole system is then done as the last fine-tuning stage. This multistage approach is time-consuming and cumbersome as it requires multiple runs until convergence and multiple rounds of hyperparameter tuning. From this point of view, it is beneficial to start the joint training procedure from the beginning. However, such approaches often unexpectedly fail and deliver results worse than the multistage ones. In this paper, we hypothesize that one reason for joint training of deep energy-based models to fail is the incorrect relative normalization of different components in the energy function. We propose online and offline scaling algorithms that fix the joint training and demonstrate their efficacy on three different tasks.

Current methods for covariate-shift adaptation use unlabelled data to compute importance weights or domain-invariant features, while the final model is trained on labelled data only. Here, we consider a particular case of covariate shift which allows us also to learn from unlabelled data, that is, combining adaptation with semi-supervised learning. Using ideas from causality, we argue that this requires learning with both causes, $X_C$, and effects, $X_E$, of a target variable, $Y$, and show how this setting leads to what we call a semi-generative model, $P(Y,X_E|X_C,\theta)$. Our approach is robust to domain shifts in the distribution of causal features and leverages unlabelled data by learning a direct map from causes to effects. Experiments on synthetic data demonstrate significant improvements in classification over purely-supervised and importance-weighting baselines.