We present skweak, a versatile, Python-based software toolkit enabling NLP developers to apply weak supervision to a wide range of NLP tasks. Weak supervision is an emerging machine learning paradigm based on a simple idea: instead of labelling data points by hand, we use labelling functions derived from domain knowledge to automatically obtain annotations for a given dataset. The resulting labels are then aggregated with a generative model that estimates the accuracy (and possible confusions) of each labelling function. The skweak toolkit makes it easy to implement a large spectrum of labelling functions (such as heuristics, gazetteers, neural models or linguistic constraints) on text data, apply them on a corpus, and aggregate their results in a fully unsupervised fashion. skweak is especially designed to facilitate the use of weak supervision for NLP tasks such as text classification and sequence labelling. We illustrate the use of skweak for NER and sentiment analysis. skweak is released under an open-source license and is available at: https://github.com/NorskRegnesentral/skweak

Major depressive disorder (MDD) is a prevalent psychiatric disorder that is associated with significant healthcare burden worldwide. Phenotyping of MDD can help early diagnosis and consequently may have significant advantages in patient management. In prior research MDD phenotypes have been extracted from structured Electronic Health Records (EHR) or using Electroencephalographic (EEG) data with traditional machine learning models to predict MDD phenotypes. However, MDD phenotypic information is also documented in free-text EHR data, such as clinical notes. While clinical notes may provide more accurate phenotyping information, natural language processing (NLP) algorithms must be developed to abstract such information. Recent advancements in NLP resulted in state-of-the-art neural language models, such as Bidirectional Encoder Representations for Transformers (BERT) model, which is a transformer-based model that can be pre-trained from a corpus of unsupervised text data and then fine-tuned on specific tasks. However, such neural language models have been underutilized in clinical NLP tasks due to the lack of large training datasets. In the literature, researchers have utilized the distant supervision paradigm to train machine learning models on clinical text classification tasks to mitigate the issue of lacking annotated training data. It is still unknown whether the paradigm is effective for neural language models. In this paper, we propose to leverage the neural language models in a distant supervision paradigm to identify MDD phenotypes from clinical notes. The experimental results indicate that our proposed approach is effective in identifying MDD phenotypes and that the Bio- Clinical BERT, a specific BERT model for clinical data, achieved the best performance in comparison with conventional machine learning models.

Volumetric imaging by fluorescence microscopy is often limited by anisotropic spatial resolution from inferior axial resolution compared to the lateral resolution. To address this problem, here we present a deep-learning-enabled unsupervised super-resolution technique that enhances anisotropic images in volumetric fluorescence microscopy. In contrast to the existing deep learning approaches that require matched high-resolution target volume images, our method greatly reduces the effort to put into practice as the training of a network requires as little as a single 3D image stack, without a priori knowledge of the image formation process, registration of training data, or separate acquisition of target data. This is achieved based on the optimal transport driven cycle-consistent generative adversarial network that learns from an unpaired matching between high-resolution 2D images in lateral image plane and low-resolution 2D images in the other planes. Using fluorescence confocal microscopy and light-sheet microscopy, we demonstrate that the trained network not only enhances axial resolution beyond the diffraction limit, but also enhances suppressed visual details between the imaging planes and removes imaging artifacts.

Four of the newfound quadruply imaged quasars are shown here: From top left and moving clockwise, the objects are: GraL J1537-3010 or "Wolf's Paw;" GraL J0659 1629 or "Gemini's Crossbow;" GraL J1651-0417 or "Dragon's Kite;" GraL J2038-4008 or "Microscope Lens." The fuzzy dot in the middle of the images is the lensing galaxy, the gravity of which is splitting the light from the quasar behind it in such a way to produce four quasar images. By modeling these systems and monitoring how the different images vary in brightness over time, astronomers can determine the expansion rate of the universe and help solve cosmological problems. With the help of machine-learning techniques, a team of astronomers has discovered a dozen quasars that have been warped by a naturally occurring cosmic "lens" and split into four similar images. Quasars are extremely luminous cores of distant galaxies that are powered by supermassive black holes.

Network Intrusion Detection Systems (NIDSs) are an increasingly important tool for the prevention and mitigation of cyber attacks. A number of labelled synthetic datasets generated have been generated and made publicly available by researchers, and they have become the benchmarks via which new ML-based NIDS classifiers are being evaluated. Recently published results show excellent classification performance with these datasets, increasingly approaching 100 percent performance across key evaluation metrics such as accuracy, F1 score, etc. Unfortunately, we have not yet seen these excellent academic research results translated into practical NIDS systems with such near-perfect performance. This motivated our research presented in this paper, where we analyse the statistical properties of the benign traffic in three of the more recent and relevant NIDS datasets, (CIC, UNSW, ...). As a comparison, we consider two datasets obtained from real-world production networks, one from a university network and one from a medium size Internet Service Provider (ISP). Our results show that the two real-world datasets are quite similar among themselves in regards to most of the considered statistical features. Equally, the three synthetic datasets are also relatively similar within their group. However, and most importantly, our results show a distinct difference of most of the considered statistical features between the three synthetic datasets and the two real-world datasets. Since ML relies on the basic assumption of training and test datasets being sampled from the same distribution, this raises the question of how well the performance results of ML-classifiers trained on the considered synthetic datasets can translate and generalise to real-world networks. We believe this is an interesting and relevant question which provides motivation for further research in this space.

We develop a novel approach for confidently accelerating inference in the large and expensive multilayer Transformers that are now ubiquitous in natural language processing (NLP). Amortized or approximate computational methods increase efficiency, but can come with unpredictable performance costs. In this work, we present CATs--Confident Adaptive Transformers--in which we simultaneously increase computational efficiency, while guaranteeing a specifiable degree of consistency with the original model with high confidence. Our method trains additional prediction heads on top of intermediate layers, and dynamically decides when to stop allocating computational effort to each input using a Figure 1: Our CAT model G can save computational resources meta consistency classifier. To calibrate our by exiting early on certain inputs--while guaranteeing early prediction stopping rule, we formulate a predictive consistency with the full model F. unique extension of conformal prediction.

However, recommender At present, most research on the fairness of recommender systems systems can also bring unfavorable consequences, such is conducted either from the perspective of customers or from the as they may narrow the customers' vision [1], or superior items perspective of product(or service) providers. However, such a practice will receive increased attention so as to become dominant [27], ignores the fact that when fairness is guaranteed to one side, while inferior items will be relegated to a lower position, which the fairness and rights of the other side are likely to reduce. In becomes an extremely vicious circle. As a possible unfavorable consequence, this paper, we consider recommendation scenarios from the perspective the unfairness in recommender systems in different aspects, of two sides(customers and providers). From the perspective such as racial/gender stereotypes [22], social polarization of providers, we consider the fairness of the providers' exposure [12], position bias [27], has been a well-studied research topic. in recommender system. For customers, we consider the fairness Problem Statement. Despite the different mechanisms which of the reduced quality of recommendation results due to the have been implemented to ensure the fairness of recommendations, introduction of fairness measures. We theoretically analyzed the these studies only consider the utility of one type of stakeholder relationship between recommendation quality, customers fairness, in business and try to eliminate unfairness among their members.

In Clarifications are crucial to robust dialogues, and Sections 4 and A we test the practical implications pragmatic factors -- notably those shaped by the of our recipe by identifying and characterizing (according world modalities situating the conversation -- have to their modalities) the clarifications in a a key role to play. Referring expressions have in corpus of long dialogues in English. In Section 5 vision a modality in which to ground clarifications we turn to the claim that clarifications are rare in concerning objects in the world (de Vries et al., dialogue datasets (Ginzburg, 2012), and that current 2017); navigation instructions have in movement data-hungry algorithms cannot learn them. We a modality in which to ground clarifications concerning argue that whether they are rare or not depends collaborative wayfinding (Thomason et al., on pragmatic factors of the conversation and the 2019). Clarifications grounded in situationally relevant modality of the grounded clarification, and discuss modalities boost the redundancy required to the impact of six such factors. After presenting learn to use language without explicit supervision, potential objections and our responses in Section 6, as they make explicit the process of negotiating the we conclude in Section 7 by noting ethical issues communicative intent. But despite its importance, raised by socioperceptive dialogue systems that work on clarification remains scattered.

Answer sentence selection (AS2) modeling requires annotated data, i.e., hand-labeled question-answer pairs. We present a strategy to collect weakly supervised answers for a question based on its reference to improve AS2 modeling. Specifically, we introduce Reference-based Weak Supervision (RWS), a fully automatic large-scale data pipeline that harvests high-quality weakly-supervised answers from abundant Web data requiring only a question-reference pair as input. We study the efficacy and robustness of RWS in the setting of TANDA, a recent state-of-the-art fine-tuning approach specialized for AS2. Our experiments indicate that the produced data consistently bolsters TANDA. We achieve the state of the art in terms of P@1, 90.1%, and MAP, 92.9%, on WikiQA.

Convolutional neural networks (CNNs) are used in many areas of computer vision, such as object tracking and recognition, security, military, and biomedical image analysis. This review presents the application of convolutional neural networks in one of the fields of dentistry - orthodontics. Advances in medical imaging technologies and methods allow CNNs to be used in orthodontics to shorten the planning time of orthodontic treatment, including an automatic search of landmarks on cephalometric X-ray images, tooth segmentation on Cone-Beam Computed Tomography (CBCT) images or digital models, and classification of defects on X-Ray panoramic images. In this work, we describe the current methods, the architectures of deep convolutional neural networks used, and their implementations, together with a comparison of the results achieved by them. The promising results and visualizations of the described studies show that the use of methods based on convolutional neural networks allows for the improvement of computer-based orthodontic treatment planning, both by reducing the examination time and, in many cases, by performing the analysis much more accurately than a manual orthodontist does.