Africa
Improving Specificity in Mammography Using Cross-correlation between Wavelet and Fourier Transform
Breast cancer is in the most common malignant tumor in women. It accounted for 30% of new malignant tumor cases. Although the incidence of breast cancer remains high around the world, the mortality rate has been continuously reduced. This is mainly due to recent developments in molecular biology technology and improved level of comprehensive diagnosis and standard treatment. Early detection by mammography is an integral part of that. The most common breast abnormalities that may indicate breast cancer are masses and calcifications. Previous detection approaches usually obtain relatively high sensitivity but unsatisfactory specificity. We will investigate an approach that applies the discrete wavelet transform and Fourier transform to parse the images and extracts statistical features that characterize an image's content, such as the mean intensity and the skewness of the intensity. A naive Bayesian classifier uses these features to classify the images. We expect to achieve an optimal high specificity.
NaijaSenti: A Nigerian Twitter Sentiment Corpus for Multilingual Sentiment Analysis
Muhammad, Shamsuddeen Hassan, Adelani, David Ifeoluwa, Ruder, Sebastian, Ahmad, Ibrahim Said, Abdulmumin, Idris, Bello, Bello Shehu, Choudhury, Monojit, Emezue, Chris Chinenye, Abdullahi, Saheed Salahudeen, Aremu, Anuoluwapo, Jeorge, Alipio, Brazdil, Pavel
Sentiment analysis is one of the most widely studied applications in NLP, but most work focuses on languages with large amounts of data. We introduce the first large-scale human-annotated Twitter sentiment dataset for the four most widely spoken languages in Nigeria (Hausa, Igbo, Nigerian-Pidgin, and Yor\`ub\'a ) consisting of around 30,000 annotated tweets per language (and 14,000 for Nigerian-Pidgin), including a significant fraction of code-mixed tweets. We propose text collection, filtering, processing and labeling methods that enable us to create datasets for these low-resource languages. We evaluate a rangeof pre-trained models and transfer strategies on the dataset. We find that language-specific models and language-adaptivefine-tuning generally perform best. We release the datasets, trained models, sentiment lexicons, and code to incentivizeresearch on sentiment analysis in under-represented languages.
Higher Order Correlation Analysis for Multi-View Learning
Nie, Jiawang, Wang, Li, Zheng, Zequn
Multi-view learning is frequently used in data science. The pairwise correlation maximization is a classical approach for exploring the consensus of multiple views. Since the pairwise correlation is inherent for two views, the extensions to more views can be diversified and the intrinsic interconnections among views are generally lost. To address this issue, we propose to maximize higher order correlations. This can be formulated as a low rank approximation problem with the higher order correlation tensor of multi-view data. We use the generating polynomial method to solve the low rank approximation problem. Numerical results on real multi-view data demonstrate that this method consistently outperforms prior existing methods.
Artificial intelligence and other tech trends to follow in 2022
Google CEO Sundar Pichai said, "Artificial Intelligence is more profound than fire, electricity, or the internet." His words certainly make sense owing to AI's contributions to the world, climate change, space exploration, or developing cancer treatments. The way AI enables machines to make decisions faster with more accuracy than a human mind is truly extraordinary. It indicates the power of AI and how it can unlock unimaginable possibilities in life. With this backdrop in mind, here's a list of top tech trends that businesses must focus on and invest in: AI has been game-changing across various industries.
US defence chief orders military to better protect civilians
US Defense Secretary Lloyd Austin has issued a directive ordering the United States military to do more to protect civilians from harm in drone attacks and other combat operations. In a two-page memo to top Pentagon civilian and military officials, Austin on Thursday ordered a comprehensive overhaul of the US Defense Department's posture towards protecting civilians in conflict zones. "The protection of innocent civilians in the conduct of our operations remains vital to the ultimate success of our operations and as a significant strategic and moral imperative," the memo reads. The defence secretary asked for an action plan from the Joint Chiefs of Staff to prevent harm to civilians and improve US responses when such incidents occur. That plan is due within 90 days.
Soundscape Ecology: The Science of Sound in the Landscape
Note that the Buckeye Flats location (a) contains greater acoustic activity, a result of the nearby rapid flowing stream that produced considerable geophonic sounds. The inset (b) graphs the same data but with Buckeye Flats removed. These values (b) reflect mostly biophony. Sycamore Creek contained the greatest acoustic activity of these three. The fall contains the greatest activity although there was no consistent pattern across sites. Photos of each landscape are provided in (c).
Ontology-enhanced Prompt-tuning for Few-shot Learning
Ye, Hongbin, Zhang, Ningyu, Deng, Shumin, Chen, Xiang, Chen, Hui, Xiong, Feiyu, Chen, Xi, Chen, Huajun
Few-shot Learning (FSL) is aimed to make predictions based on a limited number of samples. Structured data such as knowledge graphs and ontology libraries has been leveraged to benefit the few-shot setting in various tasks. However, the priors adopted by the existing methods suffer from challenging knowledge missing, knowledge noise, and knowledge heterogeneity, which hinder the performance for few-shot learning. In this study, we explore knowledge injection for FSL with pre-trained language models and propose ontology-enhanced prompt-tuning (OntoPrompt). Specifically, we develop the ontology transformation based on the external knowledge graph to address the knowledge missing issue, which fulfills and converts structure knowledge to text. We further introduce span-sensitive knowledge injection via a visible matrix to select informative knowledge to handle the knowledge noise issue. To bridge the gap between knowledge and text, we propose a collective training algorithm to optimize representations jointly. We evaluate our proposed OntoPrompt in three tasks, including relation extraction, event extraction, and knowledge graph completion, with eight datasets. Experimental results demonstrate that our approach can obtain better few-shot performance than baselines.
Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks
Razin, Noam, Maman, Asaf, Cohen, Nadav
In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks. It was shown that these models exhibit implicit regularization towards low matrix and tensor ranks, respectively. Drawing closer to practical deep learning, the current paper theoretically analyzes the implicit regularization in hierarchical tensor factorization, a model equivalent to certain deep convolutional neural networks. Through a dynamical systems lens, we overcome challenges associated with hierarchy, and establish implicit regularization towards low hierarchical tensor rank. This translates to an implicit regularization towards locality for the associated convolutional networks. Inspired by our theory, we design explicit regularization discouraging locality, and demonstrate its ability to improve performance of modern convolutional networks on non-local tasks, in defiance of conventional wisdom by which architectural changes are needed. Our work highlights the potential of enhancing neural networks via theoretical analysis of their implicit regularization.
A Survey on Visual Transfer Learning using Knowledge Graphs
Monka, Sebastian, Halilaj, Lavdim, Rettinger, Achim
Recent approaches of computer vision utilize deep learning methods as they perform quite well if training and testing domains follow the same underlying data distribution. However, it has been shown that minor variations in the images that occur when using these methods in the real world can lead to unpredictable errors. Transfer learning is the area of machine learning that tries to prevent these errors. Especially, approaches that augment image data using auxiliary knowledge encoded in language embeddings or knowledge graphs (KGs) have achieved promising results in recent years. This survey focuses on visual transfer learning approaches using KGs. KGs can represent auxiliary knowledge either in an underlying graph-structured schema or in a vector-based knowledge graph embedding. Intending to enable the reader to solve visual transfer learning problems with the help of specific KG-DL configurations we start with a description of relevant modeling structures of a KG of various expressions, such as directed labeled graphs, hypergraphs, and hyper-relational graphs. We explain the notion of feature extractor, while specifically referring to visual and semantic features. We provide a broad overview of knowledge graph embedding methods and describe several joint training objectives suitable to combine them with high dimensional visual embeddings. The main section introduces four different categories on how a KG can be combined with a DL pipeline: 1) Knowledge Graph as a Reviewer; 2) Knowledge Graph as a Trainee; 3) Knowledge Graph as a Trainer; and 4) Knowledge Graph as a Peer. To help researchers find evaluation benchmarks, we provide an overview of generic KGs and a set of image processing datasets and benchmarks including various types of auxiliary knowledge. Last, we summarize related surveys and give an outlook about challenges and open issues for future research.
Timnit Gebru is part of a wave of Black women working to change AI
A computer scientist who said she was pushed out of her job at Google in December 2020 has marked the one-year anniversary of her ouster with a new research institute aiming to support the creation of ethical artificial intelligence. Timnit Gebru, a known advocate for diversity in AI, announced the launch of the Distributed Artificial Intelligence Research Institute, or DAIR. Its website describes it as "a space for independent, community-rooted AI research free from Big Tech's pervasive influence." Part of how Gebru imagines creating such research is by moving away from the Silicon Valley ethos of "move fast and break things" -- which was Facebook's internal motto, coined by Mark Zuckerberg, until 2014 -- to instead take a more deliberate approach to creating new technologies that serve marginalized communities. That includes recognizing and mitigating technologies' potentials for harm from the beginning of their creation process, rather than after they've already caused damage to those communities, Gebru told NBC News.