Overview
Graph Representation Learning for Popularity Prediction Problem: A Survey
Chen, Tiantian, Guo, Jianxiong, Wu, Weili
The online social platforms, like Twitter, Facebook, LinkedIn and WeChat, have grown really fast in last decade and have been one of the most effective platforms for people to communicate and share information with each other. Due to the "word of mouth" effects, information usually can spread rapidly on these social media platforms. Therefore, it is important to study the mechanisms driving the information diffusion and quantify the consequence of information spread. A lot of efforts have been focused on this problem to help us better understand and achieve higher performance in viral marketing and advertising. On the other hand, the development of neural networks has blossomed in the last few years, leading to a large number of graph representation learning (GRL) models. Compared to traditional models, GRL methods are often shown to be more effective. In this paper, we present a comprehensive review for existing works using GRL methods for popularity prediction problem, and categorize related literatures into two big classes, according to their mainly used model and techniques: embedding-based methods and deep learning methods. Deep learning method is further classified into six small classes: convolutional neural networks, graph convolutional networks, graph attention networks, graph neural networks, recurrent neural networks, and reinforcement learning. We compare the performance of these different models and discuss their strengths and limitations. Finally, we outline the challenges and future chances for popularity prediction problem.
Is Neuro-Symbolic AI Meeting its Promise in Natural Language Processing? A Structured Review
Hamilton, Kyle, Nayak, Aparna, Božić, Bojan, Longo, Luca
Advocates for Neuro-Symbolic Artificial Intelligence (NeSy) assert that combining deep learning with symbolic reasoning will lead to stronger AI than either paradigm on its own. As successful as deep learning has been, it is generally accepted that even our best deep learning systems are not very good at abstract reasoning. And since reasoning is inextricably linked to language, it makes intuitive sense that Natural Language Processing (NLP), would be a particularly well-suited candidate for NeSy. We conduct a structured review of studies implementing NeSy for NLP, with the aim of answering the question of whether NeSy is indeed meeting its promises: reasoning, out-of-distribution generalization, interpretability, learning and reasoning from small data, and transferability to new domains. We examine the impact of knowledge representation, such as rules and semantic networks, language structure and relational structure, and whether implicit or explicit reasoning contributes to higher promise scores. We find that systems where logic is compiled into the neural network lead to the most NeSy goals being satisfied, while other factors such as knowledge representation, or type of neural architecture do not exhibit a clear correlation with goals being met. We find many discrepancies in how reasoning is defined, specifically in relation to human level reasoning, which impact decisions about model architectures and drive conclusions which are not always consistent across studies. Hence we advocate for a more methodical approach to the application of theories of human reasoning as well as the development of appropriate benchmarks, which we hope can lead to a better understanding of progress in the field. We make our data and code available on github for further analysis.
ROBOTICS AND ARTIFICIAL INTELLIGENCE IN DEFENCE SECTOR
Robotics and Artificial Intelligence till now have been used mainly for commercial work and yet to dominate defence sector in India. There is a huge potential in this segment and newly formed Task-Force on Artificial Intelligence by Indian government is a step towards economic transformation. Robotics and Artificial Intelligence (AI) is combination of technology and cognitive intelligence for simulation, processing of information and knowledge to build capability in a machine to imitate human behaviour. It is a transformative technology that has tremendous applications in the social, economic and military fields. Till some time back we had robots operated by a human or through a set of programming to perform repetitive task.
Yann LeCun has a bold new vision for the future of AI
Around a year and a half ago, Yann LeCun realized he had it wrong. LeCun, who is chief scientist at Meta's AI lab and one of the most influential AI researchers in the world, had been trying to give machines a basic grasp of how the world works--a kind of common sense--by training neural networks to predict what was going to happen next in video clips of everyday events. But guessing future frames of a video pixel by pixel was just too complex. Now, after months figuring out what was missing, he has a bold new vision for the next generation of AI. In a draft document shared with MIT Technology Review, LeCun sketches out an approach that he thinks will one day give machines the common sense they need to navigate the world.
Deep Neural Networks and Tabular Data: A Survey
Borisov, Vadim, Leemann, Tobias, Seßler, Kathrin, Haug, Johannes, Pawelczyk, Martin, Kasneci, Gjergji
Heterogeneous tabular data are the most commonly used form of data and are essential for numerous critical and computationally demanding applications. On homogeneous data sets, deep neural networks have repeatedly shown excellent performance and have therefore been widely adopted. However, their adaptation to tabular data for inference or data generation tasks remains challenging. To facilitate further progress in the field, this work provides an overview of state-of-the-art deep learning methods for tabular data. We categorize these methods into three groups: data transformations, specialized architectures, and regularization models. For each of these groups, our work offers a comprehensive overview of the main approaches. Moreover, we discuss deep learning approaches for generating tabular data, and we also provide an overview over strategies for explaining deep models on tabular data. Thus, our first contribution is to address the main research streams and existing methodologies in the mentioned areas, while highlighting relevant challenges and open research questions. Our second contribution is to provide an empirical comparison of traditional machine learning methods with eleven deep learning approaches across five popular real-world tabular data sets of different sizes and with different learning objectives. Our results, which we have made publicly available as competitive benchmarks, indicate that algorithms based on gradient-boosted tree ensembles still mostly outperform deep learning models on supervised learning tasks, suggesting that the research progress on competitive deep learning models for tabular data is stagnating. To the best of our knowledge, this is the first in-depth overview of deep learning approaches for tabular data; as such, this work can serve as a valuable starting point to guide researchers and practitioners interested in deep learning with tabular data.
Yann LeCun's Bold New Vision for the Future of AI
"This idea that we're going to just scale up the current large language models and eventually human-level AI will emerge--I don't believe this at all, not for one second." Yann LeCun, chief scientist at Meta's artificial intelligence (AI) lab and one of the world's most influential AI researchers, has a bold new vision for the next generation of AI. In a draft document shared with MIT Technology Review, LeCun sketches out an approach that he thinks will one day give machines the common sense they need to navigate the world. "Getting machines to behave like humans and animals has been the quest of my life," he says. LeCun thinks that animal brains run a kind of simulation of the world, which he calls a world model.
Overview of Some Deep Learning Libraries
Machine learning is a broad topic. Deep learning, in particular, is a way of using neural networks for machine learning. Neural network is probably a concept older than machine learning, dated back to 1950s. Unsurprisingly, there were many libraries created for it. In the following, we will give an overview of some of the famous libraries for neural network and deep learning.
AI
This special issue highlights the applications, practices and theory of artificial intelligence in the domain of cyber security. In the past few decades there has been an exponential rise in the application of artificial intelligence technologies (such as deep learning, machine learning, block-chain, and virtualization etc.) for solving complex and intricate problems arising in the domain of cyber security. The versatility of these techniques have made them a favorite among scientists and researchers working in diverse areas. The primary objective of this topical collection is to bring forward thorough, in-depth, and well-focused developments of artificial intelligence technologies and their applications in cyber security domain, to propose new approaches, and to present applications of innovative approaches in real facilities. AI can be both a blessing and a curse for cybersecurity.
Explaining Any ML Model? -- On Goals and Capabilities of XAI
Renftle, Moritz, Trittenbach, Holger, Poznic, Michael, Heil, Reinhard
An increasing ubiquity of machine learning (ML) motivates research on algorithms to explain ML models and their predictions -- so-called eXplainable Artificial Intelligence (XAI). Despite many survey papers and discussions, the goals and capabilities of XAI algorithms are far from being well understood. We argue that this is because of a problematic reasoning scheme in XAI literature: XAI algorithms are said to complement ML models with desired properties, such as "interpretability", or "explainability". These properties are in turn assumed to contribute to a goal, like "trust" in an ML system. But most properties lack precise definitions and their relationship to such goals is far from obvious. The result is a reasoning scheme that obfuscates research results and leaves an important question unanswered: What can one expect from XAI algorithms? In this article, we clarify the goals and capabilities of XAI algorithms from a concrete perspective: that of their users. Explaining ML models is only necessary if users have questions about them. We show that users can ask diverse questions, but that only one of them can be answered by current XAI algorithms. Answering this core question can be trivial, difficult or even impossible, depending on the ML application. Based on these insights, we outline which capabilities policymakers, researchers and society can reasonably expect from XAI algorithms.
Impact of Imputation Strategies on Fairness in Machine Learning
Caton, Simon (School of Computer Science, University College Dublin) | Malisetty, Saiteja (University of Nebraska at Omaha) | Haas, Christian (Department of Strategy and Innovation, Vienna University of Economics and Business (WU))
Research on Fairness and Bias Mitigation in Machine Learning often uses a set of reference datasets for the design and evaluation of novel approaches or definitions. While these datasets are well structured and useful for the comparison of various approaches, they do not reflect that datasets commonly used in real-world applications can have missing values. When such missing values are encountered, the use of imputation strategies is commonplace. However, as imputation strategies potentially alter the distribution of data they can also affect the performance, and potentially the fairness, of the resulting predictions, a topic not yet well understood in the fairness literature. In this article, we investigate the impact of different imputation strategies on classical performance and fairness in classification settings. We find that the selected imputation strategy, along with other factors including the type of classification algorithm, can significantly affect performance and fairness outcomes. The results of our experiments indicate that the choice of imputation strategy is an important factor when considering fairness in Machine Learning. We also provide some insights and guidance for researchers to help navigate imputation approaches for fairness.