Goto

Collaborating Authors

 Overview


Reducing Computational Complexity of Neural Networks in Optical Channel Equalization: From Concepts to Implementation

arXiv.org Artificial Intelligence

In this paper, a new methodology is proposed that allows for the low-complexity development of neural network (NN) based equalizers for the mitigation of impairments in high-speed coherent optical transmission systems. In this work, we provide a comprehensive description and comparison of various deep model compression approaches that have been applied to feed-forward and recurrent NN designs. Additionally, we evaluate the influence these strategies have on the performance of each NN equalizer. Quantization, weight clustering, pruning, and other cutting-edge strategies for model compression are taken into consideration. In this work, we propose and evaluate a Bayesian optimization-assisted compression, in which the hyperparameters of the compression are chosen to simultaneously reduce complexity and improve performance. In conclusion, the trade-off between the complexity of each compression approach and its performance is evaluated by utilizing both simulated and experimental data in order to complete the analysis. By utilizing optimal compression approaches, we show that it is possible to design an NN-based equalizer that is simpler to implement and has better performance than the conventional digital back-propagation (DBP) equalizer with only one step per span. This is accomplished by reducing the number of multipliers used in the NN equalizer after applying the weighted clustering and pruning algorithms. Furthermore, we demonstrate that an equalizer based on NN can also achieve superior performance while still maintaining the same degree of complexity as the full electronic chromatic dispersion compensation block. We conclude our analysis by highlighting open questions and existing challenges, as well as possible future research directions.


A Review of Causality for Learning Algorithms in Medical Image Analysis

arXiv.org Artificial Intelligence

Medical image analysis is a vibrant research area that offers doctors and medical practitioners invaluable insight and the ability to accurately diagnose and monitor disease. Machine learning provides an additional boost for this area. However, machine learning for medical image analysis is particularly vulnerable to natural biases like domain shifts that affect algorithmic performance and robustness. In this paper we analyze machine learning for medical image analysis within the framework of Technology Readiness Levels and review how causal analysis methods can fill a gap when creating robust and adaptable medical image analysis algorithms. We review methods using causality in medical imaging AI/ML and find that causal analysis has the potential to mitigate critical problems for clinical translation but that uptake and clinical downstream research has been limited so far.


A Survey of Text Representation Methods and Their Genealogy

arXiv.org Artificial Intelligence

It has become possible to distill complex linguistic information of text into multidimensional dense numeric vectors with the use of the distributional hypothesis. As a consequence, text representation methods have been evolving at such a quick pace that the research community is struggling to retain knowledge of the methods and their interrelations. We contribute threefold to this lack of compilation, composition, and systematization by providing a survey of current approaches, by arranging them in a genealogy, and by conceptualizing a taxonomy of text representation methods to examine and explain the state-of-the-art. Our research is a valuable guide and reference for artificial intelligence researchers and practitioners interested in natural language processing applications such as recommender systems, chatbots, and sentiment analysis.


Sketch2FullStack: Generating Skeleton Code of Full Stack Website and Application from Sketch using Deep Learning and Computer Vision

arXiv.org Artificial Intelligence

For a full-stack web or app development, it requires a software firm or more specifically a team of experienced developers to contribute a large portion of their time and resources to design the website and then convert it to code. As a result, the efficiency of the development team is significantly reduced when it comes to converting UI wireframes and database schemas into an actual working system. It would save valuable resources and fasten the overall workflow if the clients or developers can automate this process of converting the pre-made full-stack website design to get a partially working if not fully working code. In this paper, we present a novel approach of generating the skeleton code from sketched images using Deep Learning and Computer Vision approaches. The dataset for training are first-hand sketched images of low fidelity wireframes, database schemas and class diagrams. The approach consists of three parts. First, the front-end or UI elements detection and extraction from custom-made UI wireframes. Second, individual database table creation from schema designs and lastly, creating a class file from class diagrams.


Deep Fake Detection, Deterrence and Response: Challenges and Opportunities

arXiv.org Artificial Intelligence

Afterward, we offer a solution that is capable of 1) making our AI systems robust against deepfakes during development and deployment phases; 2) detecting video, image, audio, and textual deepfakes; 3) identifying deepfakes that bypass detection (deepfake hunting); 4) leveraging available intelligence for timely identification of deepfake campaigns launched by state-sponsored hacking teams; 5) conducting in-depth forensic analysis of identified deepfake payloads. Our proposed solution can be used as a technical guide for developing detection, deterrence, and forensics investigation solutions for deepfakes. Our solution would address important elements of Canada's National Cyber Security Action Plan (2019-2024) in increasing the trustworthiness of our critical services [5]. Following actions can be taken based on this research findings: Raising public awareness about risks of deepfakes: increasing the understanding of deepfake threats and empowering Canadian public to do their part in keeping our society and critical services safe from deepfake-based attacks is the most important and effective step in reducing risk of deepfakes. Cybersecurity should always be considered as a shared responsibility. While this paper is focused on development of technical solutions for early detection and deterrence of deepfakes, the effectiveness of our solutions (or any technical solution in cybersecurity) are limited without regular and systemic public awareness campaigns. Supporting development of public training programs in this domain should be considered as a top priority. Developing AI robustness monitoring solutions: there is a growing trend in using AI to detect deepfakes. However, more recently, adversaries made attempts to create adversarial deepfake payloads that are capable of deceiving humans while bypassing AI-based detection systems!


Unsupervised Representation Learning in Deep Reinforcement Learning: A Review

arXiv.org Artificial Intelligence

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many dynamical systems can be effectively described by a low-dimensional set of state variables. Discovering these state variables from the data is a crucial aspect for improving the data efficiency, robustness and generalization of DRL methods, tackling the \textit{curse of dimensionality}, and bringing interpretability and insights into black-box DRL. This review provides a comprehensive and complete overview of unsupervised representation learning in DRL by describing the main Deep Learning tools used for learning representations of the world, providing a systematic view of the method and principles, summarizing applications, benchmarks and evaluation strategies, and discussing open challenges and future directions.


RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN

arXiv.org Artificial Intelligence

Radio access network (RAN) technologies continue to evolve, with Open RAN gaining the most recent momentum. In the O-RAN specifications, the RAN intelligent controllers (RICs) are software-defined orchestration and automation functions for the intelligent management of RAN. This article introduces principles for machine learning (ML), in particular, reinforcement learning (RL) applications in the O-RAN stack. Furthermore, we review the state-of-the-art research in wireless networks and cast it onto the RAN framework and the hierarchy of the O-RAN architecture. We provide a taxonomy for the challenges faced by ML/RL models throughout the development life-cycle: from the system specification to production deployment (data acquisition, model design, testing and management, etc.). To address the challenges, we integrate a set of existing MLOps principles with unique characteristics when RL agents are considered. This paper discusses a systematic model development, testing and validation life-cycle, termed: RLOps. We discuss fundamental parts of RLOps, which include: model specification, development, production environment serving, operations monitoring and safety/security. Based on these principles, we propose the best practices for RLOps to achieve an automated and reproducible model development process. At last, a holistic data analytics platform rooted in the O-RAN deployment is designed and implemented, aiming to embrace and fulfil the aforementioned principles and best practices of RLOps.


Learning Visual Planning Models from Partially Observed Images

arXiv.org Artificial Intelligence

There has been increasing attention on planning model learning in classical planning. Most existing approaches, however, focus on learning planning models from structured data in symbolic representations. It is often difficult to obtain such structured data in real-world scenarios. Although a number of approaches have been developed for learning planning models from fully observed unstructured data (e.g., images), in many scenarios raw observations are often incomplete. In this paper, we provide a novel framework, \aType{Recplan}, for learning a transition model from partially observed raw image traces. More specifically, by considering the preceding and subsequent images in a trace, we learn the latent state representations of raw observations and then build a transition model based on such representations. Additionally, we propose a neural-network-based approach to learn a heuristic model that estimates the distance toward a given goal observation. Based on the learned transition model and heuristic model, we implement a classical planner for images. We exhibit empirically that our approach is more effective than a state-of-the-art approach of learning visual planning models in the environment with incomplete observations.


A Critical Review of Traffic Signal Control and A Novel Unified View of Reinforcement Learning and Model Predictive Control Approaches for Adaptive Traffic Signal Control

arXiv.org Artificial Intelligence

Recent years have witnessed substantial growth in adaptive traffic signal control (ATSC) methodologies that improve transportation network efficiency, especially in branches leveraging artificial intelligence based optimization and control algorithms such as reinforcement learning as well as conventional model predictive control. However, lack of cross-domain analysis and comparison of the effectiveness of applied methods in ATSC research limits our understanding of existing challenges and research directions. This chapter proposes a novel unified view of modern ATSCs to identify common ground as well as differences and shortcomings of existing methodologies with the ultimate goal to facilitate cross-fertilization and advance the state-of-the-art. The unified view applies the mathematical language of the Markov decision process, describes the process of controller design from both the world (problem) and solution modeling perspectives. The unified view also analyses systematic issues commonly ignored in existing studies and suggests future potential directions to resolve these issues.


Testing the effectiveness of saliency-based explainability in NLP using randomized survey-based experiments

arXiv.org Artificial Intelligence

It is only becoming more vital as in sensitive areas like Political Profiling, Review of Essays in AI gains foothold in making critical - and in some cases, Education, etc. proliferate, there is a great need for increasing fatal - decisions in sensitive areas like Healthcare, Finance, transparency in NLP models to build trust with stakeholders Automated Driving, and such-like [8] [9] [10]. The true potential and identify biases. A lot of work in Explainable AI has aimed to devise explanation methods that give humans insights into of these recent advancements in AI can only be realised the workings and predictions of NLP models. While these if the various stakeholders manage to discern the working of methods distill predictions from complex models like Neural AI models and how their predictions are produced, as that is Networks into consumable explanations, how humans understand necessary to incorporate trust. For example, 83% of people these explanations is still widely unexplored. Innate do not understand automated decision-making systems in the human tendencies and biases can handicap the understanding of these explanations in humans, and can also lead to them criminal justice system, and subsequently, 60% oppose its use misjudging models and predictions as a result. We designed in the domain [11]. But besides securing the buy-in of endusers a randomized survey-based experiment to understand the effectiveness and developers through building trust, AI explainability of saliency-based Post-hoc explainability methods also has the potential of identifying AI inaccuracies prior in Natural Language Processing.