In this chapter, we will give comprehensive examples of applying RL in optimizing the physical layer of wireless communications by defining different class of problems and the possible solutions to handle them. In Section 9.2, we present all the basic theory needed to address a RL problem, i.e. Markov decision process (MDP), Partially observable Markov decision process (POMDP), but also two very important and widely used algorithms for RL, i.e. the Q-learning and SARSA algorithms. We also introduce the deep reinforcement learning (DRL) paradigm and the section ends with an introduction to the multi-armed bandits (MAB) framework. Section 9.3 focuses on some toy examples to illustrate how the basic concepts of RL are employed in communication systems. We present applications extracted from literature with simplified system models using similar notation as in Section 9.2 of this Chapter. In Section 9.3, we also focus on modeling RL problems, i.e. how action and state spaces and rewards are chosen. The Chapter is concluded in Section 9.4 with a prospective thought on RL trends and it ends with a review of a broader state of the art in Section 9.5.

The Mobile Artificial Intelligence (MAI) Market Intelligence study is a collection of authentic information and in-depth analysis of data, taking into account market trends, growth prospects, emerging sectors, challenges, and drivers that can help investors and parties stakeholders to identify the most beneficial approaches for the contemporary. It provides essential information on current and projected market growth. It also focuses on technologies, volumes, materials, and markets along with an in-depth market analysis of the Mobile Artificial Intelligence (MAI) industry. The study contains a section devoted to profiling dominant companies while indicating their market shares. Subject matter experts consciously strive to analyze how some entrepreneurs manage to maintain a competitive advantage while others fail, which makes the research interesting.

Banks, telephone service companies, Internet service providers, pay TV companies, insurance firms, and alarm monitoring services, often use customer attrition analysis and customer attrition rates as one of their key business metrics (along with cash flow, EBITDA, etc.) because the cost of retaining an existing customer is far less than acquiring a new one (Wikipedia). According to this article, the probability of selling to a new customer is 60-70%, while the probability of selling to a new prospect is 5-20%. So knowing if a customer is at risk of leaving is one of the most important tasks a company has to perform in order to keep growing its business. The data can be found here on kaggle public datasets. We will predict if a customer will churn based on his informations. There are 7043 customers and 20 features.

It seems that I am building a voice recognition system, but under the hood it's actually a chat bot. The voice part is just a chat interface because we need to covert the voice to text, then we write our algorithm to find the proper data and formulate to native response, and covert text to speech again. A chatbot is a program that communicate with you. The term "chatterbot" came in existence in 1994 when Michael Mauldin created his first chatbot named "Julia". It can be looked upon as a virtual assistant that communicates with users via text messages and helps businesses in getting close to their customers. It is a program designed to imitate the way humans communicate with each other.

Networks describe the, often complex, relationships between individual actors. In this work, we address the question of how to determine whether a parametric model, such as a stochastic block model or latent space model, fits a dataset well and will extrapolate to similar data. We use recent results in random matrix theory to derive a general goodness-of-fit test for dyadic data. We show that our method, when applied to a specific model of interest, provides an straightforward, computationally fast way of selecting parameters in a number of commonly used network models. For example, we show how to select the dimension of the latent space in latent space models. Unlike other network goodness-of-fit methods, our general approach does not require simulating from a candidate parametric model, which can be cumbersome with large graphs, and eliminates the need to choose a particular set of statistics on the graph for comparison. It also allows us to perform goodness-of-fit tests on partial network data, such as Aggregated Relational Data. We show with simulations that our method performs well in many situations of interest. We analyze several empirically relevant networks and show that our method leads to improved community detection algorithms. R code to implement our method is available on Github.

Network Traffic Classification (NTC) has become an important component in a wide variety of network management operations, e.g., Quality of Service (QoS) provisioning and security purposes. Machine Learning (ML) algorithms as a common approach for NTC methods can achieve reasonable accuracy and handle encrypted traffic. However, ML-based NTC techniques suffer from the shortage of labeled traffic data which is the case in many real-world applications. This study investigates the applicability of an active form of ML, called Active Learning (AL), which reduces the need for a high number of labeled examples by actively choosing the instances that should be labeled. The study first provides an overview of NTC and its fundamental challenges along with surveying the literature in the field of using ML techniques in NTC. Then, it introduces the concepts of AL, discusses it in the context of NTC, and review the literature in this field. Further, challenges and open issues in the use of AL for NTC are discussed. Additionally, as a technical survey, some experiments are conducted to show the broad applicability of AL in NTC. The simulation results show that AL can achieve high accuracy with a small amount of data.

Fine-grained location prediction on smart phones can be used to improve app/system performance. Application scenarios include video quality adaptation as a function of the 5G network quality at predicted user locations, and augmented reality apps that speed up content rendering based on predicted user locations. Such use cases require prediction error in the same range as the GPS error, and no existing works on location prediction can achieve this level of accuracy. We present a system for fine-grained location prediction (FGLP) of mobile users, based on GPS traces collected on the phones. FGLP has two components: a federated learning framework and a prediction model. The framework runs on the phones of the users and also on a server that coordinates learning from all users in the system. FGLP represents the user location data as relative points in an abstract 2D space, which enables learning across different physical spaces. The model merges Bidirectional Long Short-Term Memory (BiLSTM) and Convolutional Neural Networks (CNN), where BiLSTM learns the speed and direction of the mobile users, and CNN learns information such as user movement preferences. FGLP uses federated learning to protect user privacy and reduce bandwidth consumption. Our experimental results, using a dataset with over 600,000 users, demonstrate that FGLP outperforms baseline models in terms of prediction accuracy. We also demonstrate that FGLP works well in conjunction with transfer learning, which enables model reusability. Finally, benchmark results on several types of Android phones demonstrate FGLP's feasibility in real life.

Vivaldi has released a major update for its eponymous web browser for privacy-minded power users. Version 4.0 bring with it a translation tool, along with beta versions of Vivaldi Mail, Calendar, and Feed Reader. The update is available now on Windows, Mac and Linux and Android devices. Vivaldi built its translation feature into its browser. The tool is powered by Lingvanex, a Cyprus-based company that makes translator's for a wider range of platforms including voice calls and smartwatches. As part of its focus on privacy, Vivaldi says that all your translation activity will be kept away from third-parties on its servers in Iceland.

Unmanned aerial vehicles (UAVs) are now beginning to be deployed for enhancing the network performance and coverage in wireless communication. However, due to the limitation of their on-board power and flight time, it is challenging to obtain an optimal resource allocation scheme for the UAV-assisted Internet of Things (IoT). In this paper, we design a new UAV-assisted IoT systems relying on the shortest flight path of the UAVs while maximising the amount of data collected from IoT devices. Then, a deep reinforcement learning-based technique is conceived for finding the optimal trajectory and throughput in a specific coverage area. After training, the UAV has the ability to autonomously collect all the data from user nodes at a significant total sum-rate improvement while minimising the associated resources used. Numerical results are provided to highlight how our techniques strike a balance between the throughput attained, trajectory, and the time spent. More explicitly, we characterise the attainable performance in terms of the UAV trajectory, the expected reward and the total sum-rate.

HUAWEI CLOUD's Enterprise Intelligence (EI) has achieved strong results in numerous industry competitions and evaluations. HUAWEI CLOUD has invested heavily in basic research AI in three domains: computer vision, speech and semantics, and decision optimization. To help AI empower all industries, the ModelArts enabling platform supports plug-and-play deployment of HUAWEI CLOUD's research results in areas such as automatic machine learning, small sample learning, federated learning, and pre-training models. In the area of perception, HUAWEI CLOUD continues to be an industry-leader in ImageNet large-scale image classification, WebVision large-scale network image classification, MS-COCO two-dimensional object detection, nuScenes three-dimensional object detection, and visual pre-training model verification, including downstream classification, detection, and segmentation. Perception models driven by ModelArts have been widely used in sectors such as medical image analysis, oil and gas exploration, and fault detection in manufacturing. In cognition, HUAWEI CLOUD integrates industry data based on its expertise in semantic analysis and knowledge graphs.