Goto

Collaborating Authors

 Statistical Learning


Development of Fake News Model using Machine Learning through Natural Language Processing

arXiv.org Artificial Intelligence

Fake news detection research is still in the early stage as this is a relatively new phenomenon in the interest raised by society. Machine learning helps to solve complex problems and to build AI systems nowadays and especially in those cases where we have tacit knowledge or the knowledge that is not known. We used machine learning algorithms and for identification of fake news; we applied three classifiers; Passive Aggressive, Na\"ive Bayes, and Support Vector Machine. Simple classification is not completely correct in fake news detection because classification methods are not specialized for fake news. With the integration of machine learning and text-based processing, we can detect fake news and build classifiers that can classify the news data. Text classification mainly focuses on extracting various features of text and after that incorporating those features into classification. The big challenge in this area is the lack of an efficient way to differentiate between fake and non-fake due to the unavailability of corpora. We applied three different machine learning classifiers on two publicly available datasets. Experimental analysis based on the existing dataset indicates a very encouraging and improved performance.


TourBERT: A pretrained language model for the tourism industry

arXiv.org Artificial Intelligence

Tourism is one of the most important economic sectors in the world (Hollenhorst The Bidirectional Encoder Representations et al., 2014), and its services have many from Transformers (BERT) is currently the characteristics that distinguish them from most important and state-of-the-art natural other products. Services are not tangible language model (Tenney et al., 2019) since and cannot be tested in advance, which is its launch in 2018 by Google. BERT Large, why the customer assumes an increased which is based on a Transformer risk before starting the trip. The service is architecture, is considered one of the most co-created together with the customer, so powerful language models with 24 layers, the customer is an active co-creator of the 16 attention heads, and 340 million service. Services are subject to the unoactu parameters (Lan et al. 2019). BERT is a principle, which means they are pretrained model and can be fine-tuned to produced at the same time as they are perform numerous downstream tasks such consumed, and they are considered as text classification, question answering, bilateral, i.e. a reciprocal relationship sentiment analysis, extractive between persons (Chehimi, 2014). In summarization, named entity recognition, addition, tourism services are relatively or sentence similarity (Egger, 2022). The expensive compared to everyday products model was pretrained on a huge English and have an intercultural dimension.


Statistical Learning for Individualized Asset Allocation

arXiv.org Machine Learning

We establish a high-dimensional statistical learning framework for individualized asset allocation. Our proposed methodology addresses continuous-action decision-making with a large number of characteristics. We develop a discretization approach to model the effect from continuous actions and allow the discretization level to be large and diverge with the number of observations. The value function of continuous-action is estimated using penalized regression with generalized penalties that are imposed on linear transformations of the model coefficients. We show that our estimators using generalized folded concave penalties enjoy desirable theoretical properties and allow for statistical inference of the optimal value associated with optimal decision-making. Empirically, the proposed framework is exercised with the Health and Retirement Study data in finding individualized optimal asset allocation. The results show that our individualized optimal strategy improves individual financial well-being and surpasses benchmark strategies.


Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimization

arXiv.org Machine Learning

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a time-efficient manner can be a challenging task due to intermittent connectivity of devices, heterogeneous connection quality, and non-i.i.d. data. In this paper, we provide a novel convergence analysis of non-convex loss functions using FL on both i.i.d. and non-i.i.d. datasets with arbitrary device selection probabilities for each round. Then, using the derived convergence bound, we use stochastic optimization to develop a new client selection and power allocation algorithm that minimizes a function of the convergence bound and the average communication time under a transmit power constraint. We find an analytical solution to the minimization problem. One key feature of the algorithm is that knowledge of the channel statistics is not required and only the instantaneous channel state information needs to be known. Using the FEMNIST and CIFAR-10 datasets, we show through simulations that the communication time can be significantly decreased using our algorithm, compared to uniformly random participation.


Deep Capsule Encoder-Decoder Network for Surrogate Modeling and Uncertainty Quantification

arXiv.org Machine Learning

The lack of complete knowledge about a system in mechanics or some randomness intrinsic to the system leads to emergence of uncertainty in numerical simulators. In order to ascertain the effect of such uncertainty on the output of a numerical simulators, it is essential that one looks towards the field of uncertainty quantification [1]. More precisely, it is only relevant the problem under consideration be reformulated into an uncertainty propagation (UP) problem. The most straightforward way to solve UP problem is via the usage of Monte Carlo (MC) method [2], which requires considerably large number of repeated evaluation of the solution of the problem at random input samples for getting convergent statistics. Now, of course, if we take into account the high computational cost of a single simulation run for complex multiscale and multiphysics systems, the situation becomes even more daunting and expensive for repeated evaluations. Furthermore, even the more advanced techniques such as Latin Hypercube Sampling [3] and Quasi MC-method [4] do not come to rescue and are often not apt for UP problems. Therefore, in such scenarios, the rational choice is to construct computationally efficient surrogate models (SM) which could then be queried instead of the original simulator using sampling methods such as the MC-method for completing UQ tasks. Further, some of the notable approaches for surrogate constructions in literature include polynomial chaos expansion [5, 6, 7], Gaussian processes [8, 9, 10, 11], variance decomposition analysis [12, 13] and its variants [14], support vector machines [15], and deep neural networks [16, 17, 18, 19, 20, 21].


Coupled Support Tensor Machine Classification for Multimodal Neuroimaging Data

arXiv.org Machine Learning

Multimodal data arise in various applications where information about the same phenomenon is acquired from multiple sensors and across different imaging modalities. Learning from multimodal data is of great interest in machine learning and statistics research as this offers the possibility of capturing complementary information among modalities. Multimodal modeling helps to explain the interdependence between heterogeneous data sources, discovers new insights that may not be available from a single modality, and improves decision-making. Recently, coupled matrix-tensor factorization has been introduced for multimodal data fusion to jointly estimate latent factors and identify complex interdependence among the latent factors. However, most of the prior work on coupled matrix-tensor factors focuses on unsupervised learning and there is little work on supervised learning using the jointly estimated latent factors. This paper considers the multimodal tensor data classification problem. A Coupled Support Tensor Machine (C-STM) built upon the latent factors jointly estimated from the Advanced Coupled Matrix Tensor Factorization (ACMTF) is proposed. C-STM combines individual and shared latent factors with multiple kernels and estimates a maximal-margin classifier for coupled matrix tensor data. The classification risk of C-STM is shown to converge to the optimal Bayes risk, making it a statistically consistent rule. C-STM is validated through simulation studies as well as a simultaneous EEG-fMRI analysis. The empirical evidence shows that C-STM can utilize information from multiple sources and provide a better classification performance than traditional single-mode classifiers.


RAMANMETRIX: a delightful way to analyze Raman spectra

arXiv.org Machine Learning

Although Raman spectroscopy is widely used for the investigation of biomedical samples and has a high potential for use in clinical applications, it is not common in clinical routines. One of the factors that obstruct the integration of Raman spectroscopic tools into clinical routines is the complexity of the data processing workflow. Software tools that simplify spectroscopic data handling may facilitate such integration by familiarizing clinical experts with the advantages of Raman spectroscopy. Here, RAMANMETRIX is introduced as a user-friendly software with an intuitive web-based graphical user interface (GUI) that incorporates a complete workflow for chemometric analysis of Raman spectra, from raw data pretreatment to a robust validation of machine learning models. The software can be used both for model training and for the application of the pretrained models onto new data sets. Users have full control of the parameters during model training, but the testing data flow is frozen and does not require additional user input. RAMANMETRIX is available in two versions: as standalone software and web application. Due to the modern software architecture, the computational backend part can be executed separately from the GUI and accessed through an application programming interface (API) for applying a preconstructed model to the measured data. This opens up possibilities for using the software as a data processing backend for the measurement devices in real-time. The models preconstructed by more experienced users can be exported and reused for easy one-click data preprocessing and prediction, which requires minimal interaction between the user and the software. The results of such prediction and graphical outputs of the different data processing steps can be exported and saved.


Cluster Analysis and Unsupervised Machine Learning in Python

#artificialintelligence

Created by Lazy Programmer Inc. English [Auto], Portuguese [Auto], Created by Lazy Programmer Inc. Cluster analysis is a staple of unsupervised machine learning and data science. It is very useful for data mining and big data because it automatically finds patterns in the data, without the need for labels, unlike supervised machine learning. In a real-world environment, you can imagine that a robot or an artificial intelligence won't always have access to the optimal answer, or maybe there isn't an optimal correct answer. You'd want that robot to be able to explore the world on its own, and learn things just by looking for patterns. Do you ever wonder how we get the data that we use in our supervised machine learning algorithms?


Machine Learning and 5G Are Crucial to Scale the Metaverse

#artificialintelligence

Machine learning and 5G can attract more people in the metaverse, blurring the lines between the virtual and real worlds. The concept of metaverse is closely related to advanced technologies such as artificial intelligence (AI), machine learning (ML), augmented reality (AR), virtual reality (VR), blockchain, 5G and the internet of things (IoT). Improved technology will allow avatars to use body language effectively and better convey human emotions producing a feeling of real communication in a virtual space. AR and VR won't be the only critical components of the metaverse, 5G and machine learning are also crucial. The metaverse is a future iteration of the internet, made up of 3D virtual spaces linked into a perceived virtual universe.


Statistical Learning -- Lasso

#artificialintelligence

In the statistical learning course, the instructors introduced Lasso regression, which is a linear regression method which performs shrinkage on the parameters of the linear model. LASSO (Least Absolute Shrinkage and Selection Operator) can be used to combat collinearity issues, overfitting and variable selection (facilitates interpretability).