Goto

Collaborating Authors

 Support Vector Machines


EEG classifier cross-task transfer to avoid training sessions in robot-assisted rehabilitation

arXiv.org Artificial Intelligence

Background: For an individualized support of patients during rehabilitation, learning of individual machine learning models from the human electroencephalogram (EEG) is required. Our approach allows labeled training data to be recorded without the need for a specific training session. For this, the planned exoskeleton-assisted rehabilitation enables bilateral mirror therapy, in which movement intentions can be inferred from the activity of the unaffected arm. During this therapy, labeled EEG data can be collected to enable movement predictions of only the affected arm of a patient. Methods: A study was conducted with 8 healthy subjects and the performance of the classifier transfer approach was evaluated. Each subject performed 3 runs of 40 self-intended unilateral and bilateral reaching movements toward a target while EEG data was recorded from 64 channels. A support vector machine (SVM) classifier was trained under both movement conditions to make predictions for the same type of movement. Furthermore, the classifier was evaluated to predict unilateral movements by only beeing trained on the data of the bilateral movement condition. Results: The results show that the performance of the classifier trained on selected EEG channels evoked by bilateral movement intentions is not significantly reduced compared to a classifier trained directly on EEG data including unilateral movement intentions. Moreover, the results show that our approach also works with only 8 or even 4 channels. Conclusion: It was shown that the proposed classifier transfer approach enables motion prediction without explicit collection of training data. Since the approach can be applied even with a small number of EEG channels, this speaks for the feasibility of the approach in real therapy sessions with patients and motivates further investigations with stroke patients.


Feature Selection Based on Orthogonal Constraints and Polygon Area

arXiv.org Artificial Intelligence

In today's information age, the rapidly increasing scale and complexity of data pose unprecedented challenges to traditional data analysis and machine learning algorithms [1-4]. Feature selection, a crucial research area in data mining, aims to identify the optimal subset of features, reducing the dimensionality of high-dimensional datasets and thereby enhancing the performance of learning algorithms [5-7]. Feature selection methods are commonly categorized into three types: filter, wrapper, and embedded methods [8]. Filter methods evaluate features based on predefined rules or criteria without involving learning algorithms [9]. Examples include information gain (IG) [10], maximum relevance minimum redundancy (mRMR) [11], correlation coefficient (CC) [12], Fisher [13], conditional mutual information maximization criterion (CMIM) [14], and ReliefF [15]. Wrapper methods generate various feature subsets and use learning algorithms to evaluate them, aiming to find the globally optimal subset by maximizing or minimizing an objective function [16]. In recent years, embedded methods have gained widespread attention. Wu et al. [17] introduced a supervised feature selection method, Feature Selection with Orthogonal Regression (FSOR), employing Generalized Power Iteration (GPI) and the Augmented Lagrangian Multiplier method to solve the objective function and evaluate features. Nie et al. [18] developed a Robust Feature Selection (RFS) method that uses the 2


Data structure > labels? Unsupervised heuristics for SVM hyperparameter estimation

arXiv.org Artificial Intelligence

Classification is one of the main areas of pattern recognition research, and within it, Support Vector Machine (SVM) is one of the most popular methods outside of field of deep learning -- and a de-facto reference for many Machine Learning approaches. Its performance is determined by parameter selection, which is usually achieved by a time-consuming grid search cross-validation procedure (GSCV). That method, however relies on the availability and quality of labelled examples and thus, when those are limited can be hindered. To address that problem, there exist several unsupervised heuristics that take advantage of the characteristics of the dataset for selecting parameters instead of using class label information. While an order of magnitude faster, they are scarcely used under the assumption that their results are significantly worse than those of grid search. To challenge that assumption, we have proposed improved heuristics for SVM parameter selection and tested it against GSCV and state of the art heuristics on over 30 standard classification datasets. The results show not only its advantage over state-of-art heuristics but also that it is statistically no worse than GSCV.


Improved Indoor Localization with Machine Learning Techniques for IoT applications

arXiv.org Artificial Intelligence

The rise of the Internet of Things (IoT) and mobile internet applications has spurred interest in location-based services (LBS) for commercial, military, and social applications. While the global positioning system (GPS) dominates outdoor localization, its efficacy wanes indoors due to signal challenges. Indoor localization systems leverage wireless technologies like Wi-Fi, ZigBee, Bluetooth, UWB, selecting based on context. Received signal strength indicator (RSSI) technology, known for its accuracy and simplicity, is widely adopted. This study employs machine learning algorithms in three phases: supervised regressors, supervised classifiers, and ensemble methods for RSSI-based indoor localization. Additionally, it introduces a weighted least squares technique and pseudo-linear solution approach to address non-linear RSSI measurement equations by approximating them with linear equations. An experimental testbed, utilizing diverse wireless technologies and anchor nodes, is designed for data collection, employing IoT cloud architectures. Pre-processing involves investigating filters for data refinement before algorithm training. The study employs machine learning models like linear regression, polynomial regression, support vector regression, random forest regression, and decision tree regressor across various wireless technologies. These models estimate the geographical coordinates of a moving target node, and their performance is evaluated using metrics such as accuracy, root mean square errors, precision, recall, sensitivity, coefficient of determinant, and the f1-score. The experiment's outcomes provide insights into the effectiveness of different supervised machine learning techniques in terms of localization accuracy and robustness in indoor environments.


Learning Input Constrained Control Barrier Functions for Guaranteed Safety of Car-Like Robots

arXiv.org Artificial Intelligence

We propose a design method for a robust safety filter based on Input Constrained Control Barrier Functions (ICCBF) for car-like robots moving in complex environments. A robust ICCBF that can be efficiently implemented is obtained by learning a smooth function of the environment using Support Vector Machine regression. The method takes into account steering constraints and is validated in simulation and a real experiment.


A Machine Learning Ensemble Model for the Detection of Cyberbullying

arXiv.org Artificial Intelligence

The pervasive use of social media platforms, such as Facebook, Instagram, and X, has significantly amplified our electronic interconnectedness. Moreover, these platforms are now easily accessible from any location at any given time. However, the increased popularity of social media has also led to cyberbullying.It is imperative to address the need for finding, monitoring, and mitigating cyberbullying posts on social media platforms. Motivated by this necessity, we present this paper to contribute to developing an automated system for detecting binary labels of aggressive tweets.Our study has demonstrated remarkable performance compared to previous experiments on the same dataset. We employed the stacking ensemble machine learning method, utilizing four various feature extraction techniques to optimize performance within the stacking ensemble learning framework. Combining five machine learning algorithms,Decision Trees, Random Forest, Linear Support Vector Classification, Logistic Regression, and K-Nearest Neighbors into an ensemble method, we achieved superior results compared to traditional machine learning classifier models. The stacking classifier achieved a high accuracy rate of 94.00%, outperforming traditional machine learning models and surpassing the results of prior experiments that utilized the same dataset. NTRODUCTION Today, social networking sites play a significant role in our daily lives. We use social media for various communications, encompassing entertainment, education, personal development, and the workplace. The revolutionary nature of these platforms has made it much easier to connect with people across long distances [1]. Technological advancements have transformed the way we communicate, share information, and interact with communities globally [2].


Supplemental Materials A Consolidated Cross Validation Algorithm for Support Vector Machines via Data Reduction

Neural Information Processing Systems

C.2 Consolidated CV with random features Alternatively, one can use random features (Rahimi and Recht, 2007) to approximate the kernel matrix. Suppose that we consider shift-invariant kernels that satisfy K(x, y) = K(x y).


A Consolidated Cross-Validation Algorithm for Support Vector Machines via Data Reduction

Neural Information Processing Systems

We propose a consolidated cross-validation (CV) algorithm for training and tuning the support vector machines (SVM) on reproducing kernel Hilbert spaces. Our consolidated CV algorithm utilizes a recently proposed exact leave-one-out formula for the SVM and accelerates the SVM computation via a data reduction strategy. In addition, to compute the SVM with the bias term (intercept), which is not handled by the existing data reduction methods, we propose a novel two-stage consolidated CV algorithm. With numerical studies, we demonstrate that our algorithm is about an order of magnitude faster than the two mainstream SVM solvers, kernlab and LIBSVM, with almost the same accuracy.


1-norm Support Vector Machines

Neural Information Processing Systems

The standard 2-norm SVM is known for its good performance in two- In this paper, we consider the 1-norm SVM. We also propose an ef cient algorithm that computes the whole solution path of the 1-norm SVM, hence facilitates adaptive selection of the tuning parameter for the 1-norm SVM.


Margin Maximizing Loss Functions

Neural Information Processing Systems

Margin maximizing properties play an important role in the analysis of classi - cation models, such as boosting and support vector machines. Margin maximiza- tion is theoretically interesting because it facilitates generalization error analysis, and practically interesting because it presents a clear geometric interpretation of the models being built. We formulate and prove a suf cient condition for the solutions of regularized loss functions to converge to margin maximizing separa- tors, as the regularization vanishes. This condition covers the hinge loss of SVM, the exponential loss of AdaBoost and logistic regression loss. We also generalize it to multi-class classi cation problems, and present margin maximizing multi- class versions of logistic regression and support vector machines.