dynamic threshold
Biologically Inspired Dynamic Thresholds for Spiking Neural Networks
The dynamic membrane potential threshold, as one of the essential properties of a biological neuron, is a spontaneous regulation mechanism that maintains neuronal homeostasis, i.e., the constant overall spiking firing rate of a neuron. As such, the neuron firing rate is regulated by a dynamic spiking threshold, which has been extensively studied in biology. Existing work in the machine learning community does not employ bioinspired spiking threshold schemes. This work aims at bridging this gap by introducing a novel bioinspired dynamic energy-temporal threshold (BDETT) scheme for spiking neural networks (SNNs). The proposed BDETT scheme mirrors two bioplausible observations: a dynamic threshold has 1) a positive correlation with the average membrane potential and 2) a negative correlation with the preceding rate of depolarization. We validate the effectiveness of the proposed BDETT on robot obstacle avoidance and continuous control tasks under both normal conditions and various degraded conditions, including noisy observations, weights, and dynamic environments. We find that the BDETT outperforms existing static and heuristic threshold approaches by significant margins in all tested conditions, and we confirm that the proposed bioinspired dynamic threshold scheme offers homeostasis to SNNs in complex real-world tasks.
Multi-Source Temporal Attention Network for Precipitation Nowcasting
Sarabia, Rafael Pablos, Nyborg, Joachim, Birk, Morten, Sjørup, Jeppe Liborius, Vesterholt, Anders Lillevang, Assent, Ira
Precipitation nowcasting is crucial across various industries and plays a significant role in mitigating and adapting to climate change. We introduce an efficient deep learning model for precipitation nowcasting, capable of predicting rainfall up to 8 hours in advance with greater accuracy than existing operational physics-based and extrapolation-based models. Our model leverages multi-source meteorological data and physics-based forecasts to deliver high-resolution predictions in both time and space. It captures complex spatio-temporal dynamics through temporal attention networks and is optimized using data quality maps and dynamic thresholds. Experiments demonstrate that our model outperforms state-of-the-art, and highlight its potential for fast reliable responses to evolving weather conditions.
- North America > United States > Massachusetts > Suffolk County > Boston (0.05)
- Europe > Denmark > Capital Region > Copenhagen (0.04)
Biologically Inspired Dynamic Thresholds for Spiking Neural Networks
The dynamic membrane potential threshold, as one of the essential properties of a biological neuron, is a spontaneous regulation mechanism that maintains neuronal homeostasis, i.e., the constant overall spiking firing rate of a neuron. As such, the neuron firing rate is regulated by a dynamic spiking threshold, which has been extensively studied in biology. Existing work in the machine learning community does not employ bioinspired spiking threshold schemes. This work aims at bridging this gap by introducing a novel bioinspired dynamic energy-temporal threshold (BDETT) scheme for spiking neural networks (SNNs). The proposed BDETT scheme mirrors two bioplausible observations: a dynamic threshold has 1) a positive correlation with the average membrane potential and 2) a negative correlation with the preceding rate of depolarization.
Horizon-wise Learning Paradigm Promotes Gene Splicing Identification
Li, Qi-Jie, Sun, Qian, Zhang, Shao-Qun
Identifying gene splicing is a core and significant task confronted in modern collaboration between artificial intelligence and bioinformatics. Past decades have witnessed great efforts on this concern, such as the bio-plausible splicing pattern AT-CG and the famous SpliceAI. In this paper, we propose a novel framework for the task of gene splicing identification, named Horizon-wise Gene Splicing Identification (H-GSI). The proposed H-GSI follows the horizon-wise identification paradigm and comprises four components: the pre-processing procedure transforming string data into tensors, the sliding window technique handling long sequences, the SeqLab model, and the predictor. In contrast to existing studies that process gene information with a truncated fixed-length sequence, H-GSI employs a horizon-wise identification paradigm in which all positions in a sequence are predicted with only one forward computation, improving accuracy and efficiency. The experiments conducted on the real-world Human dataset show that our proposed H-GSI outperforms SpliceAI and achieves the best accuracy of 97.20\%. The source code is available from this link.
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Undirected Networks > Markov Models (0.46)
A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering System
Abstract--Building operations consume 30% of total power consumption and contribute 26% of global power-related emissions. Therefore, monitoring, and early detection of anomalies at the meter level are essential for residential and commercial buildings. This work investigates both supervised and unsupervised approaches and introduces a dynamic anomaly detection system. The system introduces a supervised Light Gradient Boosting machine and an unsupervised autoencoder with a dynamic threshold. This system is designed to provide realtime detection of anomalies at the meter level. The proposed dynamical system comes with a dynamic threshold based on the Mahalanobis distance and moving averages. This approach allows the system to adapt to changes in the data distribution over time. The effectiveness of the proposed system is evaluated using real-life power consumption data collected from smart metering systems. This empirical testing ensures that the system's performance is validated under real-world conditions. By detecting unusual data movements and providing early warnings, the proposed system contributes significantly to visual analytics and decision science. Early detection of anomalies enables timely troubleshooting, preventing financial losses and potential disasters such as fire incidents. Global power consumption is increasing at an alarming rate, and buildings (residential and commercial) account for approximately 40-45% of global power consumption ([1]; [2]; [3]; [4]; [5]). "The operations of buildings account for 30% of global power consumption and 26% of global powerrelated emissions (8% being direct emissions in buildings and 18% indirect emissions from the production of electricity and heat used in buildings)." In addition, because of the pervasive misuse of residential power consumption behaviors, it is estimated that 15-30% of the power utilized during building operations is lost owing to malfunctioning equipment, poor operation protocols, and poor construction design ([6]; [3]).
- North America > United States > California > San Diego County > San Diego (0.04)
- Europe > Switzerland > Basel-City > Basel (0.04)
- Europe > Sweden (0.04)
- (2 more...)
- Energy > Power Industry (0.94)
- Construction & Engineering (0.66)
A Real-time Anomaly Detection Using Convolutional Autoencoder with Dynamic Threshold
Maitra, Sarit, Kundu, Sukanya, Shankar, Aishwarya
The majority of modern consumer-level energy is generated by real-time smart metering systems. These frequently contain anomalies, which prevent reliable estimates of the series' evolution. This work introduces a hybrid modeling approach combining statistics and a Convolutional Autoencoder with a dynamic threshold. The threshold is determined based on Mahalanobis distance and moving averages. It has been tested using real-life energy consumption data collected from smart metering systems. The solution includes a real-time, meter-level anomaly detection system that connects to an advanced monitoring system. This makes a substantial contribution by detecting unusual data movements and delivering an early warning. Early detection and subsequent troubleshooting can financially benefit organizations and consumers and prevent disasters from occurring.
- Asia > India > Karnataka > Bengaluru (0.05)
- North America > United States (0.04)
- Europe > Switzerland > Basel-City > Basel (0.04)
- (2 more...)
Machine Learning Trading Essentials (Part 1): Financial Data Structures - Hudson & Thames
Trading in financial markets can be a challenging and complex endeavour, with ever-changing conditions and numerous factors to consider. With markets becoming increasingly competitive all the time, it is a never ending struggle to stay ahead of the curve. Machine learning (ML) has made several advances in recent years, particularly by becoming more accessible. One might think then why not use ML models in markets to challenge more traditional ways of trading? Well the answer is, unfortunately, that it is not so simple.
Collision detection and identification for a legged manipulator
van Dam, Jessie, Tulbure, Andreea, Minniti, Maria Vittoria, Abi-Farraj, Firas, Hutter, Marco
Abstract-- To safely deploy legged robots in the real world it is necessary to provide them with the ability to reliably detect unexpected contacts and accurately estimate the corresponding contact force. In this paper, we propose a collision detection and identification pipeline for a quadrupedal manipulator. We first introduce an approach to estimate the collision time span based on band-pass filtering and show that this information is key for obtaining accurate collision force estimates. We then improve the accuracy of the identified force magnitude by compensating for model inaccuracies, unmodeled loads, and any other potential source of quasi-static disturbances acting on the robot. Quadrupedal robots have recently become sufficiently advanced to be deployed in unknown and unstructured environments, where they could operate alongside humans or phase (e.g., detecting a collision when there is none) or other robots.
- Europe > Switzerland > Zürich > Zürich (0.04)
- Africa > Central African Republic > Ombella-M'Poko > Bimbo (0.04)
Dash: Semi-Supervised Learning with Dynamic Thresholding
Xu, Yi, Shang, Lei, Ye, Jinxing, Qian, Qi, Li, Yu-Feng, Sun, Baigui, Li, Hao, Jin, Rong
While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a fixed high-confidence prediction during the training progress. However, it is possible that too many correct/wrong pseudo labeled examples are eliminated/selected. In this work we develop a simple yet powerful framework, whose key idea is to select a subset of training examples from the unlabeled data when performing existing SSL methods so that only the unlabeled examples with pseudo labels related to the labeled data will be used to train models. The selection is performed at each updating iteration by only keeping the examples whose losses are smaller than a given threshold that is dynamically adjusted through the iteration. Our proposed approach, Dash, enjoys its adaptivity in terms of unlabeled data selection and its theoretical guarantee. Specifically, we theoretically establish the convergence rate of Dash from the view of non-convex optimization. Finally, we empirically demonstrate the effectiveness of the proposed method in comparison with state-of-the-art over benchmarks.
- North America > United States > Wisconsin > Dane County > Madison (0.04)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > China > Jiangsu Province > Nanjing (0.04)
- Research Report (0.64)
- Overview (0.46)
- Information Technology > Artificial Intelligence > Machine Learning > Unsupervised or Indirectly Supervised Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Inductive Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.47)
Solar Radiation Anomaly Events Modeling Using Spatial-Temporal Mutually Interactive Processes
Zhang, Minghe, Xu, Chen, Sun, Andy, Qiu, Feng, Xie, Yao
Solar power installations are becoming common in residential and commercial areas, largely due to their decreasing costs. However, the power system is vulnerable to some anomalies such as rainstorm or hurricane, which cost greatly to restoration. As a result, detecting and predicting abnormal events from the spatialtemporal series plays a vital role in the solar system, aiming to capture the variety of intrinsic reasons for the anomalies. For example, the rainstorm and drought would bring out different types and patterns of anomalies. In many cases, the abnormal event will also start at one location and then propagate to its neighbors with a time delay, leading to spatial-temporal correlation among anomalies. Thus it is crucial to make observations at multiple locations, which correspondingly form the spatial-temporal series. In this paper, we address non-stationarity and strong spatial-temporal correlation through the following contributions: - Strong spatial-temporal correlation: We present a spatial-temporal Bernoulli process (also extended to categorical observations), which is proposed by [19]. The model can flexibly capture the spatial-temporal correlations and interactions without assuming time-decaying influence. It can also efficiently make predictions for any location at any future time for timely ramp event detection.
- North America > United States > California > Los Angeles County > Los Angeles (0.16)
- North America > United States > California > Santa Clara County > Palo Alto (0.05)
- North America > United States > California > Santa Clara County > Sunnyvale (0.04)
- (2 more...)