Pacific Ocean
A Comprehensive Survey of Regression Based Loss Functions for Time Series Forecasting
Jadon, Aryan, Patil, Avinash, Jadon, Shruti
Time Series Forecasting has been an active area of research due to its many applications ranging from network usage prediction, resource allocation, anomaly detection, and predictive maintenance. Numerous publications published in the last five years have proposed diverse sets of objective loss functions to address cases such as biased data, long-term forecasting, multicollinear features, etc. In this paper, we have summarized 14 well-known regression loss functions commonly used for time series forecasting and listed out the circumstances where their application can aid in faster and better model convergence. We have also demonstrated how certain categories of loss functions perform well across all data sets and can be considered as a baseline objective function in circumstances where the distribution of the data is unknown. Our code is available at GitHub: https://github.com/aryan-jadon/Regression-Loss-Functions-in-Time-Series-Forecasting-Tensorflow.
G7 takes aim at chief adversaries and urges peace from UN leaders Russia, China
Fox News Flash top headlines are here. Check out what's clicking on Foxnews.com. Chief diplomats from the world's leading democracies rallied together in a joint statement condemning global adversaries like Iran and North Korea and called on Russia and China to remember their security commitments to the United Nations. After two days of meetings, officials from the Group of 7 (G7) released a lengthy statement Friday in an address to its top geopolitical challengers, warning them to adhere to international laws. United States Secretary of States Antony Blinken and Foreign Minister Yoshimasa Hayashi of Japan, right, meet for bilateral talks at the G7 Foreign Ministers' Meeting in Muenster, Germany, Friday, Nov. 4, 2022.
Beyond Dashboards: The Future Of Analytics And Business Intelligence?
Analytics and business intelligence (BI) have long been understood to be fundamental to business success. Today, powerful technologies, including artificial intelligence (AI) and machine learning (ML), make it possible to gain deeper insights into all areas of business activity in order to drive efficiency, reduce waste and gain a better understanding of customers. Truly benefiting from analytics โ particularly the most advanced and powerful analytics techniques involving AI โ requires developing a top-to-bottom culture of data literacy throughout an organization and this, in my experience, is where many businesses are still failing. This is highlighted by one particular statistic that came up during my recent webinar conversation with Amir Orad, CEO of Sisense. Orad told me that according to his observations, 80 percent of employees in the average organization simply aren't leveraging the analytics that, in theory, are available to them.
Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast
Bi, Kaifeng, Xie, Lingxi, Zhang, Hengheng, Chen, Xin, Gu, Xiaotao, Tian, Qi
In this paper, we present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For this purpose, we establish a data-driven environment by downloading $43$ years of hourly global weather data from the 5th generation of ECMWF reanalysis (ERA5) data and train a few deep neural networks with about $256$ million parameters in total. The spatial resolution of forecast is $0.25^\circ\times0.25^\circ$, comparable to the ECMWF Integrated Forecast Systems (IFS). More importantly, for the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy (latitude-weighted RMSE and ACC) of all factors (e.g., geopotential, specific humidity, wind speed, temperature, etc.) and in all time ranges (from one hour to one week). There are two key strategies to improve the prediction accuracy: (i) designing a 3D Earth Specific Transformer (3DEST) architecture that formulates the height (pressure level) information into cubic data, and (ii) applying a hierarchical temporal aggregation algorithm to alleviate cumulative forecast errors. In deterministic forecast, Pangu-Weather shows great advantages for short to medium-range forecast (i.e., forecast time ranges from one hour to one week). Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast (e.g., tropical cyclone tracking) and large-member ensemble forecast in real-time. Pangu-Weather not only ends the debate on whether AI-based methods can surpass conventional NWP methods, but also reveals novel directions for improving deep learning weather forecast systems.
Make it pop! Do we really need the Beatles to sound new?
Yellow Submarine, Ringo Starr's turn on Revolver, has been a gateway for children into the music of the Beatles since its release in 1966. A new reissue of the album makes that relationship more explicit: Giles Martin, son of original producer George and the sonic custodian of the Beatles catalogue, says his "de-mixing" of the album โ using AI to separate individual instruments that were originally squeezed together on four tracks โ was done in part with a playlist-listening younger audience in mind. Martin recently told Variety that his teenage children listen to old and new music side by side, veering from Fleetwood Mac to Billie Eilish and Olivia Rodrigo. "[W]hat I want to make sure is that when people hear the Beatles, that it has the same dynamic as the other stuff they're listening to," he said. He added that 1969's Abbey Road, recorded on a then luxuriant eight tracks and the first Beatles album not released in mono, stands out from the band's catalogue as "it sounds more hi-fi than the other Beatles albums".
Review on Monitoring, Operation and Maintenance of Smart Offshore Wind Farms
Kou, Lei, Li, Yang, Zhang, Fangfang, Gong, Xiaodong, Hu, Yinghong, Yuan, Quande, Ke, Wende
In recent years, with the development of wind energy, the number and scale of wind farms have been developing rapidly. Since offshore wind farms have the advantages of stable wind speed, being clean renewable, non-polluting, and the non-occupation of cultivated land, they have gradually become a new trend in the wind power industry all over the world. The operation and maintenance of offshore wind powe has been developing in the direction of digitization and intelligence. It is of great significance to carry ou research on the monitoring, operation, and maintenance of offshore wind farms, which will be of benefit fo the reduction of the operation and maintenance costs, the improvement of the power generation efficiency improvement of the stability of offshore wind farm systems, and the building of smart offshore wind farms This paper will mainly summarize the monitoring, operation, and maintenance of offshore wind farms, with particular focus on the following points: monitoring of "offshore wind power engineering and biological and environment", the monitoring of power equipment, and the operation and maintenance of smart offshore wind farms. Finally, the future research challenges in relation to the monitoring, operation, and maintenance of smart offshore wind farms are proposed, and the future research directions in this field are explored especially in marine environment monitoring, weather and climate prediction, intelligent monitoring of powe equipment, and digital platforms.
Understanding Adverse Biological Effect Predictions Using Knowledge Graphs
Myklebust, Erik Bryhn, Jimenez-Ruiz, Ernesto, Chen, Jiaoyan, Wolf, Raoul, Tollefsen, Knut Erik
Extrapolation of adverse biological (toxic) effects of chemicals is an important contribution to expand available hazard data in (eco)toxicology without the use of animals in laboratory experiments. In this work, we extrapolate effects based on a knowledge graph (KG) consisting of the most relevant effect data as domain-specific background knowledge. An effect prediction model, with and without background knowledge, was used to predict mean adverse biological effect concentration of chemicals as a prototypical type of stressors. The background knowledge improves the model prediction performance by up to 40\% in terms of $R^2$ (\ie coefficient of determination). We use the KG and KG embeddings to provide quantitative and qualitative insights into the predictions. These insights are expected to improve the confidence in effect prediction. Larger scale implementation of such extrapolation models should be expected to support hazard and risk assessment, by simplifying and reducing testing needs.
Credit-Based Congestion Pricing: Equilibrium Properties and Optimal Scheme Design
Jalota, Devansh, Lazarus, Jessica, Bayen, Alexandre, Pavone, Marco
Credit-based congestion pricing (CBCP) has emerged as a mechanism to alleviate the social inequity concerns of road congestion pricing - a promising strategy for traffic congestion mitigation - by providing low-income users with travel credits to offset some of their toll payments. While CBCP offers immense potential for addressing inequity issues that hamper the practical viability of congestion pricing, the deployment of CBCP in practice is nascent, and the potential efficacy and optimal design of CBCP schemes have yet to be formalized. In this work, we study the design of CBCP schemes to achieve particular societal objectives and investigate their influence on traffic patterns when routing heterogeneous users with different values of time (VoTs) in a multi-lane highway with an express lane. We introduce a new non-atomic congestion game model of a mixed-economy, wherein eligible users receive travel credits while the remaining ineligible users pay out-of-pocket to use the express lane. In this setting, we investigate the effect of CBCP schemes on traffic patterns by characterizing the properties (i.e., existence, comparative statics) of the corresponding Nash equilibria and, in the setting when eligible users have time-invariant VoTs, develop a convex program to compute these equilibria. We further present a bi-level optimization framework to design optimal CBCP schemes to achieve a central planner's societal objectives. Finally, we conduct numerical experiments based on a case study of the San Mateo 101 Express Lanes Project, one of the first North American CBCP pilots. Our results demonstrate the potential of CBCP to enable low-income travelers to avail of the travel time savings provided by congestion pricing on express lanes while having comparatively low impacts on the travel costs of other road users.
ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation
Li, Junyi, Tang, Tianyi, Zhao, Wayne Xin, Nie, Jian-Yun, Wen, Ji-Rong
We study the text generation task under the approach of pre-trained language models (PLMs). Typically, an auto-regressive (AR) method is adopted for generating texts in a token-by-token manner. Despite many advantages of AR generation, it usually suffers from inefficient inference. Therefore, non-autoregressive (NAR) models are proposed to generate all target tokens simultaneously. However, NAR models usually generate texts of lower quality due to the absence of token dependency in the output text. In this paper, we propose ELMER: an efficient and effective PLM for NAR text generation to explicitly model the token dependency during NAR generation. By leveraging the early exit technique, ELMER enables the token generations at different layers, according to their prediction confidence (a more confident token will exit at a lower layer). Besides, we propose a novel pre-training objective, Layer Permutation Language Modeling, to pre-train ELMER by permuting the exit layer for each token in sequences. Experiments on three text generation tasks show that ELMER significantly outperforms NAR models and further narrows the performance gap with AR PLMs (\eg ELMER (29.92) vs BART (30.61) ROUGE-L in XSUM) while achieving over 10 times inference speedup.
Effective and Efficient Query-aware Snippet Extraction for Web Search
Yi, Jingwei, Wu, Fangzhao, Wu, Chuhan, Huang, Xiaolong, Jiao, Binxing, Sun, Guangzhong, Xie, Xing
Query-aware webpage snippet extraction is widely used in search engines to help users better understand the content of the returned webpages before clicking. Although important, it is very rarely studied. In this paper, we propose an effective query-aware webpage snippet extraction method named DeepQSE, aiming to select a few sentences which can best summarize the webpage content in the context of input query. DeepQSE first learns query-aware sentence representations for each sentence to capture the fine-grained relevance between query and sentence, and then learns document-aware query-sentence relevance representations for snippet extraction. Since the query and each sentence are jointly modeled in DeepQSE, its online inference may be slow. Thus, we further propose an efficient version of DeepQSE, named Efficient-DeepQSE, which can significantly improve the inference speed of DeepQSE without affecting its performance. The core idea of Efficient-DeepQSE is to decompose the query-aware snippet extraction task into two stages, i.e., a coarse-grained candidate sentence selection stage where sentence representations can be cached, and a fine-grained relevance modeling stage. Experiments on two real-world datasets validate the effectiveness and efficiency of our methods.