process industry
Contrastive Learning Using Graph Embeddings for Domain Adaptation of Language Models in the Process Industry
Zhukova, Anastasia, Lührs, Jonas, Lobmüller, Christian E., Gipp, Bela
Recent trends in NLP utilize knowledge graphs (KGs) to enhance pretrained language models by incorporating additional knowledge from the graph structures to learn domain-specific terminology or relationships between documents that might otherwise be overlooked. This paper explores how SciNCL, a graph-aware neighborhood contrastive learning methodology originally designed for scientific publications, can be applied to the process industry domain, where text logs contain crucial information about daily operations and are often structured as sparse KGs. Our experiments demonstrate that language models fine-tuned with triplets derived from graph embeddings (GE) outperform a state-of-the-art mE5-large text encoder by 9.8-14.3% (5.45-7.96p) on the proprietary process industry text embedding benchmark (PITEB) while having 3 times fewer parameters.
- Europe > Germany > Lower Saxony > Gottingen (0.14)
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- Europe > Spain > Catalonia > Barcelona Province > Barcelona (0.04)
- (11 more...)
- Information Technology > Artificial Intelligence > Representation & Reasoning (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Text Processing (1.00)
- Information Technology > Artificial Intelligence > Natural Language > Information Retrieval (0.68)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
Link Prediction for Event Logs in the Process Industry
Zhukova, Anastasia, Walton, Thomas, Matt, Christian E., Gipp, Bela
Knowledge management (KM) is vital in the process industry for optimizing operations, ensuring safety, and enabling continuous improvement through effective use of operational data and past insights. A key challenge in this domain is the fragmented nature of event logs in shift books, where related records, e.g., entries documenting issues related to equipment or processes and the corresponding solutions, may remain disconnected. This fragmentation hinders the recommendation of previous solutions to the users. To address this problem, we investigate record linking (RL) as link prediction, commonly studied in graph-based machine learning, by framing it as a cross-document coreference resolution (CDCR) task enhanced with natural language inference (NLI) and semantic text similarity (STS) by shifting it into the causal inference (CI). We adapt CDCR, traditionally applied in the news domain, into an RL model to operate at the passage level, similar to NLI and STS, while accommodating the process industry's specific text formats, which contain unstructured text and structured record attributes. Our RL model outperformed the best versions of NLI- and STS-driven baselines by 28% (11.43 points) and 27% (11.21 points), respectively. Our work demonstrates how domain adaptation of the state-of-the-art CDCR models, enhanced with reasoning capabilities, can be effectively tailored to the process industry, improving data quality and connectivity in shift logs.
- Europe > Germany > Lower Saxony > Gottingen (0.14)
- North America > United States > Minnesota > Hennepin County > Minneapolis (0.14)
- South America > Paraguay > Asunción > Asunción (0.04)
- (22 more...)
Learning Paradigms and Modelling Methodologies for Digital Twins in Process Industry
Mayr, Michael, Chasparis, Georgios C., Küng, Josef
Central to the digital transformation of the process industry are Digital Twins (DTs), virtual replicas of physical manufacturing systems that combine sensor data with sophisticated data-based or physics-based models, or a combination thereof, to tackle a variety of industrial-relevant tasks like process monitoring, predictive control or decision support. The backbone of a DT, i.e. the concrete modelling methodologies and architectural frameworks supporting these models, are complex, diverse and evolve fast, necessitating a thorough understanding of the latest state-of-the-art methods and trends to stay on top of a highly competitive market. From a research perspective, despite the high research interest in reviewing various aspects of DTs, structured literature reports specifically focusing on unravelling the utilized learning paradigms (e.g. self-supervised learning) for DT-creation in the process industry are a novel contribution in this field. This study aims to address these gaps by (1) systematically analyzing the modelling methodologies (e.g. Convolutional Neural Network, Encoder-Decoder, Hidden Markov Model) and paradigms (e.g. data-driven, physics-based, hybrid) used for DT-creation; (2) assessing the utilized learning strategies (e.g. supervised, unsupervised, self-supervised); (3) analyzing the type of modelling task (e.g. regression, classification, clustering); and (4) identifying the challenges and research gaps, as well as, discuss potential resolutions provided.
- Research Report > Promising Solution (0.34)
- Research Report > New Finding (0.30)
Facilitating Reinforcement Learning for Process Control Using Transfer Learning: Perspectives
Lin, Runze, Chen, Junghui, Xie, Lei, Su, Hongye, Huang, Biao
This paper provides insights into deep reinforcement learning (DRL) for process control from the perspective of transfer learning. We analyze the challenges of applying DRL in the field of process industries and the necessity of introducing transfer learning. Furthermore, recommendations and prospects are provided for future research directions on how transfer learning can be integrated with DRL to empower process control.
- Asia > China > Zhejiang Province > Hangzhou (0.06)
- Asia > Taiwan (0.05)
- North America > Canada > Alberta > Census Division No. 11 > Edmonton Metropolitan Region > Edmonton (0.05)
Machine learning for industrial sensing and control: A survey and practical perspective
Lawrence, Nathan P., Damarla, Seshu Kumar, Kim, Jong Woo, Tulsyan, Aditya, Amjad, Faraz, Wang, Kai, Chachuat, Benoit, Lee, Jong Min, Huang, Biao, Gopaluni, R. Bhushan
With the rise of deep learning, there has been renewed interest within the process industries to utilize data on large-scale nonlinear sensing and control problems. We identify key statistical and machine learning techniques that have seen practical success in the process industries. To do so, we start with hybrid modeling to provide a methodological framework underlying core application areas: soft sensing, process optimization, and control. Soft sensing contains a wealth of industrial applications of statistical and machine learning methods. We quantitatively identify research trends, allowing insight into the most successful techniques in practice. We consider two distinct flavors for data-driven optimization and control: hybrid modeling in conjunction with mathematical programming techniques and reinforcement learning. Throughout these application areas, we discuss their respective industrial requirements and challenges. A common challenge is the interpretability and efficiency of purely data-driven methods. This suggests a need to carefully balance deep learning techniques with domain knowledge. As a result, we highlight ways prior knowledge may be integrated into industrial machine learning applications. The treatment of methods, problems, and applications presented here is poised to inform and inspire practitioners and researchers to develop impactful data-driven sensing, optimization, and control solutions in the process industries.
- North America > United States (0.28)
- Asia > South Korea (0.14)
- North America > Canada > Alberta (0.14)
- Research Report (1.00)
- Overview (1.00)
- Energy > Oil & Gas > Upstream (1.00)
- Materials > Chemicals (0.95)
- Leisure & Entertainment > Games (0.92)
- Health & Medicine (0.67)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- (3 more...)
A Novel Black Box Process Quality Optimization Approach based on Hit Rate
Yang, Yang, Wu, Jian, Song, Xiangman, Wu, Derun, Su, Lijie, Tang, Lixin
Hit rate is a key performance metric in predicting process product quality in integrated industrial processes. It represents the percentage of products accepted by downstream processes within a controlled range of quality. However, optimizing hit rate is a non-convex and challenging problem. To address this issue, we propose a data-driven quasi-convex approach that combines factorial hidden Markov models, multitask elastic net, and quasi-convex optimization. Our approach converts the original non-convex problem into a set of convex feasible problems, achieving an optimal hit rate. We verify the convex optimization property and quasi-convex frontier through Monte Carlo simulations and real-world experiments in steel production. Results demonstrate that our approach outperforms classical models, improving hit rates by at least 41.11% and 31.01% on two real datasets. Furthermore, the quasi-convex frontier provides a reference explanation and visualization for the deterioration of solutions obtained by conventional models.
- Asia > China (0.28)
- North America > United States (0.14)
- Materials > Metals & Mining > Steel (1.00)
- Energy > Oil & Gas (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Undirected Networks > Markov Models (1.00)
The Digital Divide in Process Safety: Quantitative Risk Analysis of Human-AI Collaboration
Digital technologies have dramatically accelerated the digital transformation in process industries, boosted new industrial applications, upgraded the production system, and enhanced operational efficiency. In contrast, the challenges and gaps between human and artificial intelligence (AI) have become more and more prominent, whereas the digital divide in process safety is aggregating. The study attempts to address the following questions: (i)What is AI in the process safety context? (ii)What is the difference between AI and humans in process safety? (iii)How do AI and humans collaborate in process safety? (iv)What are the challenges and gaps in human-AI collaboration? (v)How to quantify the risk of human-AI collaboration in process safety? Qualitative risk analysis based on brainstorming and literature review, and quantitative risk analysis based on layer of protection analysis (LOPA) and Bayesian network (BN), were applied to explore and model. The importance of human reliability should be stressed in the digital age, not usually to increase the reliability of AI, and human-centered AI design in process safety needs to be propagated.
- North America > United States (0.94)
- Europe (0.46)
- North America > Canada > Alberta (0.28)
- Government (1.00)
- Energy > Power Industry > Utilities > Nuclear (0.95)
- Health & Medicine (0.94)
- (2 more...)
- Information Technology > Artificial Intelligence > Issues > Social & Ethical Issues (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Uncertainty > Bayesian Inference (0.48)
- Information Technology > Artificial Intelligence > Machine Learning > Learning Graphical Models > Directed Networks > Bayesian Learning (0.48)
Hazardous Lighting Market Share, Size and Industry Growth Analysis 2021-2026
Hazardous Lighting Market size was valued at $1.8 billion in 2020 and it is estimated to grow at a CAGR of 2.29% during 2021-2026. The growth is mainly attributed to the increasing investment on various industries, high penetration of internet of things (IoT), increasing demand for efficient advanced lighting solutions across industries and rapid industrialization in emerging economies. Furthermore, the constant innovation in advanced technologies such as artificial intelligence (AI), machine learning (ML), radio-frequency identification (RFID) along with other wireless technologies, which are being used for producing advanced connected hazardous lighting system; and awareness regarding energy conservation boost the growth of hazardous lighting market. Furthermore, government's initiatives for greener strategies to support sustainable development across the world, is one of the major driving factors of hazardous lighting industry. Hence, the above mentioned factors will drive the adoption rate of various hazardous lighting solutions such as industrial LED lighting, fluorescent lighting, high-intensity discharge lamps and others, during the forecast period 2021-2026.
- Asia > India (0.71)
- Europe (0.70)
- North America > Mexico (0.47)
- (4 more...)
- Materials > Chemicals (0.99)
- Government > Regional Government (0.70)
- Energy > Oil & Gas > Downstream (0.49)
- Information Technology > Artificial Intelligence (0.89)
- Information Technology > Communications > Networks (0.54)
Modern Machine Learning Tools for Monitoring and Control of Industrial Processes: A Survey
Gopaluni, R. Bhushan, Tulsyan, Aditya, Chachuat, Benoit, Huang, Biao, Lee, Jong Min, Amjad, Faraz, Damarla, Seshu Kumar, Kim, Jong Woo, Lawrence, Nathan P.
Over the last ten years, we have seen a significant increase in industrial data, tremendous improvement in computational power, and major theoretical advances in machine learning. This opens up an opportunity to use modern machine learning tools on large-scale nonlinear monitoring and control problems. This article provides a survey of recent results with applications in the process industry.
- Research Report (1.00)
- Overview (1.00)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Statistical Learning (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Reinforcement Learning (1.00)
- (3 more...)
Optimization paper production through digitalization by developing an assistance system for machine operators including quality forecast: a concept
Schroth, Moritz, Hake, Felix, Merker, Konstantin, Becher, Alexander, Klaeger, Tilman, Huesmann, Robin, Eichhorn, Detlef, Oehm, Lukas
Nowadays cross-industry ranging challenges include the reduction of greenhouse gas emission and enabling a circular economy. However, the production of paper from waste paper is still a highly resource intensive task, especially in terms of energy consumption. While paper machines produce a lot of data, we have identified a lack of utilization of it and implement a concept using an operator assistance system and state-of-the-art machine learning techniques, e.g., classification, forecasting and alarm flood handling algorithms, to support daily operator tasks. Our main objective is to provide situation-specific knowledge to machine operators utilizing available data. We expect this will result in better adjusted parameters and therefore a lower footprint of the paper machines.