microservice
Reusability in MLOps: Leveraging Ports and Adapters to Build a Microservices Architecture for the Maritime Domain
Ferreira, Renato Cordeiro, Dhinavahi, Aditya, Trapmann, Rowanne, Heuvel, Willem-Jan van den
ML-Enabled Systems (MLES) are inherently complex since they require multiple components to achieve their business goal. This experience report showcases the software architecture reusability techniques applied while building Ocean Guard, an MLES for anomaly detection in the maritime domain. In particular, it highlights the challenges and lessons learned to reuse the Ports and Adapters pattern to support building multiple microservices from a single codebase. This experience report hopes to inspire software engineers, machine learning engineers, and data scientists to apply the Hexagonal Architecture pattern to build their MLES.
- Europe > Netherlands > North Brabant > 's-Hertogenbosch (0.05)
- Europe > Switzerland (0.05)
- Europe > Netherlands > North Brabant > Eindhoven (0.05)
- (4 more...)
Federated Learning and Trajectory Compression for Enhanced AIS Coverage
Gräupl, Thomas, Reisenbauer, Andreas, Hecko, Marcel, Rasouli, Anil, Graser, Anita, Dragaschnig, Melitta, Weissenfeld, Axel, Dejaegere, Gilles, Sakr, Mahmoud
Abstract--This paper presents the V esselEdge system, which leverages federated learning and bandwidth-constrained trajectory compression to enhance maritime situational awareness by extending AIS coverage. V esselEdge transforms vessels into mobile sensors, enabling real-time anomaly detection and efficient data transmission over low-bandwidth connections. The system integrates the M fed model for federated learning and the BWC-DR-A algorithm for trajectory compression, prioritizing anomalous data. Preliminary results demonstrate the effectiveness of V esselEdge in improving AIS coverage and situational awareness using historical data. The Automatic Identification System (AIS) is a tracking system that uses transceivers on ships to monitor marine traffic.
- Europe > Austria > Vienna (0.15)
- Europe > Sweden > Vaestra Goetaland > Gothenburg (0.04)
- Europe > Belgium > Brussels-Capital Region > Brussels (0.04)
- Transportation (0.95)
- Government > Military (0.55)
Root Cause Analysis for Microservice Systems via Cascaded Conditional Learning with Hypergraphs
Xie, Shuaiyu, He, Hanbin, Wang, Jian, Li, Bing
Abstract--Root cause analysis in microservice systems typically involves two core tasks: root cause localization (RCL) and failure type identification (FTI). Despite substantial research efforts, conventional diagnostic approaches still face two key challenges. First, these methods predominantly adopt a joint learning paradigm for RCL and FTI to exploit shared information and reduce training time. Second, these existing methods primarily focus on point-to-point relationships between instances, overlooking the group nature of inter-instance influences induced by deployment configurations and load balancing. T o overcome these limitations, we propose CCLH, a novel root cause analysis framework that orchestrates diagnostic tasks based on cascaded conditional learning. CCLH provides a three-level taxonomy for group influences between instances and incorporates a heterogeneous hypergraph to model these relationships, facilitating the simulation of failure propagation. Extensive experiments conducted on datasets from three mi-croservice benchmarks demonstrate that CCLH outperforms state-of-the-art methods in both RCL and FTI. Microservice architecture has been widely adopted by cloud-native enterprises due to its flexibility, scalability, and loose coupling. In microservice systems (MSS), each microser-vice typically reproduces multiple instances, which collaborate with instances affiliated with other microservices to handle user requests [1], [2]. As these systems scale up, they may suffer from reliability issues, aka failures, attributable to the increasing complexity and dynamicity. Worse still, diagnosing failures in microservice systems is labor-intensive and time-consuming, due to the intricate failure propagation and the overwhelming volume of telemetry data. For example, GitHub once took approximately one and a half hours to resolve a failure that disrupted the codespace service, affecting millions of developers and repositories [3]. Traditional root cause analysis (RCA) in MSS encompasses two tasks: root cause localization (RCL) and failure type identification (FTI).
Smart Manufacturing: MLOps-Enabled Event-Driven Architecture for Enhanced Control in Steel Production
Ahmed, Bestoun S., Azzalin, Tommaso, Kassler, Andreas, Thore, Andreas, Lindback, Hans
We explore a Digital Twin-Based Approach for Smart Manufacturing to improve Sustainability, Efficiency, and Cost-Effectiveness for a steel production plant. Our system is based on a micro-service edge-compute platform that ingests real-time sensor data from the process into a digital twin over a converged network infrastructure. We implement agile machine learning-based control loops in the digital twin to optimize induction furnace heating, enhance operational quality, and reduce process waste. Key to our approach is a Deep Reinforcement learning-based agent used in our machine learning operation (MLOps) driven system to autonomously correlate the system state with its digital twin to identify correction actions that aim to optimize power settings for the plant. We present the theoretical basis, architectural details, and practical implications of our approach to reduce manufacturing waste and increase production quality. We design the system for flexibility so that our scalable event-driven architecture can be adapted to various industrial applications. With this research, we propose a pivotal step towards the transformation of traditional processes into intelligent systems, aligning with sustainability goals and emphasizing the role of MLOps in shaping the future of data-driven manufacturing.
- Europe > Sweden > Värmland County > Karlstad (0.04)
- Europe > Italy > Emilia-Romagna > Metropolitan City of Bologna > Bologna (0.04)
- North America > United States (0.04)
- (2 more...)
- Overview (1.00)
- Research Report > New Finding (0.67)
- Materials > Metals & Mining > Steel (1.00)
- Energy (1.00)
- Information Technology > Artificial Intelligence > Machine Learning > Reinforcement Learning (0.87)
- Information Technology > Artificial Intelligence > Representation & Reasoning > Optimization (0.67)
- Information Technology > Artificial Intelligence > Machine Learning > Neural Networks > Deep Learning (0.46)
- North America > United States (0.14)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > South Korea > Gyeongsangnam-do > Changwon (0.04)
- (2 more...)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.68)
- Information Technology > Services (0.46)
- North America > United States (0.14)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.04)
- Asia > South Korea > Gyeongsangnam-do > Changwon (0.04)
- Asia > India (0.04)
- Information Technology > Services (0.46)
- Health & Medicine > Pharmaceuticals & Biotechnology (0.46)
Application Management in C-ITS: Orchestrating Demand-Driven Deployments and Reconfigurations
Zanger, Lukas, Lampe, Bastian, Reiher, Lennart, Eckstein, Lutz
Personal use of this material is permitted. Abstract-- V ehicles are becoming increasingly automated and interconnected, enabling the formation of cooperative intelligent transport systems (C-ITS) and the use of offboard services. As a result, cloud-native techniques, such as microservices and container orchestration, play an increasingly important role in their operation. However, orchestrating applications in a large-scale C-ITS poses unique challenges due to the dynamic nature of the environment and the need for efficient resource utilization. In this paper, we present a demand-driven application management approach that leverages cloud-native techniques - specifically Kubernetes - to address these challenges. T aking into account the demands originating from different entities within the C-ITS, the approach enables the automation of processes, such as deployment, reconfiguration, update, upgrade, and scaling of microservices. Executing these processes on demand can, for example, reduce computing resource consumption and network traffic. A demand may include a request for provisioning an external supporting service, such as a collective environment model. The approach handles changing and new demands by dynamically reconciling them through our proposed application management framework built on Kubernetes and the Robot Operating System (ROS 2). We demonstrate the operation of our framework in the C-ITS use case of collective environment perception and make the source code of the prototypical framework publicly available at https://github.com/
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.04)
- Europe > Spain > Basque Country > Biscay Province > Bilbao (0.04)
- Europe > Hungary > Budapest > Budapest (0.04)
- (3 more...)
- Information Technology > Cloud Computing (1.00)
- Information Technology > Artificial Intelligence > Robots (1.00)
LLM Agents for Generating Microservice-based Applications: how complex is your specification?
In this paper we evaluate the capabilities of LLM Agents in generating code for real-world problems. Specifically, we explore code synthesis for microservice-based applications, a widely used architectural pattern for building applications. We define a standard template for specifying these applications, and we propose a metric for scoring the difficulty of a specification. The higher the score, the more difficult it is to generate code for the specification. Our experimental results show that agents using strong LLMs (like GPT-3o-mini) do fairly well on medium difficulty specifications but do poorly on those of higher difficulty levels. This is due to more intricate business logic, a greater use of external services, database integration and inclusion of non-functional capabilities such as authentication. We analyzed the errors in LLM-synthesized code and report on the key challenges LLM Agents face in generating code for these specifications. Finally, we show that using a fine-grained approach to code generation improves the correctness of the generated code.
- Europe > Austria > Vienna (0.14)
- North America > United States > Florida > Miami-Dade County > Miami (0.04)
- Europe > Spain > Catalonia > Barcelona Province > Barcelona (0.04)
- (3 more...)
- Consumer Products & Services > Restaurants (0.47)
- Information Technology (0.35)
MLOps with Microservices: A Case Study on the Maritime Domain
Ferreira, Renato Cordeiro, Trapmann, Rowanne, Heuvel, Willem-Jan van den
This case study describes challenges and lessons learned on building Ocean Guard: a Machine Learning-Enabled System (MLES) for anomaly detection in the maritime domain. First, the paper presents the system's specification, and architecture. Ocean Guard was designed with a microservices' architecture to enable multiple teams to work on the project in parallel. Then, the paper discusses how the developers adapted contract-based design to MLOps for achieving that goal. As a MLES, Ocean Guard employs code, model, and data contracts to establish guidelines between its services. This case study hopes to inspire software engineers, machine learning engineers, and data scientists to leverage similar approaches for their systems.
- Europe > Netherlands > North Brabant > Eindhoven (0.04)
- Europe > Netherlands > North Brabant > 's-Hertogenbosch (0.04)
- Europe > Germany > Bavaria > Upper Bavaria > Munich (0.04)
- Transportation (0.69)
- Law (0.68)
- Information Technology > Security & Privacy (0.46)
HECATE: An ECS-based Framework for Teaching and Developing Multi-Agent Systems
Casals, Arthur, Brandão, Anarosa A. F.
This paper introduces HECATE, a novel framework based on the Entity-Component-System (ECS) architectural pattern that bridges the gap between distributed systems engineering and MAS development. HECATE is built using the Entity-Component-System architectural pattern, leveraging data-oriented design to implement multiagent systems. This approach involves engineering multiagent systems (MAS) from a distributed systems (DS) perspective, integrating agent concepts directly into the DS domain. This approach simplifies MAS development by (i) reducing the need for specialized agent knowledge and (ii) leveraging familiar DS patterns and standards to minimize the agent-specific knowledge required for engineering MAS. We present the framework's architecture, core components, and implementation approach, demonstrating how it supports different agent models.
- South America > Brazil > São Paulo (0.76)
- North America > United States (0.15)
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.04)
- (2 more...)
- Information Technology (0.95)
- Leisure & Entertainment > Games > Computer Games (0.94)