reusable component
LOCOFY Large Design Models -- Design to code conversion solution
Muhammad, Sohaib, Vipin, Ashwati, Shetti, Karan, Mittal, Honey
Despite rapid advances in Large Language Models and Multimodal Large Language Models (LLMs), numerous challenges related to interpretability, scalability, resource requirements and repeatability remain, related to their application in the design-to-code space. To address this, we introduce the Large Design Models (LDMs) paradigm specifically trained on designs and webpages to enable seamless conversion from design-to-code. We have developed a training and inference pipeline by incorporating data engineering and appropriate model architecture modification. The training pipeline consists of the following: 1)Design Optimiser: developed using a proprietary ground truth dataset and addresses sub-optimal designs; 2)Tagging and feature detection: using pre-trained and fine-tuned models, this enables the accurate detection and classification of UI elements; and 3)Auto Components: extracts repeated UI structures into reusable components to enable creation of modular code, thus reducing redundancy while enhancing code reusability. In this manner, each model addresses distinct but key issues for design-to-code conversion. Separately, our inference pipeline processes real-world designs to produce precise and interpretable instructions for code generation and ensures reliability. Additionally, our models illustrated exceptional end-to-end design-to-code conversion accuracy using a novel preview match score metric. Comparative experiments indicated superior performance of LDMs against LLMs on accuracy of node positioning, responsiveness and reproducibility. Moreover, our custom-trained tagging and feature detection model demonstrated high precision and consistency in identifying UI elements across a wide sample of test designs. Thus, our proposed LDMs are a reliable and superior solution to understanding designs that subsequently enable the generation of efficient and reliable production-ready code.
H&M wants to democratize AI with reusable components
In AI implementation, organizations grapple with scaling issues. Advancing investments from the pilot stage into business critical processes is challenging, due to constraints in accessing talent and organizational culture pitfalls. But given the threats the retail industry faces -- consumers pulling back on spending and inventory challenges -- digital is imperative. H&M "must act quickly to improve its online proposition globally" as it adjusts to shifting shopping habits everywhere, analyst firm GlobalData said in a research note. This year, H&M already planned to open fewer stores as it expanded digital operations globally.
- Information Technology > Artificial Intelligence > Machine Learning (0.43)
- Information Technology > Data Science > Data Mining > Big Data (0.40)
Applying Software Engineering to Agent Development
Cohen, Mark A. (Lock Haven University) | Ritter, Frank E. | Haynes, Steven R
Developing intelligent agents and cognitive models is a complex software engineering activity. This article shows how all intelligent agent creation tools can be improved by taking advantage of established software engineering principles such as high-level languages, maintenance-oriented development environments, and software reuse. We describe how these principles have been realized in the Herbal integrated development environment, a collection of tools that allows agent developers to exploit modern software engineering principles.
- North America > United States > New York (0.05)
- North America > United States > Massachusetts > Middlesex County > Reading (0.04)
- North America > United States > District of Columbia > Washington (0.04)
- (13 more...)
- Education (0.68)
- Government > Military (0.67)