Goto

Collaborating Authors

 design


A Coupled Design of Exploiting Record Similarity for Practical Vertical Federated Learning

Neural Information Processing Systems

Federated learning is a learning paradigm to enable collaborative learning across different parties without revealing raw data. Notably, vertical federated learning (VFL), where parties share the same set of samples but only hold partial features, has a wide range of real-world applications.


Twins: Revisiting the Design of Spatial Attention in Vision Transformers

Neural Information Processing Systems

Very recently, a variety of vision transformer architectures for dense prediction tasks have been proposed and they show that the design of spatial attention is critical to their success in these tasks. In this work, we revisit the design of the spatial attention and demonstrate that a carefully devised yet simple spatial attention mechanism performs favorably against the state-of-the-art schemes. As a result, we propose two vision transformer architectures, namely, Twins-PCPVT and Twins-SVT. Our proposed architectures are highly efficient and easy to implement, only involving matrix multiplications that are highly optimized in modern deep learning frameworks. More importantly, the proposed architectures achieve excellent performance on a wide range of visual tasks including image-level classification as well as dense detection and segmentation. The simplicity and strong performance suggest that our proposed architectures may serve as stronger backbones for many vision tasks.


Multiple Descent: Design Your Own Generalization Curve

Neural Information Processing Systems

This paper explores the generalization loss of linear regression in variably parameterized families of models, both under-parameterized and over-parameterized. We show that the generalization curve can have an arbitrary number of peaks, and moreover, the locations of those peaks can be explicitly controlled. Our results highlight the fact that both the classical U-shaped generalization curve and the recently observed double descent curve are not intrinsic properties of the model family. Instead, their emergence is due to the interaction between the properties of the data and the inductive biases of learning algorithms.


Designs for Enabling Collaboration in Human-Machine Teaming via Interactive and Explainable Systems

Neural Information Processing Systems

Collaborative robots and machine learning-based virtual agents are increasingly entering the human workspace with the aim of increasing productivity and enhancing safety. Despite this, we show in a ubiquitous experimental domain, Overcooked-AI, that state-of-the-art techniques for human-machine teaming (HMT), which rely on imitation or reinforcement learning, are brittle and result in a machine agent that aims to decouple the machine and human's actions to act independently rather than in a synergistic fashion. To remedy this deficiency, we develop HMT approaches that enable iterative, mixed-initiative team development allowing end-users to interactively reprogram interpretable AI teammates. Our 50-subject study provides several findings that we summarize into guidelines. While all approaches underperform a simple collaborative heuristic (a critical, negative result for learning-based methods), we find that white-box approaches supported by interactive modification can lead to significant team development, outperforming white-box approaches alone, and that black-box approaches are easier to train and result in better HMT performance highlighting a tradeoff between explainability and interactivity versus ease-of-training.


Project URSULA: Design of a Robotic Squid for Underwater Manipulation

arXiv.org Artificial Intelligence

With this paper, the design of a biomimetic robotic squid (dubbed URSULA) developed for dexterous underwater manipulation is presented. The robot serves as a test bed for several novel underwater technologies such as soft manipulators, propeller-less propulsion, model mediated tele-operation with video and haptic feedback, sonar-based underwater mapping, localization, and navigation, and high bandwidth visible light communications. Following the finalization of the detailed design, a prototype is manufactured and is currently undergoing pool tests.


MIND: Microstructure INverse Design with Generative Hybrid Neural Representation

arXiv.org Artificial Intelligence

The inverse design of microstructures plays a pivotal role in optimizing metamaterials with specific, targeted physical properties. While traditional forward design methods are constrained by their inability to explore the vast combinatorial design space, inverse design offers a compelling alternative by directly generating structures that fulfill predefined performance criteria. However, achieving precise control over both geometry and material properties remains a significant challenge due to their intricate interdependence. Existing approaches, which typically rely on voxel or parametric representations, often limit design flexibility and structural diversity. In this work, we present a novel generative model that integrates latent diffusion with Holoplane, an advanced hybrid neural representation that simultaneously encodes both geometric and physical properties. This combination ensures superior alignment between geometry and properties. Our approach generalizes across multiple microstructure classes, enabling the generation of diverse, tileable microstructures with significantly improved property accuracy and enhanced control over geometric validity, surpassing the performance of existing methods. We introduce a multi-class dataset encompassing a variety of geometric morphologies, including truss, shell, tube, and plate structures, to train and validate our model. Experimental results demonstrate the model's ability to generate microstructures that meet target properties, maintain geometric validity, and integrate seamlessly into complex assemblies. Additionally, we explore the potential of our framework through the generation of new microstructures, cross-class interpolation, and the infilling of heterogeneous microstructures. The dataset and source code will be open-sourced upon publication.


Automated Driving Architecture and Operation of a Light Commercial Vehicle

arXiv.org Artificial Intelligence

This paper is on the automated driving architecture and operation of a light commercial vehicle. Simple longitudinal and lateral dynamic models of the vehicle and a more detailed CarSim model are developed and used in simulations and controller design and evaluation. Experimental validation is used to make sure that the models used represent the actual response of the vehicle as closely as possible. The vehicle is made drive-by-wire by interfacing with the existing throttle-by-wire, by adding an active vacuum booster for brake-by-wire and by adding a steering actuator for steer-by-wire operation. Vehicle localization is achieved by using a GPS sensor integrated with six axes IMU with a built-in INS algorithm and a digital compass for heading information. Front looking radar, lidar and camera are used for environmental sensing. Communication with the road infrastructure and other vehicles is made possible by a vehicle to vehicle communication modem. A dedicated computer under real time Linux is used to collect, process and distribute sensor information. A dSPACE MicroAutoBox is used for drive-by-wire controls. CACC based longitudinal control and path tracking of a map of GPS waypoints are used to present the operation of this automated driving vehicle.


Ville Tolvanen on LinkedIn: "#digitalist #cx #innovation #iot #ai #customerexperience #smartcities #design"

#artificialintelligence

We as a Digitalist Group & Network are opening our doors and building a dynamic community here in San Francisco. If it's a creative, professional environment that you are looking for, we are it! Our company and wider community is comprised of businesses and experts in the AI, ML and high tech fields. Digitalist San Francisco is located in the Financial District of downtown San Francisco. The montly rent is $600 USD per desk, per person, per month.


#Open #IoT with #Blockchain #AI and #BigData – Paradigm Interactions

#artificialintelligence

There will be many people who will say it does exist and has working technologies, hardware and software. It is an interesting error in thinking to focus on closed system devices/products as to what Ubiquity (IoT3) is. Devices are used to get across the point of various types of connections and networks being accessed. But more importantly in a full implementation of the concept of Ubiquity (often described as the IoT) devices may not even be owned anymore. The ownership of devices ceases to be important if you can own your digital identity, can verify it and establish your own ecosystem of assets in Blockchain.


AI Will Turn Graphic Design On Its Head Backchannel

#artificialintelligence

Graphic design used to require physical work. To compose letterheads, business cards, brochures, magazines, books, and posters, you hunched over a desk or a light table. You cut and pasted paper or assembled metal type on a printing press. You processed 35mm film by hand, developing pictures in a darkroom with chemicals. Jason Tselentis is an educator, writer, and designer.