Goto

Collaborating Authors

 Agents


A Simulation Model Demonstrating the Impact of Social Aspects on Social Internet of Things

arXiv.org Artificial Intelligence

In addition to seamless connectivity and smartness, the objects in the Internet of Things (IoT) are expected to have the social capabilities -- these objects are termed as ``social objects''. In this paper, an intuitive paradigm of social interactions between these objects are argued and modeled. The impact of social behavior on the interaction pattern of social objects is studied taking Peer-to-Peer (P2P) resource sharing as an example application. The model proposed in this paper studies the implications of competitive vs. cooperative social paradigm, while peers attempt to attain the shared resources / services. The simulation results divulge that the social capabilities of the peers impart a significant increase in the quality of interactions between social objects. Through an agent-based simulation study, it is proved that cooperative strategy is more efficient than competitive strategy. Moreover, cooperation with an underpinning on real-life networking structure and mobility does not negatively impact the efficiency of the system at all; rather it helps.


Optimizing Traffic Lights with Multi-agent Deep Reinforcement Learning and V2X communication

arXiv.org Artificial Intelligence

We consider a system to optimize duration of traffic signals using multi-agent deep reinforcement learning and Vehicle-to-Everything (V2X) communication. This system aims at analyzing independent and shared rewards for multi-agents to control duration of traffic lights. A learning agent traffic light gets information along its lanes within a circular V2X coverage. The duration cycles of traffic light are modeled as Markov decision Processes. We investigate four variations of reward functions. The first two are unshared-rewards: based on waiting number, and waiting time of vehicles between two cycles of traffic light. The third and fourth functions are: shared-rewards based on waiting cars, and waiting time for all agents. Each agent has a memory for optimization through target network and prioritized experience replay. We evaluate multi-agents through the Simulation of Urban MObility (SUMO) simulator. The results prove effectiveness of the proposed system to optimize traffic signals and reduce average waiting cars to 41.5 % as compared to the traditional periodic traffic control system.


Performance Analysis of Combine Harvester using Hybrid Model of Artificial Neural Networks Particle Swarm Optimization

arXiv.org Machine Learning

Novel applications of artificial intelligence for tuning the parameters of industrial machines for optimal performance are emerging at a fast pace. Tuning the combine harvesters and improving the machine performance can dramatically minimize the wastes during harvesting, and it is also beneficial to machine maintenance. Literature includes several soft computing, machine learning and optimization methods that had been used to model the function of harvesters of various crops. Due to the complexity of the problem, machine learning methods had been recently proposed to predict the optimal performance with promising results. In this paper, through proposing a novel hybrid machine learning model based on artificial neural networks integrated with particle swarm optimization (ANN-PSO), the performance analysis of a common combine harvester is presented. The hybridization of machine learning methods with soft computing techniques has recently shown promising results to improve the performance of the combine harvesters. This research aims at improving the results further by providing more stable models with higher accuracy.


Finite-Time Last-Iterate Convergence for Multi-Agent Learning in Games

arXiv.org Machine Learning

We consider multi-agent learning via online gradient descent (OGD) in a class of games called $\lambda$-cocoercive games, a broad class of games that admits many Nash equilibria and that properly includes strongly monotone games. We characterize the finite-time last-iterate convergence rate for joint OGD learning on $\lambda$-cocoercive games; further, building on this result, we develop a fully adaptive OGD learning algorithm that does not require any knowledge of the problem parameter (e.g., the cocoercive constant $\lambda$) and show, via a novel double-stopping-time technique, that this adaptive algorithm achieves the same finite-time last-iterate convergence rate as its non-adaptive counterpart. Subsequently, we extend OGD learning to the noisy gradient feedback case and establish last-iterate convergence results---first qualitative almost sure convergence, then quantitative finite-time convergence rates---all under non-decreasing step-sizes. These results fill in several gaps in the existing multi-agent online learning literature, where three aspects---finite-time convergence rates, non-decreasing step-sizes, and fully adaptive algorithms---have not been previously explored.


Signature in Counterparts, a Formal Treatment

arXiv.org Artificial Intelligence

"Smart contracts" are a form of code, in the context of cryptocurrency and blockchain platforms, that is used to enforce security properties of multi-agent protocols. Often these protocols are for processes for which trust amongst the agents would typically have been provided through the use of legal contracts. The emergence of the area of "smart contracts" has given renewed motivation to study the formal representation of legal reasoning and legal processes. In the present paper, we consider questions of knowledge representation pertinent to a particular legal process: contract signature. In formation of legal contracts between two or more parties, all parties to the contract are required to sign in order for the contract to be considered valid. In some sensitive situations, this requires a physical meeting of the parties so that copies of the contract can be signed and immediately exchanged for co-signature. An example of such a sensitive situation is where one party may gain advantage in a negotiation with a third party by presentation of a partially signed contract. It is also frequently desirable to establish a state of common knowledge amongst the parties that the contract has been signed and that the signers were authenticated: a physical signing ceremony achieves this goal.


Emergent Communication with World Models

arXiv.org Artificial Intelligence

We introduce Language World Models, a class of language-conditional generative model which interpret natural language messages by predicting latent codes of future observations. This provides a visual grounding of the message, similar to an enhanced observation of the world, which may include objects outside of the listening agent's field-of-view. We incorporate this "observation" into a persistent memory state, and allow the listening agent's policy to condition on it, akin to the relationship between memory and controller in a World Model. We show this improves effective communication and task success in 2D gridworld speaker-listener navigation tasks. In addition, we develop two losses framed specifically for our model-based formulation to promote positive signalling and positive listening. Finally, because messages are interpreted in a generative model, we can visualize the model beliefs to gain insight into how the communication channel is utilized.


A characterization of proportionally representative committees

arXiv.org Artificial Intelligence

When voters elicit ranked preferences over candidates, one particular axiom for proportional representation is Proportionality of Solid Coalitions (PSC). This axiom was advocated by Dummett [4] and has been referred to as the most important requirement for proportional representation [15, 16, 18, 19]. PSC is the subject of many theoretical and empirical studies. Theoretical studies have focused on designing voting rules that satisfy PSC; these include single transferable vote (STV) [15], Quota Borda System (QBS) [4], Schulz-STV [14], and the Expanding Approvals Rule (EAR) [2].


Publications

#artificialintelligence

Inceoglu I, Thomas G, Chu C, Plans D, Gerbasi A (2018). Leadership behavior and employee well-being: an integrated review and a future research agenda. Lopez D, Brown AW, Plans D. (2019). Modelling and simulation of operation and maintenance strategy for offshore wind farms based on multiagent system. Murphy J, Brewer R, Coll M-P, Plans D, Hall M, Shiu SS, Catmur C, Bird G. (2019).


Researchers Improve Robotic Arm Used in Surgery

#artificialintelligence

Facebook has recently created an algorithm that enhances an AI agent's ability to navigate an environment, letting the agent determine the shortest route through new environments without access to a map. While mobile robots typically have a map programmed into them, the new algorithm that Facebook designed could enable the creation of robots that can navigate environments without the need for maps. According to a post created by Facebook researchers, a major challenge for robot navigation is endowing AI systems with the ability to navigate through novel environments and reaching programmed destinations without a map. In order to tackle this challenge, Facebook created a reinforcement learning algorithm distributed across multiple learners. The algorithm was called decentralized distributed proximal policy optimization (DD-PPO).


Comprehensive Taxonomies of Nature- and Bio-inspired Optimization: Inspiration versus Algorithmic Behavior, Critical Analysis and Recommendations

arXiv.org Artificial Intelligence

In recent years, a great variety of nature- and bio-inspired algorithms has been reported in the literature. This algorithmic family simulates different biological processes observed in Nature in order to efficiently address complex optimization problems. In the last years the number of bio-inspired optimization approaches in literature has grown considerably, reaching unprecedented levels that dark the future prospects of this field of research. This paper addresses this problem by proposing two comprehensive, principle-based taxonomies that allow researchers to organize existing and future algorithmic developments into well-defined categories, considering two different criteria: the source of inspiration and the behavior of each algorithm. Using these taxonomies we review more than three hundred publications dealing with nature-inspired and bio-inspired algorithms, and proposals falling within each of these categories are examined, leading to a critical summary of design trends and similarities between them, and the identification of the most similar classical algorithm for each reviewed paper. From our analysis we conclude that a poor relationship is often found between the natural inspiration of an algorithm and its behavior. Furthermore, similarities in terms of behavior between different algorithms are greater than what is claimed in their public disclosure: specifically, we show that more than one-third of the reviewed bio-inspired solvers are versions of classical algorithms. Grounded on the conclusions of our critical analysis, we give several recommendations and points of improvement for better methodological practices in this active and growing research field.