Goto

Collaborating Authors

 Agents


Distinction Between Agent-Based mostly and Community-Based mostly Inner Vulnerability Scanning - Channel969

#artificialintelligence

For years, the 2 hottest strategies for inside scanning: agent-based and network-based had been thought-about to be about equal in worth, every bringing its personal strengths to bear. Nevertheless, with distant working now the norm in most if not all workplaces, it feels much more like agent-based scanning is a should, whereas network-based scanning is an non-obligatory additional. This text will go in-depth on the strengths and weaknesses of every method, however let's wind it again a second for many who aren't certain why they need to even do inside scanning within the first place. Whereas exterior vulnerability scanning can provide an excellent overview of what you appear to be to a hacker, the knowledge that may be gleaned with out entry to your programs will be restricted. Some critical vulnerabilities will be found at this stage, so it is a should for a lot of organizations, however that is not the place hackers cease.


Controllability of Coarsely Measured Networked Linear Dynamical Systems (Extended Version)

arXiv.org Machine Learning

We consider the controllability of large-scale linear networked dynamical systems when complete knowledge of network structure is unavailable and knowledge is limited to coarse summaries. We provide conditions under which average controllability of the fine-scale system can be well approximated by average controllability of the (synthesized, reduced-order) coarse-scale system. To this end, we require knowledge of some inherent parametric structure of the fine-scale network that makes this type of approximation possible. Therefore, we assume that the underlying fine-scale network is generated by the stochastic block model (SBM) -- often studied in community detection. We then provide an algorithm that directly estimates the average controllability of the fine-scale system using a coarse summary of SBM. Our analysis indicates the necessity of underlying structure (e.g., in-built communities) to be able to quantify accurately the controllability from coarsely characterized networked dynamics. We also compare our method to that of the reduced-order method and highlight the regimes where both can outperform each other. Finally, we provide simulations to confirm our theoretical results for different scalings of network size and density, and the parameter that captures how much community-structure is retained in the coarse summary.


Conformal Prediction Intervals for Markov Decision Process Trajectories

arXiv.org Machine Learning

Before delegating a task to an autonomous system, a human operator may want a guarantee about the behavior of the system. This paper extends previous work on conformal prediction for functional data and conformalized quantile regression to provide conformal prediction intervals over the future behavior of an autonomous system executing a fixed control policy on a Markov Decision Process (MDP). The prediction intervals are constructed by applying conformal corrections to prediction intervals computed by quantile regression. The resulting intervals guarantee that with probability $1-\delta$ the observed trajectory will lie inside the prediction interval, where the probability is computed with respect to the starting state distribution and the stochasticity of the MDP. The method is illustrated on MDPs for invasive species management and StarCraft2 battles.


MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge

#artificialintelligence

Autonomous agents have made great strides in specialist domains like Atari games and Go. However, they typically learn tabula rasa in isolated environments with limited and manually conceived objectives, thus failing to generalize across a wide spectrum of tasks and capabilities. Inspired by how humans continually learn and adapt in the open world, we advocate a trinity of ingredients for building generalist agents: 1) an environment that supports a multitude of tasks and goals, 2) a large-scale database of multimodal knowledge, and 3) a flexible and scalable agent architecture. We introduce MineDojo, a new framework built on the popular Minecraft game that features a simulation suite with thousands of diverse open-ended tasks and an internet-scale knowledge base with Minecraft videos, tutorials, wiki pages, and forum discussions. Using MineDojo's data, we propose a novel agent learning algorithm that leverages large pre-trained video-language models as a learned reward function. Our agent is able to solve a variety of open-ended tasks specified in free-form language without any manually designed dense shaping reward. We open-source the simulation suite and knowledge bases (https://minedojo.org) to promote research towards the goal of generally capable embodied agents.


Distributional Hamilton-Jacobi-Bellman Equations for Continuous-Time Reinforcement Learning

arXiv.org Machine Learning

Continuous-time reinforcement learning offers an appealing formalism for describing control problems in which the passage of time is not naturally divided into discrete increments. Here we consider the problem of predicting the distribution of returns obtained by an agent interacting in a continuous-time, stochastic environment. Accurate return predictions have proven useful for determining optimal policies for risk-sensitive control, learning state representations, multiagent coordination, and more. We begin by establishing the distributional analogue of the Hamilton-Jacobi-Bellman (HJB) equation for It\^o diffusions and the broader class of Feller-Dynkin processes. We then specialize this equation to the setting in which the return distribution is approximated by $N$ uniformly-weighted particles, a common design choice in distributional algorithms. Our derivation highlights additional terms due to statistical diffusivity which arise from the proper handling of distributions in the continuous-time setting. Based on this, we propose a tractable algorithm for approximately solving the distributional HJB based on a JKO scheme, which can be implemented in an online control algorithm. We demonstrate the effectiveness of such an algorithm in a synthetic control problem.


Difference Between Agent-Based and Network-Based Internal Vulnerability Scanning

#artificialintelligence

For years, the two most popular methods for internal scanning: agent-based and network-based were considered to be about equal in value, each bringing its own strengths to bear. However, with remote working now the norm in most if not all workplaces, it feels a lot more like agent-based scanning is a must, while network-based scanning is an optional extra. This article will go in-depth on the strengths and weaknesses of each approach, but let's wind it back a second for those who aren't sure why they should even do internal scanning in the first place. While external vulnerability scanning can give a great overview of what you look like to a hacker, the information that can be gleaned without access to your systems can be limited. Some serious vulnerabilities can be discovered at this stage, so it's a must for many organizations, but that's not where hackers stop.


Intelligent agents in network operations – Ericsson

#artificialintelligence

In the technology industry, the word'intelligent' typically refers to applying AI techniques such as machine learning (ML) and deep reinforcement …


Border Patrol agents fume as DHS prepares to punish officers caught up in 'whip' controversy: 'Bull----'

FOX News

Fox News contributor Sean Duffy slams the Biden administration for not supporting individuals who uphold the rule of law, including border patrol. EXCLUSIVE: Border Patrol agents are furious after it has emerged that the Department of Homeland Security is expected to punish multiple agents who were caught up in since-debunked allegations that they whipped Haitian migrants in Del Rio last year – exacerbating already rock-bottom morale among agents who see a politicized investigation designed to deliver a result for the White House. "What we're seeing right now is the executive branch weaponizing the Office of Professional Responsibility to go after what President Biden perceives as political opponents," National Border Patrol Council President Brandon Judd told Fox News Digital. He has never liked the mission of the Border Patrol. And now he is going after these agents because he panders to open border activists.


Calibrating Agent-based Models to Microdata with Graph Neural Networks

arXiv.org Machine Learning

Calibrating agent-based models (ABMs) to data is among the most fundamental requirements to ensure the model fulfils its desired purpose. In recent years, simulation-based inference methods have emerged as powerful tools for performing this task when the model likelihood function is intractable, as is often the case for ABMs. In some real-world use cases of ABMs, both the observed data and the ABM output consist of the agents' states and their interactions over time. In such cases, there is a tension between the desire to make full use of the rich information content of such granular data on the one hand, and the need to reduce the dimensionality of the data to prevent difficulties associated with high-dimensional learning tasks on the other. A possible resolution is to construct lower-dimensional time-series through the use of summary statistics describing the macrostate of the system at each time point. However, a poor choice of summary statistics can result in an unacceptable loss of information from the original dataset, dramatically reducing the quality of the resulting calibration. In this work, we instead propose to learn parameter posteriors associated with granular microdata directly using temporal graph neural networks. We will demonstrate that such an approach offers highly compelling inductive biases for Bayesian inference using the raw ABM microstates as output.


Cooperation and Learning Dynamics under Wealth Inequality and Diversity in Individual Risk

Journal of Artificial Intelligence Research

We examine how wealth inequality and diversity in the perception of risk of a collective disaster impact cooperation levels in the context of a public goods game with uncertain and non-linear returns. In this game, individuals face a collective-risk dilemma where they may contribute or not to a common pool to reduce their chances of future losses. We draw our conclusions based on social simulations with populations of independent reinforcement learners with diverse levels of risk and wealth. We find that both wealth inequality and diversity in risk assessment can hinder cooperation and augment collective losses. Additionally, wealth inequality further exacerbates long term inequality, causing rich agents to become richer and poor agents to become poorer. On the other hand, diversity in risk only amplifies inequality when combined with bias in group assortment--i.e., high probability that agents from the same risk class play together. Our results also suggest that taking wealth inequality into account can help to design effective policies aiming at leveraging cooperation in large group sizes, a configuration where collective action is harder to achieve. Finally, we characterize the circumstances under which risk perception alignment is crucial and those under which reducing wealth inequality constitutes a deciding factor for collective welfare.