Realizing the vision of using AI agents to automate critical IT tasks depends on the ability to measure and understand effectiveness of proposed solutions. We introduce ITBench, a framework that offers a systematic methodology for benchmarking AI agents to address real-world IT automation tasks. Our initial release targets three key areas: Site Reliability Engineering (SRE), Compliance and Security Operations (CISO), and Financial Operations (FinOps). The design enables AI researchers to understand the challenges and opportunities of AI agents for IT automation with push-button workflows and interpretable metrics. ITBench includes an initial set of 94 real-world scenarios, which can be easily extended by community contributions. Our results show that agents powered by state-of-the-art models resolve only 13.8% of SRE scenarios, 25.2% of CISO scenarios, and 0% of FinOps scenarios. We expect ITBench to be a key enabler of AI-driven IT automation that is correct, safe, and fast.

A handful of important trends will transform the software developer experience in 2023, as enterprises consider more self-hosting, observe more SaaS consolidations and see an upswing of interest in creative AI. Also, as AI enters the creativity realm, it threatens to upend the future of app dev. And OpenAI's Chat GPT, released in November, takes code completion beyond line suggestions -- in addition to writing complete web pages and simple applications, it can generate new programming languages. For developers, the 2022 job market started strong, but by December, they saw storm clouds as layoffs hit the tech sector. Experts felt vibes of the early 2000s recession and the pandemic's early days.

We have the vision of a world where each day is safer and more secure than the one before. These aren't easy goals to accomplish – but we're not here for easy. We are a company built on the foundation of challenging and disrupting the way things are done, and we're looking for innovators who are as committed to shaping the future of cybersecurity as we are. Palo Alto Networks is evolving to meet the needs of our employees now and in the future through FLEXWORK, our approach to how we work. And because it FLEXes around each individual employee based on their individual choices, employees are empowered to push boundaries and help us all evolve, together.