OpenAI's latest AI models can 'think with images' and combine tools

Earlier this week via blog post, OpenAI released their newest AI models: o3 and o4-mini. These models are the company's "smartest and most capable models to date" and their first reasoning models that can also reason when it comes to images. In short, these AI models can use an image--such as a photograph or a sketch--as part of an analysis. The models can also adjust, zoom in on, and rotate an image during reasoning. For the first time, our reasoning models can agentically use and combine every tool within ChatGPT, including web search, Python, image analysis, file interpretation, and image generation.