Dutta, Praneet
Preserving Product Fidelity in Large Scale Image Recontextualization with Diffusion Models
Malhi, Ishaan, Dutta, Praneet, Talius, Ellie, Ma, Sally, Driscoll, Brendan, Holden, Krista, Pruthi, Garima, Narayanaswamy, Arunachalam
Figure 1: Given a few input images of a real world product, our system can generate images that not only maintain high fidelity to the original product, but also recontextualize it in novel settings beyond background changes: from showcasing it in a new perspective, adding object occlusions, to creating different and realistic lighting conditions. We present a framework for high-fidelity product image recontextualization using text-to-image diffusion models and a novel data augmentation pipeline. This pipeline leverages image-to-video diffusion, in/outpainting & negatives to create synthetic training data, addressing limitations of real-world data collection for this task. Our method improves the quality and diversity of generated images by disentangling product representations and enhancing the model's understanding of product characteristics. Evaluation on the ABO dataset and a private product dataset, using automated metrics and human assessment, demonstrates the effectiveness of our framework in generating realistic and compelling product visualizations, with implications for applications such as e-commerce and virtual product showcasing.
Growing Cosine Unit: A Novel Oscillatory Activation Function That Can Speedup Training and Reduce Parameters in Convolutional Neural Networks
Noel, Mathew Mithra, L, Arunkumar, Trivedi, Advait, Dutta, Praneet
Convolutional neural networks have been successful in solving many socially important and economically significant problems. This ability to learn complex high-dimensional functions hierarchically can be attributed to the use of nonlinear activation functions. A key discovery that made training deep networks feasible was the adoption of the Rectified Linear Unit (ReLU) activation function to alleviate the vanishing gradient problem caused by using saturating activation functions. Since then, many improved variants of the ReLU activation have been proposed. However, a majority of activation functions used today are non-oscillatory and monotonically increasing due to their biological plausibility. This paper demonstrates that oscillatory activation functions can improve gradient flow and reduce network size. Two theorems on limits of non-oscillatory activation functions are presented. A new oscillatory activation function called Growing Cosine Unit(GCU) defined as $C(z) = z\cos z$ that outperforms Sigmoids, Swish, Mish and ReLU on a variety of architectures and benchmarks is presented. The GCU activation has multiple zeros enabling single GCU neurons to have multiple hyperplanes in the decision boundary. This allows single GCU neurons to learn the XOR function without feature engineering. Experimental results indicate that replacing the activation function in the convolution layers with the GCU activation function significantly improves performance on CIFAR-10, CIFAR-100 and Imagenette.
Controlling Commercial Cooling Systems Using Reinforcement Learning
Luo, Jerry, Paduraru, Cosmin, Voicu, Octavian, Chervonyi, Yuri, Munns, Scott, Li, Jerry, Qian, Crystal, Dutta, Praneet, Davis, Jared Quincy, Wu, Ningjia, Yang, Xingwei, Chang, Chu-Ming, Li, Ted, Rose, Rob, Fan, Mingyan, Nakhost, Hootan, Liu, Tinglin, Kirkman, Brian, Altamura, Frank, Cline, Lee, Tonker, Patrick, Gouker, Joel, Uden, Dave, Bryan, Warren Buddy, Law, Jason, Fatiha, Deeni, Satra, Neil, Rothenberg, Juliet, Waraich, Mandeep, Carlin, Molly, Tallapaka, Satish, Witherspoon, Sims, Parish, David, Dolan, Peter, Zhao, Chenyu, Mankowitz, Daniel J.
This paper is a technical overview of DeepMind and Google's recent work on reinforcement learning for controlling commercial cooling systems. Building on expertise that began with cooling Google's data centers more efficiently, we recently conducted live experiments on two real-world facilities in partnership with Trane Technologies, a building management system provider. These live experiments had a variety of challenges in areas such as evaluation, learning from offline data, and constraint satisfaction. Our paper describes these challenges in the hope that awareness of them will benefit future applied RL work. We also describe the way we adapted our RL system to deal with these challenges, resulting in energy savings of approximately 9% and 13% respectively at the two live experiment sites.
Game Plan: What AI can do for Football, and What Football can do for AI
Tuyls, Karl, Omidshafiei, Shayegan, Muller, Paul, Wang, Zhe, Connor, Jerome, Hennes, Daniel, Graham, Ian, Spearman, William, Waskett, Tim, Steele, Dafydd, Luc, Pauline, Recasens, Adria, Galashov, Alexandre, Thornton, Gregory, Elie, Romuald, Sprechmann, Pablo, Moreno, Pol, Cao, Kris, Garnelo, Marta, Dutta, Praneet, Valko, Michal, Heess, Nicolas, Bridgland, Alex, Perolat, Julien, De Vylder, Bart, Eslami, Ali, Rowland, Mark, Jaegle, Andrew, Munos, Remi, Back, Trevor, Ahamed, Razia, Bouton, Simon, Beauguerlange, Nathalie, Broshear, Jackson, Graepel, Thore, Hassabis, Demis
The rapid progress in artificial intelligence (AI) and machine learning has opened unprecedented analytics possibilities in various team and individual sports, including baseball, basketball, and tennis. More recently, AI techniques have been applied to football, due to a huge increase in data collection by professional teams, increased computational power, and advances in machine learning, with the goal of better addressing new scientific challenges involved in the analysis of both individual players' and coordinated teams' behaviors. The research challenges associated with predictive and prescriptive football analytics require new developments and progress at the intersection of statistical learning, game theory, and computer vision. In this paper, we provide an overarching perspective highlighting how the combination of these fields, in particular, forms a unique microcosm for AI research, while offering mutual benefits for professional teams, spectators, and broadcasters in the years to come. We illustrate that this duality makes football analytics a game changer of tremendous value, in terms of not only changing the game of football itself, but also in terms of what this domain can mean for the field of AI. We review the state-of-the-art and exemplify the types of analysis enabled by combining the aforementioned fields, including illustrative examples of counterfactual analysis using predictive models, and the combination of game-theoretic analysis of penalty kicks with statistical learning of player attributes. We conclude by highlighting envisioned downstream impacts, including possibilities for extensions to other sports (real and virtual).
AutoML for Contextual Bandits
Dutta, Praneet, Kit, Man, Cheuk, null, Kim, Jonathan S, Mascaro, Massimo
Contextual Bandits is one of the widely popular techniques used in applications such as personalization, recommendation systems, mobile health, causal marketing etc . As a dynamic approach, it can be more efficient than standard A/B testing in minimizing regret. We propose an end to end automated meta-learning pipeline to approximate the optimal Q function for contextual bandits problems. We see that our model is able to perform much better than random exploration, being more regret efficient and able to converge with a limited number of samples, while remaining very general and easy to use due to the meta-learning approach. We used a linearly annealed e-greedy exploration policy to define the exploration vs exploitation schedule. We tested the system on a synthetic environment to characterize it fully and we evaluated it on some open source datasets to benchmark against prior work. We see that our model outperforms or performs comparatively to other models while requiring no tuning nor feature engineering.