Education
Reports of the Workshops Held at the 2025 AAAI Conference on Artificial Intelligence
The Workshop Program of the Association for the Advancement of Artificial Intelligence's 39th Conference on Artificial Intelligence (AAAI-25) was held in Philadelphia, Pennsylvania, on February 25 - March 4, 2025. TIKA is envisioned to create an open knowledge resource and serve as a hub for research, education and training on knowledge representation and knowledge engineering. Over 50 AI researchers convened at the workshop over two days. The discussions focused on different aspects of creating an open knowledge resource including foundational knowledge, automated reasoning, knowledge curation, education on knowledge axiomatization, and evaluation of outcomes. The opening discussion confirmed that the idea of curated knowledge, that is, knowledge captured in an expressive formal language that can be explicitly examined and verified by humans, is compelling. It must, however, be situated in the modern context of AI. Such a resource should address the limitations of existing generative ...
Learning with Fredholm Kernels
Qichao Que, Mikhail Belkin, Yusu Wang
In this paper we propose a framework for supervised and semi-supervised learning based on reformulating the learning problem as a regularized Fredholm integral equation. Our approach fits naturally into the kernel framework and can be interpreted as constructing new data-dependent kernels, which we call Fredholm kernels. We proceed to discuss the "noise assumption" for semi-supervised learning and provide both theoretical and experimental evidence that Fredholm kernels can effectively utilize unlabeled data under the noise assumption. We demonstrate that methods based on Fredholm learning show very competitive performance in the standard semi-supervised learning setting.
Scalable Kernel Methods via Doubly Stochastic Gradients
The general perception is that kernel methods are not scalable, so neural nets become the choice for large-scale nonlinear learning problems. Have we tried hard enough for kernel methods? In this paper, we propose an approach that scales up kernel methods using a novel concept called " doubly stochastic functional gradients ". Based on the fact that many kernel methods can be expressed as convex optimization problems, our approach solves the optimization problems by making two unbiased stochastic approximations to the functional gradient--one using random training points and another using random features associated with the kernel--and performing descent steps with this noisy functional gradient. Our algorithm is simple, need no commit to a preset number of random features, and allows the flexibility of the function class to grow as we see more incoming data in the streaming setting. We demonstrate that a function learned by this procedure after t iterations converges to the optimal function in the reproducing kernel Hilbert space in rate O (1/t), and achieves a generalization bound of O (1 / t). Our approach can readily scale kernel methods up to the regimes which are dominated by neural nets. We show competitive performances of our approach as compared to neural nets in datasets such as 2.3 million energy materials from MolecularSpace, 8 million handwritten digits from MNIST, and 1 million photos from ImageNet using convolution features.