Plotting

Towards Tight Communication Lower Bounds for Distributed Optimisation

Neural Information Processing Systems

This problem arises naturally in large-scale distributed optimisation, where a standard solution is to apply variants of (stochastic) gradient descent. We focus on the communication complexity of this problem: our main result provides the first fully unconditional bounds on total number of bits which need to be sent and received by the N machines to solve this problem under point-to-point communication, within a given error-tolerance. Specifically, we show that (Ndlog d/N") total bits need to be communicated between the machines to find an additive -approximation to the minimum of P



Neutralizing Self-Selection Bias in Sampling for Sortition Paul Gรถlz Computer Science Department Computer Science Department Carnegie Mellon University Carnegie Mellon University Anupam Gupta

Neural Information Processing Systems

Sortition is a political system in which decisions are made by panels of randomly selected citizens. The process for selecting a sortition panel is traditionally thought of as uniform sampling without replacement, which has strong fairness properties. In practice, however, sampling without replacement is not possible since only a fraction of agents is willing to participate in a panel when invited, and different demographic groups participate at different rates. In order to still produce panels whose composition resembles that of the population, we develop a sampling algorithm that restores close-to-equal representation probabilities for all agents while satisfying meaningful demographic quotas. As part of its input, our algorithm requires probabilities indicating how likely each volunteer in the pool was to participate. Since these participation probabilities are not directly observable, we show how to learn them, and demonstrate our approach using data on a real sortition panel combined with information on the general population in the form of publicly available survey data.


A Overall procedure of consistency regularization for ABC

Neural Information Processing Systems

Supplementary Material for the Paper entitled "ABC: Auxiliary Balanced Classifier for Class-Imbalanced Semi-Supervised Learning" Figure 1 illustrates the overall procedure of consistency regularization for the ABC. Detailed procedure is described in Section 3.4 of the main paper. The pseudo code of the proposed algorithm is presented in Algorithm 1. The for loop (lines 2 14) can be run in parallel. Two types of class imbalance for the considered datasets are illustrated in Figure 2. In Figure 2 (b), we can see that each minority class has a very small amount of data. Existing SSL algorithms can be significantly biased toward majority classes under step imbalanced settings.



Appendix

Neural Information Processing Systems

In this section, we provide and expand upon a toy example. Example 5. Suppose that the regulatory guideline requires that users in the same geographical location receive similar weather forecasts. This can be written as "the weather forecasts that are selected by F should be similar for all users in the same geographical location", and S could be a randomly generated set of user pairs, where each pair corresponds to two (hypothetical) users in the same geographical location, and S could contain pairs across many locations. The question of how to quantify "similarity" is addressed in Section 2.1. The toy example in Example 5 is illustrated in the right-most panel.


RTFormer: Efficient Design for Real-Time Semantic Segmentation with Transformer Jian Wang 1 Qiman Wu1

Neural Information Processing Systems

Recently, transformer-based networks have shown impressive results in semantic segmentation. Yet for real-time semantic segmentation, pure CNN-based approaches still dominate in this field, due to the time-consuming computation mechanism of transformer. We propose RTFormer, an efficient dual-resolution transformer for real-time semantic segmenation, which achieves better trade-off between performance and efficiency than CNN-based models. To achieve high inference efficiency on GPU-like devices, our RTFormer leverages GPU-Friendly Attention with linear complexity and discards the multi-head mechanism. Besides, we find that cross-resolution attention is more efficient to gather global context information for high-resolution branch by spreading the high level knowledge learned from low-resolution branch. Extensive experiments on mainstream benchmarks demonstrate the effectiveness of our proposed RTFormer, it achieves state-of-the-art on Cityscapes, CamVid and COCOStuff, and shows promising results on ADE20K.



Everything you need to know from Google I/O 2025

Mashable

From the opening AI-influenced intro video set to "You Get What You Give" by New Radicals to CEO Sundar Pichai's sign-off, Google I/O 2025 was packed with news and updates for the tech giant and its products. And when we say packed, we mean it, as this year's Google I/O clocked in at nearly two hours long. During that time, Google shared some big wins for its AI products, such as Gemini topping various categories on the LMArena leaderboard. Another example that Google seemed really proud of was the fact that Gemini completed Pokรฉmon Blue a few weeks ago. But, we know what you're really here for: Product updates and new product announcements.


Introducing Flow, Googles new AI video tool and Sora competitor

Mashable

Google's AI Era is officially officially here, and at the center of it is a new generative video model called Flow. At the Google I/O 2025 keynote event on May 20, Google unveiled a new suite of AI video tools, powered by state-of-the-art models. The offspring of media models Veo 3 and Imagen 4, Flow is Google's answer to OpenAI's Sora -- AI tools for a new era in video generation for filmmakers and creatives. However, unlike Sora, Flow comes with native audio generation baked right in. Pitched as an "AI filmmaking tool built for creatives, by creatives," Flow is the tech giant's latest attempt to demo the power of AI as a use case in reshaping the creative process.