Goto

Collaborating Authors

 Technology


DELIFFAS: Deformable Light Fields for Fast Avatar Synthesis

Neural Information Processing Systems

Generating controllable and photorealistic digital human avatars is a long-standing and important problem in Vision and Graphics. Recent methods have shown great progress in terms of either photorealism or inference speed while the combination of the two desired properties still remains unsolved. To this end, we propose a novel method, called DELIFFAS, which parameterizes the appearance of the human as a surface light field that is attached to a controllable and deforming human mesh model. At the core, we represent the light field around the human with a deformable two-surface parameterization, which enables fast and accurate inference of the human appearance. This allows perceptual supervision on the full image compared to previous approaches that could only supervise individual pixels or small patches due to their slow runtime. Our carefully designed human representation and supervision strategy leads to state-of-the-art synthesis results and inference time. The video results and code are available at https://vcai.


Musk says basis of charitable giving at stake in OpenAI lawsuit

BBC News

A trial pitting two founders of OpenAI - Sam Altman and Elon Musk - against each other has opened in California, with the sides presenting duelling narratives about the company's history and obligations to consumers. Musk, wearing a dark suit and tie, was asked by one of his lawyers what the lawsuit was about when he took the stand. It's actually very simple, he said. It's not okay to steal a charity... If it's okay to loot a charity, the entire foundation of charitable giving will be destroyed.


iOS 27 will reportedly come with new AI-powered photo editing tools

Engadget

You can currently use the Photos app across Apple's operating systems to adjust things like saturation and contrast, apply filters, crop photos or use AI to remove objects with the Clean Up tool . Clean Up will apparently be one of several Apple Intelligence Tools after these new updates roll out, writes. Along with Clean Up, users will be able to use Extend to expand the background of the photo with generative AI, Enhance to automatically improve things like lighting and image quality and Reframe to shift the perspective of a photo after it's taken, primarily for Apple's spatial photos. The new features, if released, will bring Apple's photo-editing tools more in line with competitors like Google and Samsung, though both companies still lap Apple in their willingness to create entirely generated images. Google's Magic Editor feature, which debuted in 2023, still takes the cake in terms of giving users leeway to radically add to and change their photos.


Massive explosion from Israeli operation seen in southern Lebanon

Al Jazeera

Why is Israel still in southern Lebanon? A war to shape Lebanon's future Video captured massive explosions in southern Lebanon in what the Israeli military called strikes on a Hezbollah tunnel. Other attacks happened nearby, as Israeli Defence Minister Israel Katz vowed that southern Lebanon's fate will be like Gaza's. Ukrainian drones strike Russia's Tuapse refinery for third time Qatar says using Hormuz Strait as political weapon is'unacceptable' Australia's top diplomat visits China to talk energy security


AbDiffuser: Full-Atom Generation of in vitro Functioning Antibodies

Neural Information Processing Systems

We introduce AbDiffuser, an equivariant and physics-informed diffusion model for the joint generation of antibody 3D structures and sequences. AbDiffuser is built on top of a new representation of protein structure, relies on a novel architecture for aligned proteins, and utilizes strong diffusion priors to improve the denoising process. Our approach improves protein diffusion by taking advantage of domain knowledge and physics-based constraints; handles sequence-length changes; and reduces memory complexity by an order of magnitude, enabling backbone and side chain generation.


Reference-Based POMDPs

Neural Information Processing Systems

Making good decisions in partially observable and non-deterministic scenarios is a crucial capability for robots. APartially Observable Markov Decision Process (POMDP) is a general framework for the above problem. Despite advances in POMDP solving, problems with long planning horizons and evolving environments remain difficult to solve even by the best approximate solvers today. To alleviate this difficulty, we propose a slightly modified POMDP problem, called a ReferenceBased POMDP, where the objective is to balance between maximizing the expected total reward and being close to a given reference (stochastic) policy. The optimal policy of a Reference-Based POMDP can be computed via iterative expectations using the given reference policy, thereby avoiding exhaustive enumeration of actions at each belief node of the search tree. We demonstrate theoretically that the standard POMDP under stochastic policies is related to the Reference-Based POMDP. To demonstrate the feasibility of exploiting the formulation, we present a basic algorithm REFSOLVER. Results from experiments on long-horizon navigation problems indicate that this basic algorithm substantially outperforms POMCP.


Conformalized Multiple Testing after Data-dependent Selection

Neural Information Processing Systems

The task of distinguishing individuals of interest from a vast pool of candidates using predictive models has garnered significant attention in recent years. This task can be framed as a procedure, which aims at quantifying prediction uncertainty by controlling the false discovery rate (FDR) via conformal inference. In this paper, we tackle the challenge of conformalized multiple testing after data-dependent selection procedures. To guarantee the construction of valid test statistics that accurately capture the distorted distribution resulting from the selection process, we leverage a holdout labeled set to closely emulate the selective distribution. Our approach involves adaptively picking labeled data to create a calibration set based on the stability of the selection rule.


Decentralized Matrix Sensing: Statistical Guarantees and Fast Convergence

Neural Information Processing Systems

We explore the matrix sensing problem from near-isotropic linear measurements, distributed across a network of agents modeled as an undirected graph, with no server. We provide the first study of statistical, computational/communication guarantees for a decentralized gradient algorithm that solves the (nonconvex) Burer-Monteiro type decomposition associated to the low-rank matrix estimation. With small random initialization, the algorithm displays an approximate two-phase convergence: (i) a spectral phase that aligns the iterates' column space with the underlying low-rank matrix, mimicking centralized spectral initialization (not directly implementable over networks); and (ii) a local refinement phase that diverts the iterates from certain degenerate saddle points, while ensuring swift convergence to the underlying low-rank matrix. Central to our analysis is a novel "in-network" Restricted Isometry Property which accommodates for the decentralized nature of the optimization, revealing an intriguing interplay between sample complexity, network connectivity & topology, and communication complexity.



'It's Undignified': Hundreds of Workers Training Meta's AI Could Be Laid Off

WIRED

'It's Undignified': Hundreds of Workers Training Meta's AI Could Be Laid Off More than 700 people working for a Meta contractor in Ireland are at risk of losing their jobs, documents show. Hundreds of workers in Ireland tasked with refining Meta's AI models have been told that their jobs are at risk as the company embarks on a sweeping new round of layoffs, according to documents obtained by WIRED. The affected workers are employed by the Dublin-based firm Covalen, which handles various content moderation and labeling services for Meta. The workers were informed of the layoffs over a brief video meeting on Monday afternoon and were not allowed to ask questions, according to Nick Bennett, one of the employees on the call. "We had a pretty bad feeling [before the meeting]," he says.