Government
Efficient Vision Transformer for Human Pose Estimation via Patch Selection
While Convolutional Neural Networks (CNNs) have been widely successful in 2D human pose estimation, Vision Transformers (ViTs) have emerged as a promising alternative to CNNs, boosting state-of-the-art performance. However, the quadratic computational complexity of ViTs has limited their applicability for processing high-resolution images. In this paper, we propose three methods for reducing ViT's computational complexity, which are based on selecting and processing a small number of most informative patches while disregarding others. The first two methods leverage a lightweight pose estimation network to guide the patch selection process, while the third method utilizes a set of learnable joint tokens to ensure that the selected patches contain the most important information about body joints. Experiments across six benchmarks show that our proposed methods achieve a significant reduction in computational complexity, ranging from 30% to 44%, with only a minimal drop in accuracy between 0% and 3.5%.
Bayesian Prognostic Covariate Adjustment With Additive Mixture Priors
Vanderbeek, Alyssa M., Sabbaghi, Arman, Walsh, Jon R., Fisher, Charles K.
Effective and rapid decision-making from randomized controlled trials (RCTs) requires unbiased and precise treatment effect inferences. Two strategies to address this requirement are to adjust for covariates that are highly correlated with the outcome, and to leverage historical control information via Bayes' theorem. We propose a new Bayesian prognostic covariate adjustment methodology, referred to as Bayesian PROCOVA, that combines these two strategies. Covariate adjustment in Bayesian PROCOVA is based on generative artificial intelligence (AI) algorithms that construct a digital twin generator (DTG) for RCT participants. The DTG is trained on historical control data and yields a digital twin (DT) probability distribution for each RCT participant's outcome under the control treatment. The expectation of the DT distribution, referred to as the prognostic score, defines the covariate for adjustment. Historical control information is leveraged via an additive mixture prior with two components: an informative prior probability distribution specified based on historical control data, and a weakly informative prior distribution. The mixture weight determines the extent to which posterior inferences are drawn from the informative component, versus the weakly informative component. This weight has a prior distribution as well, and so the entire additive mixture prior is completely pre-specifiable without involving any RCT information. We establish an efficient Gibbs algorithm for sampling from the posterior distribution, and derive closed-form expressions for the posterior mean and variance of the treatment effect parameter conditional on the weight, in Bayesian PROCOVA. We evaluate efficiency gains of Bayesian PROCOVA via its bias control and variance reduction compared to frequentist PROCOVA in simulation studies that encompass different discrepancies. These gains translate to smaller RCTs.
Ensemble transport smoothing. Part II: Nonlinear updates
Ramgraber, Maximilian, Baptista, Ricardo, McLaughlin, Dennis, Marzouk, Youssef
Sequential Monte Carlo methods can characterize arbitrary distributions using sequential importance sampling and resampling, but typically require very large sample sizes to mitigate weight collapse [Snyder et al., 2008, 2015]. By contrast, ensemble Kalman-type methods avoid the use of weights, but are based on affine prior-to-posterior updates that are consistent only if all distributions involved are Gaussian. In the context of smoothing, such methods include the ensemble Kalman smoother (EnKS) [Evensen and Van Leeuwen, 2000], which has inspired numerous algorithmic variations such as the ensemble smoother with multiple data assimilation [Emerick and Reynolds, 2013] and the iterative ensemble Kalman smoother (iEnKS) [Bocquet and Sakov, 2014, Evensen et al., 2019], as well as backwards smoothers such as the ensemble Rauch-Tung-Striebel smoother (EnRTSS) [Raanes, 2016]. These two classes of methods occupy opposite ends of a spectrum that ranges from an emphasis on statistical generality at one end to an emphasis on computational efficiency at the other. This trade-off complicates design decisions for smoothing problems that are at once non-Gaussian and computationally expensive.
Ensemble transport smoothing. Part I: Unified framework
Ramgraber, Maximilian, Baptista, Ricardo, McLaughlin, Dennis, Marzouk, Youssef
Smoothers are algorithms for Bayesian time series re-analysis. Most operational smoothers rely either on affine Kalman-type transformations or on sequential importance sampling. These strategies occupy opposite ends of a spectrum that trades computational efficiency and scalability for statistical generality and consistency: non-Gaussianity renders affine Kalman updates inconsistent with the true Bayesian solution, while the ensemble size required for successful importance sampling can be prohibitive. This paper revisits the smoothing problem from the perspective of measure transport, which offers the prospect of consistent prior-to-posterior transformations for Bayesian inference. We leverage this capacity by proposing a general ensemble framework for transport-based smoothing. Within this framework, we derive a comprehensive set of smoothing recursions based on nonlinear transport maps and detail how they exploit the structure of state-space models in fully non-Gaussian settings. We also describe how many standard Kalman-type smoothing algorithms emerge as special cases of our framework. A companion paper (Ramgraber et al., 2023) explores the implementation of nonlinear ensemble transport smoothers in greater depth.
EXCLUSIVE: Retired US Army Colonel says secret UFO projects should be made public by October 2030 - to beat America's rivals and get ahead of a 'catastrophic' leak
Nearly two decades ago, a think-tank in Washington D.C. invited past and present government officials from the CIA, the Defense Intelligence Agency (DIA), the Pentagon and elsewhere to debate the risks of revealing the truth about UFOs. The 2004 event -- according to a former CIA scientist who went public with the shocking story Friday -- broke into working groups to weigh the positive and negative ramifications of declassifying America's top secret UFO programs. Every working group according to that scientist, Dr. Hal Puthoff, came back with the same conclusion: the societal risks of UFO'disclosure' were just too great. But now, a host of Washington insiders are calling for a strategic'campaign' to drag these alleged UFO reverse-engineering programs out into public view. The Sol Foundation, a new nonprofit dedicated to exploring the broad implications of what are now called'Unidentified Anomalous Phenomena' or UAP, convened its first ever symposium Friday, sponsored by Stanford University's School of Medicine Sol's lofty goal, as described by its chief operating officer - the now famous UFO whistleblower and US Air Force and intel veteran David Grusch - is to'open ourselves to a future where truth, unity, technological advancements and a deeper understanding of our existence converge' The pivot emerged this weekend at an invite-only conference of former government officials, tenured physicists and other academic researchers, activists and reporters, held at Stanford University and attended by DailyMail.com. The most explosive moments from the UFO event -- the first ever symposium of the new nonprofit Sol Foundation, which is dedicated to exploring the broad implications of what are now called'Unidentified Anomalous Phenomena' or UAP -- came from recently retired US Army Colonel Karl E. Nell.
Ex-California Gov Jerry Brown snubs Kamala Harris when asked opinion of her: 'Do not have a thought on that'
'The Big Weekend' panelists discuss rumors around Vice President Kamala Harris's future as predictions mount that former First Lady Michelle Obama could replace President Biden. Former Democratic California Gov. Jerry Brown refused to comment on Vice President Kamala Harris after expressing confidence in President Biden as the "man of the hour," during a recent media interview. While talking about President Biden and overall feelings of the electorate, Brown told NBC News in a recent interview that the president was the "man of the hour." "I would say he's the man of the hour. He's there," Brown said, adding that he didn't have a political strategy for the Democrats.
Meta is giving researchers more access to Facebook and Instagram data
In an interview, Meta's president of global affairs, Nick Clegg, said the tools "are really quite important" in that they provide, in a lot of ways, "the most comprehensive access to publicly available content across Facebook and Instagram of anything that we've built to date." The Content Library will also help the company meet new regulatory requirements and obligations on data sharing and transparency, as the company notes in a blog post Tuesday. The library and associated API were first released as a beta version several months ago and allow researchers to access near-real-time data about pages, posts, groups, and events on Facebook and creator and business accounts on Instagram, as well as the associated numbers of reactions, shares, comments, and post view counts. While all this data is publicly available--as in, anyone can see public posts, reactions, and comments on Facebook--the new library makes it easier for researchers to search and analyze this content at scale. Meta says that to protect user privacy, this data will be accessible only through a virtual "clean room" and not downloadable.
To protect children, we need to fill these gaps in AI policy
Canopy CMO Yaron Litwin discusses how criminals are using deepfake technology to blackmail teens and generate child pornography. Today's hot trend for policymakers is talking about artificial intelligence. This incredibly powerful technology is here to stay, and new research shows that most of us are optimistic about how generative AI will be able to improve our lives. But there are some new and concerning threats to which policymakers must pay attention. This includes a horrific misuse of this positive tech: bad actors abusing AI to put real people in sexually explicit situations, including minors.
Moderating Model Marketplaces: Platform Governance Puzzles for AI Intermediaries
The AI development community is increasingly making use of hosting intermediaries such as Hugging Face provide easy access to user-uploaded models and training data. These model marketplaces lower technical deployment barriers for hundreds of thousands of users, yet can be used in numerous potentially harmful and illegal ways. In this article, we explain ways in which AI systems, which can both `contain' content and be open-ended tools, present one of the trickiest platform governance challenges seen to date. We provide case studies of several incidents across three illustrative platforms -- Hugging Face, GitHub and Civitai -- to examine how model marketplaces moderate models. Building on this analysis, we outline important (and yet nevertheless limited) practices that industry has been developing to respond to moderation demands: licensing, access and use restrictions, automated content moderation, and open policy development. While the policy challenge at hand is a considerable one, we conclude with some ideas as to how platforms could better mobilize resources to act as a careful, fair, and proportionate regulatory access point.
Machine-learning-accelerated simulations to enable automatic surface reconstruction
Du, Xiaochen, Damewood, James K., Lunger, Jaclyn R., Millan, Reisel, Yildiz, Bilge, Li, Lin, Gómez-Bombarelli, Rafael
Understanding material surfaces and interfaces is vital in applications like catalysis or electronics. By combining energies from electronic structure with statistical mechanics, ab initio simulations can in principle predict the structure of material surfaces as a function of thermodynamic variables. However, accurate energy simulations are prohibitive when coupled to the vast phase space that must be statistically sampled. Here, we present a bi-faceted computational loop to predict surface phase diagrams of multi-component materials that accelerates both the energy scoring and statistical sampling methods. Fast, scalable, and data-efficient machine learning interatomic potentials are trained on high-throughput density-functional theory calculations through closed-loop active learning. Markov-chain Monte Carlo sampling in the semi-grand canonical ensemble is enabled by using virtual surface sites. The predicted surfaces for GaN(0001), Si(111), and SrTiO3(001) are in agreement with past work and suggest that the proposed strategy can model complex material surfaces and discover previously unreported surface terminations.