Personal
Decentralized Federated Learning: A Survey on Security and Privacy
Hallaji, Ehsan, Razavi-Far, Roozbeh, Saif, Mehrdad, Wang, Boyu, Yang, Qiang
Federated learning has been rapidly evolving and gaining popularity in recent years due to its privacy-preserving features, among other advantages. Nevertheless, the exchange of model updates and gradients in this architecture provides new attack surfaces for malicious users of the network which may jeopardize the model performance and user and data privacy. For this reason, one of the main motivations for decentralized federated learning is to eliminate server-related threats by removing the server from the network and compensating for it through technologies such as blockchain. However, this advantage comes at the cost of challenging the system with new privacy threats. Thus, performing a thorough security analysis in this new paradigm is necessary. This survey studies possible variations of threats and adversaries in decentralized federated learning and overviews the potential defense mechanisms. Trustability and verifiability of decentralized federated learning are also considered in this study.
TrustLLM: Trustworthiness in Large Language Models
Sun, Lichao, Huang, Yue, Wang, Haoran, Wu, Siyuan, Zhang, Qihui, Gao, Chujie, Huang, Yixin, Lyu, Wenhan, Zhang, Yixuan, Li, Xiner, Liu, Zhengliang, Liu, Yixin, Wang, Yijue, Zhang, Zhikun, Kailkhura, Bhavya, Xiong, Caiming, Xiao, Chaowei, Li, Chunyuan, Xing, Eric, Huang, Furong, Liu, Hao, Ji, Heng, Wang, Hongyi, Zhang, Huan, Yao, Huaxiu, Kellis, Manolis, Zitnik, Marinka, Jiang, Meng, Bansal, Mohit, Zou, James, Pei, Jian, Liu, Jian, Gao, Jianfeng, Han, Jiawei, Zhao, Jieyu, Tang, Jiliang, Wang, Jindong, Mitchell, John, Shu, Kai, Xu, Kaidi, Chang, Kai-Wei, He, Lifang, Huang, Lifu, Backes, Michael, Gong, Neil Zhenqiang, Yu, Philip S., Chen, Pin-Yu, Gu, Quanquan, Xu, Ran, Ying, Rex, Ji, Shuiwang, Jana, Suman, Chen, Tianlong, Liu, Tianming, Zhou, Tianyi, Wang, William, Li, Xiang, Zhang, Xiangliang, Wang, Xiao, Xie, Xing, Chen, Xun, Wang, Xuyu, Liu, Yan, Ye, Yanfang, Cao, Yinzhi, Chen, Yong, Zhao, Yue
Large language models (LLMs), exemplified by ChatGPT, have gained considerable attention for their excellent natural language processing capabilities. Nonetheless, these LLMs present many challenges, particularly in the realm of trustworthiness. Therefore, ensuring the trustworthiness of LLMs emerges as an important topic. This paper introduces TrustLLM, a comprehensive study of trustworthiness in LLMs, including principles for different dimensions of trustworthiness, established benchmark, evaluation, and analysis of trustworthiness for mainstream LLMs, and discussion of open challenges and future directions. Specifically, we first propose a set of principles for trustworthy LLMs that span eight different dimensions. Based on these principles, we further establish a benchmark across six dimensions including truthfulness, safety, fairness, robustness, privacy, and machine ethics. We then present a study evaluating 16 mainstream LLMs in TrustLLM, consisting of over 30 datasets. Our findings firstly show that in general trustworthiness and utility (i.e., functional effectiveness) are positively related. Secondly, our observations reveal that proprietary LLMs generally outperform most open-source counterparts in terms of trustworthiness, raising concerns about the potential risks of widely accessible open-source LLMs. However, a few open-source LLMs come very close to proprietary ones. Thirdly, it is important to note that some LLMs may be overly calibrated towards exhibiting trustworthiness, to the extent that they compromise their utility by mistakenly treating benign prompts as harmful and consequently not responding. Finally, we emphasize the importance of ensuring transparency not only in the models themselves but also in the technologies that underpin trustworthiness. Knowing the specific trustworthy technologies that have been employed is crucial for analyzing their effectiveness.
The biggest threat your nail salon has ever seen
Nimble helps avoid the nail salon. Nail salons everywhere may soon face a serious competitor: Nimble, the robot manicurist. The company calls it the world's first smart home nail salon. It is a revolutionary device that lets you get a flawless manicure at home without any hassle. Nimble uses patented pioneering technology to scan, paint and dry your nails with one game-changing device.
Single man enrages girl after he asks her to pay for date: 'Feminist until it's time to split the bill'
A single man searching for love in Miami is confused. On the one hand, he received a barrage of criticism online for asking to split the bill on a first date with a girl he met on Tinder, an online dating app. On the other hand, he thinks – with modern-day feminism strongly in place in 2024 – women want equality and all that comes with it. The single man, who goes by "Water Boy" (@TheWaterBoy) on TikTok, posted a video recording of the date on TikTok. Users posting retellings of their bad dates are commonplace on the platform.
ARGS: Alignment as Reward-Guided Search
Khanov, Maxim, Burapacheep, Jirayu, Li, Yixuan
Aligning large language models with human objectives is paramount, yet common approaches including RLHF suffer from unstable and resource-intensive training. In response to this challenge, we introduce ARGS, Alignment as Reward-Guided Search, a novel framework that integrates alignment into the decoding process, eliminating the need for expensive RL training. By adjusting the model's probabilistic predictions using a reward signal, ARGS generates texts with semantic diversity while being aligned with human preferences, offering a promising and flexible solution for aligning language models. Notably, ARGS demonstrates consistent enhancements in average reward compared to baselines across diverse alignment tasks and various model dimensions. For example, under the same greedy-based decoding strategy, our method improves the average reward by 19.56% relative to the baseline and secures a preference or tie score of 64.33% in GPT-4 evaluation. We believe that our framework, emphasizing decoding-time alignment, paves the way for more responsive language models in the future. Code is publicly available at: \url{https://github.com/deeplearning-wisc/args}.
Icy Moon Surface Simulation and Stereo Depth Estimation for Sampling Autonomy
Bhaskara, Ramchander, Georgakis, Georgios, Nash, Jeremy, Cameron, Marissa, Bowkett, Joseph, Ansar, Adnan, Majji, Manoranjan, Backes, Paul
Sampling autonomy for icy moon lander missions requires understanding of topographic and photometric properties of the sampling terrain. Unavailability of high resolution visual datasets (either bird-eye view or point-of-view from a lander) is an obstacle for selection, verification or development of perception systems. We attempt to alleviate this problem by: 1) proposing Graphical Utility for Icy moon Surface Simulations (GUISS) framework, for versatile stereo dataset generation that spans the spectrum of bulk photometric properties, and 2) focusing on a stereo-based visual perception system and evaluating both traditional and deep learning-based algorithms for depth estimation from stereo matching. The surface reflectance properties of icy moon terrains (Enceladus and Europa) are inferred from multispectral datasets of previous missions. With procedural terrain generation and physically valid illumination sources, our framework can fit a wide range of hypotheses with respect to visual representations of icy moon terrains. This is followed by a study over the performance of stereo matching algorithms under different visual hypotheses. Finally, we emphasize the standing challenges to be addressed for simulating perception data assets for icy moons such as Enceladus and Europa. Our code can be found here: https://github.com/nasa-jpl/guiss.
These robot dogs paint like Picasso and fetch up to 40K for their art
Robot dog uses sensors, cameras and artificial intelligence to perceive and navigate surroundings. Agnieszka Pilat is not your typical artist. She doesn't use brushes, pencils or even her own hands to create her artwork. Pilat, who was born in Poland and now lives in the U.S., spent months teaching three of these four-legged machines named Basia, Vanya and Bunny to hold a paintbrush in their "mouths" and move them across a large canvas, turning the paint into abstract art. They use sensors, cameras and artificial intelligence to perceive and navigate their surroundings.
Modeling Considerations for Developing Deep Space Autonomous Spacecraft and Simulators
Agia, Christopher, Vila, Guillem Casadesus, Bandyopadhyay, Saptarshi, Bayard, David S., Cheung, Kar-Ming, Lee, Charles H., Wood, Eric, Aenishanslin, Ian, Ardito, Steven, Fesq, Lorraine, Pavone, Marco, Nesnas, Issa A. D.
To extend the limited scope of autonomy used in prior missions for operation in distant and complex environments, there is a need to further develop and mature autonomy that jointly reasons over multiple subsystems, which we term system-level autonomy. System-level autonomy establishes situational awareness that resolves conflicting information across subsystems, which may necessitate the refinement and interconnection of the underlying spacecraft and environment onboard models. However, with a limited understanding of the assumptions and tradeoffs of modeling to arbitrary extents, designing onboard models to support system-level capabilities presents a significant challenge. In this paper, we provide a detailed analysis of the increasing levels of model fidelity for several key spacecraft subsystems, with the goal of informing future spacecraft functional- and system-level autonomy algorithms and the physics-based simulators on which they are validated. We do not argue for the adoption of a particular fidelity class of models but, instead, highlight the potential tradeoffs and opportunities associated with the use of models for onboard autonomy and in physics-based simulators at various fidelity levels. We ground our analysis in the context of deep space exploration of small bodies, an emerging frontier for autonomous spacecraft operation in space, where the choice of models employed onboard the spacecraft may determine mission success. We conduct our experiments in the Multi-Spacecraft Concept and Autonomy Tool (MuSCAT), a software suite for developing spacecraft autonomy algorithms.
When Might AI Outsmart Us? It Depends Who You Ask
In 1960, Herbert Simon, who went on to win both the Nobel Prize for economics and the Turing Award for computer science, wrote in his book The New Science of Management Decision that "machines will be capable, within 20 years, of doing any work that a man can do." History is filled with exuberant technological predictions that have failed to materialize. Within the field of artificial intelligence, the brashest predictions have concerned the arrival of systems that can perform any task a human can, often referred to as artificial general intelligence, or AGI. So when Shane Legg, Google DeepMind's co-founder and chief AGI scientist, estimates that there's a 50% chance that AGI will be developed by 2028, it might be tempting to write him off as another AI pioneer who hasn't learnt the lessons of history. Still, AI is certainly progressing rapidly.
The Machine Ethics podcast: Avoidable misery with Adam Braus
Hosted by Ben Byford, The Machine Ethics Podcast brings together interviews with academics, authors, business leaders, designers and engineers on the subject of autonomous algorithms, artificial intelligence, machine learning, and technology's impact on society. This episode we're chatting with Adam Braus about natural stupidity, natural intelligence, misericordianism and avoidable misery, the drowning child thought experiment, natural state of morality, Donald Trump bot, Asimov's rules, human instincts, the positive outcomes of AI and more… Adam Braus is a professor and polymath professional, author, and expert in the fields of ethics, education, and organizational management. He is a writer, speaker, teacher, podcaster, coach, and consultant. He lives in San Francisco, California. You can subscribe to his weekly podcast, find links to his books, or contact him via his website.