WPFed: Web-based Personalized Federation for Decentralized Systems
Ye, Guanhua, He, Jifeng, Wang, Weiqing, Xue, Zhe, Kou, Feifei, Li, Yawen
–arXiv.org Artificial Intelligence
Decentralized learning has become crucial for collaborative model training in environments where data privacy and trust are paramount. In web-based applications, clients are liberated from traditional fixed network topologies, enabling the establishment of arbitrary peer-to-peer (P2P) connections. While this flexibility is highly promising, it introduces a fundamental challenge: the optimal selection of neighbors to ensure effective collaboration. To address this, we introduce WPFed, a fully decentralized, web-based learning framework designed to enable globally optimal neighbor selection. WPFed employs a dynamic communication graph and a weighted neighbor selection mechanism. By assessing inter-client similarity through Locality-Sensitive Hashing (LSH) and evaluating model quality based on peer rankings, WPFed enables clients to identify personalized optimal neighbors on a global scale while preserving data privacy. To enhance security and deter malicious behavior, WPFed integrates verification mechanisms for both LSH codes and performance rankings, leveraging blockchain-driven announcements to ensure transparency and verifiability. Through extensive experiments on multiple real-world datasets, we demonstrate that WPFed significantly improves learning outcomes and system robustness compared to traditional federated learning methods. Our findings highlight WPFed's potential to facilitate effective and secure decentralized collaborative learning across diverse and interconnected web environments.
arXiv.org Artificial Intelligence
Oct-15-2024
- Country:
- Oceania > Australia (0.04)
- North America > United States
- Texas
- Travis County > Austin (0.04)
- Harris County > Houston (0.04)
- Oregon > Multnomah County
- Portland (0.04)
- New York > New York County
- New York City (0.05)
- Texas
- Asia
- Genre:
- Research Report > New Finding (0.88)
- Industry:
- Information Technology > Security & Privacy (1.00)
- Education > Educational Setting
- Online (0.34)
- Technology:
- Information Technology
- Security & Privacy (1.00)
- Communications > Networks (1.00)
- Artificial Intelligence > Machine Learning (1.00)
- Information Technology