题 目:Sparse Decentralized Federated Learning
主讲人:孔令臣 教授
单 位:北京交通大学
时 间:2025年7月1日 15:00
地 点:九章学堂南楼C座209
摘 要:Decentralized Federated Learning (DFL) enables collaborative model training without a central server but faces challenges in efficiency, stability, and trustworthiness due to communication and computational limitations among distributed nodes. To address these critical issues, we introduce a sparsity constraint on the shared model, leading to Sparse DFL (SDFL), and propose a novel algorithm, CEPS. The sparsity constraint facilitates the use of one-bit compressive sensing to transmit one-bit information between partially selected neighbour nodes at specific steps, thereby significantly improving communication efficiency. Moreover, we integrate differential privacy into the algorithm to ensure privacy preservation and bolster the trustworthiness of the learning process. Furthermore, CEPS is underpinned by theoretical guarantees regarding both convergence and privacy. Numerical experiments validate the effectiveness of the proposed algorithm in improving communication and computation efficiency while maintaining a high level of trustworthiness.
简 介:孔令臣,教授,博士生导师,中国运筹学会数学规划分会理事长,北京交通大学数学与统计学院副院长。主要从事对称锥互补问题和最优化、高维数据分析、统计优化与学习、医学成像等方面的研究。在《Mathematical Programming》、《SIAM Journal on Optimization》、《IEEE Transactions on Pattern Analysis and Machine Intelligence》、《IEEE Transactions on Signal Processing》、《Technometrics》、《Statistica Sinica》、《Electronic Journal of Statistics》等期刊发表论文60余篇。主持国家自然科学基金面上项目4项和专项基金项目4项, 参与国家自然科学基金重点项目、重点研发项目以及973课题等。2005年获山东省高等教育教学成果三等奖,2012年获中国运筹学会青年奖,2018年获得北京市高等教育教学成果一等奖,2022年获教育部自然科学二等奖和北京市高等教育教学成果二等奖。