Authors

* External authors

Venue

Date

Share

Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine Learning

Xu Xinyi*

Lingjuan Lyu

Xingjun Ma*

Chenglin Miao*

Chuan-Sheng Foo*

Bryan Kian Hsiang Low*

* External authors

NeurIPS-2021

2021

Abstract

Collaborative machine learning provides a promising framework for different agents to pool their resources (e.g., data) for a common learning task. In realistic settings where agents are self-interested and not altruistic, they may be unwilling to share data or model without adequate rewards. Furthermore, as the data/model the agents share may differ in quality, designing rewards which are fair to them is important so they do not feel exploited and discouraged from sharing. In this paper, we investigate this problem in gradient-based collaborative machine learning. We propose a novel cosine gradient Shapley to evaluate the agents’ contributions and design commensurate rewards in the form of better models. Compared to existing baselines, our method is more efficient and does not require a validation dataset. We provide theoretical fairness guarantees and empirically validate the effectiveness of our method.

Related Publications

Self-Comparison for Dataset-Level Membership Inference in Large (Vision-)Language Model

WWW, 2025
Jie Ren, Kangrui Chen, Chen Chen, Vikash Sehwag, Yue Xing, Jiliang Tang, Lingjuan Lyu

Large Language Models (LLMs) and Vision-Language Models (VLMs) have made significant advancements in a wide range of natural language processing and vision-language tasks. Access to large web-scale datasets has been a key factor in their success. However, concerns have been …

Exploit Gradient Skewness to Circumvent Byzantine Defenses for Federated Learning

AAAI, 2025
Yuchen Liu*, Chen Chen, Lingjuan Lyu, Yaochu Jin, Gang Chen*

Federated Learning (FL) is notorious for its vulnerability to Byzantine attacks. Most current Byzantine defenses share a common inductive bias: among all the gradients, the densely distributed ones are more likely to be honest. However, such a bias is a poison to Byzantine r…

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low- Rank Adaptations

NeurIPS, 2024
Lingjuan Lyu, Ziyao Wang, Zheyu Shen, Yexiao He, Guoheng Sun, Hongyi Wang, Ang Li

The rapid development of Large Language Models (LLMs) has been pivotal in advancing AI, with pre-trained LLMs being adaptable to diverse downstream tasks through fine-tuning. Federated learning (FL) further enhances fine-tuning in a privacy-aware manner by utilizing clients'…

  • HOME
  • Publications
  • Gradient Driven Rewards to Guarantee Fairness in Collaborative Machine Learning

JOIN US

Shape the Future of AI with Sony AI

We want to hear from those of you who have a strong desire
to shape the future of AI.