Federated News Recommendation

Federated Learning is proposed by Google in 2016. In this project, we try to deploy a news recommendation algorithm on a federated framework - Pysyft.

Github: https://github.com/ZHANG-GuiGui/news_reco_syft/

CSDN: https://blog.csdn.net/weixin_45520982/article/details/116781765/

Introduction

Data security and personal privacy are two main concerns with regard to giant Internet companies.

Federated Learning is about how to update the deep learning model stored on a central server without seeing training data conserved on multiple client devices.

Fig1

The simplest way is to transfer encrypted gradient calculated locally on clients' devices.

Our project is more like an engineer attempt without considering fondly the theories behind Federated Learning.

Dataset and Model

We used the MIcrosoft News Dataset (MIND). Due to project time limitation, we conducted the experiments on MIND-small dataset.

We used the NRMS model as the default news recommendation model.

Federated Learning Framework

Pysyft 0.2.x is chosen as our deploy framework.

Fig2

Experiments

hyper parameters setting

  • batch size = 128
  • learning rate = 5e-4 for Adam Optimizer 0.01 for SGD Optimizer

Results

Name 1 machine 2 machines 3 machines 4 machines
Tag Orange Pink Blue Green
Loss
Fig3
AUC
Fig4
MRR
Fig5
nDCG@5 and nDCG@10
# Working Machine nDCG@5 nDCG@10
1 0.3358 0.398
2 0.298 0.3622
3 0.3061 0.3701
4 0.2956 0.3602

Team Member:

HUANG Zeyu

ZHANG Xiaofeng

LI Yuhang

WANG Kunyang

TAN Ying

Supervisor:

JIANG Li @ Orange Beijing Lab