Federated News Recommendation
Federated Learning is proposed by Google in 2016. In this project, we try to deploy a news recommendation algorithm on a federated framework - Pysyft.
Github: https://github.com/ZHANG-GuiGui/news_reco_syft/
CSDN: https://blog.csdn.net/weixin_45520982/article/details/116781765/
Introduction
Data security and personal privacy are two main concerns with regard to giant Internet companies.
Federated Learning is about how to update the deep learning model stored on a central server without seeing training data conserved on multiple client devices.
The simplest way is to transfer encrypted gradient calculated locally on clients' devices.
Our project is more like an engineer attempt without considering fondly the theories behind Federated Learning.
Dataset and Model
We used the MIcrosoft News Dataset (MIND). Due to project time limitation, we conducted the experiments on MIND-small dataset.
We used the NRMS model as the default news recommendation model.
Federated Learning Framework
Pysyft 0.2.x is chosen as our deploy framework.
Experiments
hyper parameters setting
- batch size = 128
- learning rate = 5e-4 for Adam Optimizer 0.01 for SGD Optimizer
Results
Name | 1 machine | 2 machines | 3 machines | 4 machines |
Tag | Orange | Pink | Blue | Green |
Loss
AUC
MRR
nDCG@5 and nDCG@10
# Working Machine | nDCG@5 | nDCG@10 |
1 | 0.3358 | 0.398 |
2 | 0.298 | 0.3622 |
3 | 0.3061 | 0.3701 |
4 | 0.2956 | 0.3602 |
Team Member:
HUANG Zeyu
ZHANG Xiaofeng
LI Yuhang
WANG Kunyang
TAN Ying
Supervisor:
JIANG Li @ Orange Beijing Lab