@FrancescoPase
@DenizGunduz1
@sanmikoyejo
We show the existence of highly natural choices of pre-data distribution (side information at the server) and post-data distribution (local updates at the clients) in FL that we can use to reduce the communication cost significantly -- up to 50 times more than the baselines. 2/3
1
0
6
Replies
Excited to share our new work with
@FrancescoPase
,
@DenizGunduz1
,
@sanmikoyejo
,Tsachy Weissman, and Michele Zorzi.
We reduce the communication cost in FL by exploiting the side information correlated with the local updates and available to the server.1/3
2
7
59
@FrancescoPase
@DenizGunduz1
@sanmikoyejo
We also show how to adaptively adjust the bitrate across the model parameters and training rounds to achieve the fundamental communication cost -- the KL divergence between the pre-data and post-data distributions. 3/3
0
0
5