Learning to Refer: Inference-Time Collaboration in Decentralized Federated Learning