AI clusters

Homa, a transport protocol designed for data centers, is being presented as a replacement for TCP in AI training clusters. The argument is that TCP's limitations on latency and congestion control make it poorly suited to the traffic patterns of large-scale machine learning workloads, and that purpose-built protocols can deliver better performance for GPU clusters.