middleware like MPI/SHMEM Implementing lower-level communication frameworks like UCX and libfabric, or development using RDMA... to enable collective communication software for datacenter GPU systems Understand existing codebases and software designs...