8-Node M5 Ultra Mac Studio Cluster: Dual-Cable Thunderbolt 5 Ring Topology & RDMA (TN3205) for MLX

Hi all,

We are planning an 8-node M5 Ultra Mac Studio deployment for distributed LLM inference and training using MLX (mlx.distributed) and RDMA over Thunderbolt 5 (per Technote TN3205). Before finalizing our physical rack cabling, we would appreciate official confirmation on a few architectural details:

  1. Is an 8-node M5 Ultra Mac Studio cluster supported for distributed AI workloads using Apple's MLX framework?

  2. What is the recommended Thunderbolt 5 connection topology for eight Mac Studios: ring, mesh, or another configuration?

  3. We currently plan to use 14 Thunderbolt 5 cables. Can this quantity be used effectively for an eight-node cluster, or would Apple recommend a different number?

  4. Can Apple provide a detailed physical cabling diagram showing the specific Thunderbolt ports to connect between all eight machines?

  5. Is it possible or beneficial to establish multiple Thunderbolt connections between the same two Mac Studios to increase communication bandwidth?