Kudos to Jeff Geerling for persuading Apple to send him about $40Ks worth of Mac Studios to test the new RDMA networking feature, which connects the computers to work together on processing monster LLMs. His review setup has 1.5TB of RAM, and the results are… interesting—spoilers after the break.
Leave a Reply