Framework Desktop AI Cluster mini-rack


I built this mini AI cluster using four Framework Mainboards, provided by Framework, and four DeskPi Framework Mainboard Mini ITX trays provided by DeskPi.

The Mainboards each have 128 GB of LPDDR5x RAM attached to an AMD Ryzen AI Max+ 395 (what a mouthful!) APU. This is good enough for 1+ TFLOPs of CPU performance when clustered, and can run LLMs up to a few hundred GB in size.

Parts used:

- [DeskPi T1 Black 8U Mini Rack](https://amzn.to/3H04Tb6)
- [NICGIGA 5 Gbps 8 port Ethernet switch](https://amzn.to/46NFID8)
- [Monoprice SlimRun Cat6A 2' Patch Cable - 5 pack](https://amzn.to/4ldhLZf)
- [Framework Desktop Ryzen AI Max+ 395 128GB Mainboard](https://frame.work/products/framework-desktop-mainboard-amd-ryzen-ai-max-300-series?v=FRAFMK0006) (x4)
- [Framework WD_BLACK SN7100 1TB NVMe](https://frame.work/products/wd_black-sn7100-nvme?v=FRANTJWD0A) (x4)
- [Framework C13 AC Power cable](https://frame.work/products/desktop-ac-cable?v=FRAMBJ000B) (x4)
- [Framework Desktop CPU Fan Kit - Noctua](https://frame.work/products/desktop-noctua-cpu-fan?v=FRAMBX0002) (x4)
- [Framework Desktop Power Supply - 400W](https://frame.work/products/desktop-power-supply-400w) (x4)
- DeskPi Framework Desktop 2U Mini ITX Tray (not yet released)
- [Framework Desktop Lego-compatible Tile - 3D print](https://www.printables.com/make/2780369) (thanks to @herranz for sharing the model!)

I published a full video on the setup on YouTube: [I built a private AI mini-cluster with Framework Desktop](https://www.youtube.com/watch?v=N5xhOqlvRh4).

And I also have a writeup on my blog: [I clustered four Framework Mainboards to test huge LLMs](https://www.jeffgeerling.com/blog/2025/i-clustered-four-framework-mainboards-test-huge-llms).

This issue is a showcase of a Framework Desktop AI cluster and does not identify a file, test, entry point, or requested repository change. There is no implementation path or completion criterion for a newcomer to follow.

Written by the indexing model from the issue text.