Cool exploration of distributed inference on heterogenous hardware. Including Apple silicon with MLX:
Gradient
Gradient2.8. klo 21.00
Intelligence has been locked in walled gardens. Today, we’re opening the gates. Parallax now runs in Hybrid mode, with Macs and GPUs serving large models together in a truly distributed framework.
15,42K