EXO now supports GLM-4.7-Flash. 4-bit, 5-bit, 6-bit and 8-bit quants run fast on MacBook, Mac Mini and Mac Studio. Supports tensor parallel sharding across Macs with RDMA over Thunderbolt for even more speed. Here it is running at 82 tok/sec on M4 Max MacBook Pro. (EXO Labs)