PANews
PANews|Mar 21, 2026 01:51
[Tether Releases Cross-Platform BitNet LoRA Framework, Billion-Parameter Models Can Be Fine-Tuned on Consumer-Grade Devices] According to the official announcement, Tether has introduced the cross-platform BitNet LoRA fine-tuning framework within QVAC Fabric, enabling training and inference optimization for Microsoft BitNet (1-bit LLM). This framework significantly reduces computational power and memory requirements, allowing billion-parameter models to be trained and fine-tuned on laptops, consumer-grade GPUs, and smartphones. For the first time, this solution enables fine-tuning of BitNet models on mobile GPUs (including Adreno, Mali, and Apple Bionic). Tests show that a 125M-parameter model can be fine-tuned in approximately 10 minutes, while a 1B-parameter model can be completed in about an hour, and even scaled up to 13B-parameter models on mobile devices. Additionally, the framework supports heterogeneous hardware such as Intel, AMD, and Apple Silicon, and for the first time enables 1-bit LLM LoRA fine-tuning on non-NVIDIA devices. In terms of performance, inference speed for BitNet models on mobile GPUs is 2 to 11 times faster compared to CPUs, while memory usage is reduced by up to 77.8% compared to traditional 16-bit models. Tether stated that this technology is expected to break the reliance on high-end computational power and cloud infrastructure, driving AI training toward decentralization and localization, and providing a foundation for new application scenarios such as federated learning.
+5
Mentioned
Share To

Timeline

HotFlash

APP

X

Telegram

Facebook

Reddit

CopyLink

Hot Reads