Microsoft Unveils Mu: Compact Language Model for Edge Devices and NPUs
Summary
Microsoft introduces Mu, a compact language model engineered for efficient performance on edge devices and NPUs, powering the new AI-powered agent in Windows Settings that understands natural language queries and adjusts relevant settings.
Key Points
- Mu is Microsoft's new micro-sized language model designed to run efficiently on edge devices and NPUs.
- Mu employs optimizations like encoder-decoder architecture, dual LayerNorm, rotary positional embeddings, and grouped-query attention for high performance within tight constraints.
- Mu powers the new AI-powered agent in Windows Settings on Copilot+ PCs, understanding natural language queries and changing relevant settings.