Apple's MLX framework now supports the M5 chip's Neural Accelerators, delivering a massive 4x speedup in AI response times and up to 27% faster token generation, powered by the M5's 153GB/s memory bandwidth, enabling MacBook Pro users to run powerful large language models locally with ease.
A deepening AI infrastructure crisis is forcing companies like Anthropic to actively degrade their own products to conserve compute, as surging demand from agentic tools outpaces supply — and with DRAM constraints expected to cap growth at 15GW until 2027, experts warn inference shortages will worsen through 2026 and 2027, …
Andrej Karpathy's new 'autoresearch' tool enables an AI agent to autonomously run roughly 100 LLM training experiments overnight on a single NVIDIA GPU, modifying code, evaluating results, and iterating — all guided by a simple plain-text file instead of manual coding.
MIT researchers unveil Attention Matching, a groundbreaking KV cache compression technique that slashes large language model memory usage by up to 50x in seconds, delivering near-identical accuracy without the slow, compute-heavy optimization methods that have long bottlenecked AI deployment.
Apple's 18-core M5 Max stuns in Geekbench 6 benchmarks, outscoring AMD's 96-core Threadripper Pro, though experts caution the test favors fewer, faster cores and doesn't scale beyond 32 threads — still, the chip's 29,644 multi-core score and 614 GB/s memory bandwidth signal a major leap forward for Apple silicon.
Red Hat is making major strides in open AI infrastructure, emerging as the third-highest global contributor to PyTorch while driving innovations in multi-cloud inference, distributed model serving, and hardware-agnostic AI deployment through projects like vLLM and llm-d.
Meta faces a lawsuit and international investigations over its AI-powered Ray-Ban smart glasses after reports reveal overseas contractors in Kenya are reviewing users' intimate and explicit footage, directly contradicting the company's 'designed for privacy' marketing claims — and over seven million buyers have no way to opt out.
Oracle is planning to cut thousands of jobs across multiple divisions as soon as this month, driven by a cash crunch stemming from its massive AI data center expansion, with some roles being eliminated due to AI advancements reducing the need for certain positions.
SRAM-centric AI chips are challenging GPU dominance as NVIDIA's $20B Groq IP licensing deal and Cerebras's 750 MW OpenAI partnership signal a major shift toward faster, lower-latency accelerators purpose-built for AI inference workloads.
Arm's technology, found in 99% of smartphones worldwide, is revolutionizing on-device AI by bringing real-time generative features like creative style transfer at 30 frames per second to mid-range and entry-level devices, with a TECNO collaboration and KleidiAI optimizations delivering 30% faster AI compute across all price ranges.