OpenAI overhauled its WebRTC architecture with a split relay-plus-transceiver model, enabling real-time voice AI to scale globally across Kubernetes for over 900 million weekly active users while minimizing latency without requiring custom client modifications.
A free app called Locally AI is turning heads by running powerful AI models like Llama, DeepSeek, and Gemma entirely on-device across iPhone, iPad, and Mac — with no internet, no login, and zero data collection, all powered by Apple Silicon.
DeepSeek unleashes two groundbreaking AI models — DeepSeek-V4-Pro and V4-Flash — featuring over 1 trillion parameters and record-breaking low prices, with V4-Flash undercutting OpenAI's cheapest model at just $0.14 per million tokens, powered by dramatic efficiency gains that slash compute costs to a fraction of its predecessor.
AI chipmaker Cerebras Systems is targeting a massive $4 billion IPO with a $40 billion valuation, with formal marketing set to launch as early as Monday amid surging investor demand for its shares.
TALOS-V2 brings AI inference to FPGA hardware, running Karpathy's microGPT at a blazing 50,000 tokens per second on a DE1-SoC Cyclone V board using fixed-point arithmetic and SystemVerilog RTL, complete with real-time controls and token output on onboard displays.
OpenClaw, a self-hosted AI agent platform, rockets to 250,000 GitHub stars in just 60 days, overtaking React as GitHub's most-starred project while NVIDIA rushes to address security vulnerabilities by launching NemoClaw, a hardened reference implementation, as autonomous long-running agents drive a 1,000x surge in inference demand and reshape industries from …
Oracle is simultaneously navigating a massive banking crisis tied to a $300 billion AI data center deal with OpenAI while slashing up to 30,000 jobs, as analysts warn the tech giant may need over $100 billion in additional financing by 2028 amid mounting debt concerns.
Apple's Mac revenue surges 6% to $8.4 billion in Q2, beating Wall Street expectations as explosive demand for running local AI models on Mac mini and Mac Studio devices outpaces supply, with CEO Tim Cook warning shortages on AI-focused Mac models could persist for months.
Self-hosting large language models is a hardware-intensive, patience-demanding endeavor requiring at least 16GB of VRAM for even modest models, with operational friction from RAG pipelines, prompt template mismatches, and latency issues making it far from a seamless API replacement.
Google is now selling its custom AI chips, Tensor Processing Units, directly to customers for use in their own data centers, marking a major strategic shift that intensifies competition with Nvidia while Amazon simultaneously challenges the chip giant with its own lineup generating over $20 billion in annual revenue.