Alibaba's New 27B Vision AI Model Runs on Laptops But Overthinks Simple Tasks

Aug 17, 2026
Simon Willison’s Weblog
Article image for Alibaba's New 27B Vision AI Model Runs on Laptops But Overthinks Simple Tasks

Summary

Alibaba's new Qwen 3.8 27B vision AI model runs on consumer laptops as a 17GB file, delivering impressive code generation and image analysis capabilities, but its default 'xhigh' reasoning setting causes excessive overthinking on simple tasks, and speed remains limited at 15–30 tokens per second — though a 72% boost is already achievable via Multi-Token Prediction support.

Key Points

  • Qwen 3.8 27B, a new Apache 2 licensed 27B parameter vision-capable LLM from Alibaba, is now available as a 17GB file capable of running on high-end consumer laptops, delivering strong performance in code generation, tool calling, image annotation, and bounding box detection.
  • The model defaults to an 'xhigh' reasoning effort setting, causing extreme overthinking on even simple tasks — generating a basic SVG circle prompt triggers minutes of elaborate internal reasoning and unsolicited animated output, making it strongly recommended to run the model on 'low' or no reasoning by default.
  • Despite impressive capabilities, the model runs at only 15–30 tokens per second on current consumer hardware, though Multi-Token Prediction (MTP) support in llama.cpp is already delivering around a 72% speed boost, with further community optimizations expected in the coming weeks.

Tags

Read Original Article