Nvidia Achieves Breakthrough with 4-Bit AI Training, Delivering 6X Speed Boost While Matching Full Precision Results
Nvidia achieves groundbreaking 4-bit AI training breakthrough with new NVFP4 format, delivering 6X speed boost and 50% memory reduction while matching full precision results on 12-billion-parameter language model, requiring only 1% higher validation loss and 36% less training data than competitors.