Linley Microprocessor Report: Ceva-NeuPro-M Enhances BF16, FP8 Support

Ceva has updated its licensable NeuPro-M design to better handle Transformers—the neural networks underpinning ChatGPT and Dall-E AI software and now finding application at the edge in computer vision. Architectural changes to Ceva-NeuPro-M improve its power efficiency and can increase its performance sevenfold on models that can take advantage of the new features. Critical among these is the addition of BF16 and FP8 support to more Ceva-NeuPro-M function units and improved handling of sparse data.