Raspberry Pi Unveils 8GB RAM Add-On Board for Generative AI Models
Raspberry Pi has announced the release of the AI HAT+ 2, an advanced add-on board designed for generative AI applications. Priced at $130, it features 8GB of RAM and a Hailo 10H chip, providing 40 TOPS of AI performance. This new addition is compatible with the Raspberry Pi 5 and aims to enhance its capability to handle AI workloads.
Key Features of the AI HAT+ 2
The AI HAT+ 2 offers several improvements over its predecessor launched last year. Unlike the earlier version, which focused primarily on image processing, this new model includes onboard RAM, allowing it to execute small generative AI models such as:
- Llama 3.2
- DeepSeek-R1-Distill
- Multiple Qwen models
This add-on board allows users to train and fine-tune AI models effectively. A demonstration highlighted its ability to generate text descriptions based on camera streams, and respond to questions regarding scene details, such as the presence of individuals. Another application showcased its text translation capability, converting French to English using Qwen2.
Performance Analysis
Despite the impressive specifications, tech YouTuber Jeff Geerling noted that a standalone Raspberry Pi 5 with 8GB of RAM often outperformed the AI HAT+ 2 across several models. He attributes this performance discrepancy to the power consumption limitations of the add-on board. The Raspberry Pi 5 can operate at a maximum of 10 watts, while the AI HAT+ 2’s power draw is capped at 3 watts.
Geerling observed that while the AI HAT+ 2 serves specific use cases, its additional 8GB of RAM might not justify the price compared to upgrading to the 16GB Raspberry Pi 5 model. The latter offers more flexibility and enhanced performance for running various models efficiently.
Future Developments
Raspberry Pi has plans to roll out more extensive AI models shortly after the AI HAT+ 2 launch. These upcoming models aim to expand the capabilities of the add-on board and further enhance its usability for generative AI tasks.
In comparison, the original AI HAT+, available for $70, remains focused on AI image processing, appealing to users seeking budget-friendly options.
