StreamPulse does basically that. The app is light enough to easily deploy on a Raspberry Pi or as a container on a NAS.

Edge AI comparison of Pi 5, Hailo 8, and Orin Nano shows 157 FPS at 13W on Orin, guiding teams on performance versus power ...

The Raspberry Pi AI HAT+ and the corresponding AI Kit, which both rely on Hailo AI accelerators, are now fully compatible ...

This Raspberry Pi 5 offline assistant runs the Quen 3 1.7B model locally, so you get fast, private replies without cloud ...