Chatbot Zero - AI on Raspberry Pi zero

I'm thrilled to share that the Whisplay HAT is available today! 

Link: https://www.pisugar.com/products/whisplay-hat-for-pi-zero-2w-audio-display

The chatbot now support local ollama! 

This demo uses the deepseek-r1:1.5b model to generate responses. Since this is a reasoning model, I added a "thinking" display in the chatbot UI. You can choose to turn off the "thinking," which makes the responses faster, but the quality may noticeably decrease.

I also tried running Ollama on the Zero2W with a smaller model, smollm2:135m-instruct-q4_K_S, but after answering just one question, the Zero2W became extremely sluggish — its limited hardware performance is the objective bottleneck.

I tried running Ollama on the Zero 2W, and the output speed was actually quite decent. I also ran a chatbot program at the same time — while it did slow things down a bit, it shows that the Zero 2W does have potential! That said, the core temperature quickly rose to 68°C, so it’s clearly struggling a bit.

Install ollama following this tutorial: https://github.com/Gilzone/Installing-a-LLM-on-Raspberry-Pi-Zero-2-W

Today I received the HAT printed with the Whisplay logo. The logo features a screen-faced robot with a cartoon expression that gives off a strong electronic vibe. Interestingly, its ears are actually speakers!

You can just the waitlist via the link below:

https://www.pisugar.com/pages/subscribe-whisplay-hat

I want to make this device work like a walkie-talkie, where you press and hold the button to talk, so the button will be used quite frequently. That’s why I specifically chose this mouse button. It has excellent tactile feedback — you can easily press it with a light touch. But compared to a regular button, it’s definitely a big guy!