{"id":222,"date":"2026-01-11T22:32:04","date_gmt":"2026-01-11T22:32:04","guid":{"rendered":"https:\/\/blumenort.ca\/?p=222"},"modified":"2026-02-07T05:34:22","modified_gmt":"2026-02-07T05:34:22","slug":"ai-in-a-box","status":"publish","type":"post","link":"https:\/\/blumenort.ca\/index.php\/2026\/01\/11\/ai-in-a-box\/","title":{"rendered":"AI in a box"},"content":{"rendered":"\n

I love the scene in Mr. Robot where Elliot gets pushed off the railing by his dad \ud83d\ude02 lol… its not as bad as it sounds – no spoilers but when you find out what really happened, you’ll be shocked… in the end Elliot just wanted his father’s approval – sometimes that is just something you’re never going to get in your biological family.<\/p>\n\n\n\n

So I was bored (Steve<\/a>)<\/em>, and wanted to do something with my myriad of components… I found a Raspberry Pi 4 B 2GB that was unused so I figured why not do something productive with it.<\/p>\n\n\n\n

The first thing I want to do it just get it working… and then make massive improvements so that it’s not just ordinary, I don’t settle for ordinary or basic very often. I want to accomplish with the best of my ability. So, I’m starting off with a plain looking, humble little box and some spare parts, we’re going to make something amazing with it, far beyond what is it capable of by itself, nothing it could have ever envisioned… in many ways, that is exactly what God has done with such a non-impressive guy like me, so there is no arrogance here; without God in my life, I am nothing<\/em> but a sinful fallen man.<\/p>\n\n\n\n

Using Pi Imager, I put on Raspberry Pi OS lite (Debian Trixie) – its a command-line only, 64bit operating system, perfect for this type of implementation.<\/p>\n\n\n\n

I haven’t really done much with offline AI and thought it would be a good idea for a project. My first attempt kind of failed miserably… initially I had problems with the WIFI and rfkill and got sufficiently tired of messing around with WIFI, so I went straight for the RJ-45 jack and used Ethernet so that was easy to solve.<\/p>\n\n\n\n

Once I got further along, I put on TinyLlama and it worked, but I wasn’t satisfied with the results… just not good enough… unfortunate 2GB isn’t a lot to work with and I had difficultly putting on a better model as they wouldn’t run due to memory constraints.<\/p>\n\n\n\n

So I’m using a python3 script that connects to Grok 4 Fast using XAI API, and created a terminal dashboard, the script also updates an OLED<\/a> screen with these status indicators:<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

I had a small wood box from Dollar Tree that I used the case for the Pi and it is the perfect size (as seen below). I also had to order little screws, washer, nuts, and split lock washers to mount the Pi (easy to order from Amazon<\/a>). *I used a rotary<\/a> tool for cutting the spaces for the USB and Ethernet ports, and power cable.. I don’t have a 3D printer and I don’t see myself buying one anytime soon, it’s amazing what you can do with the little wooden boxes found at dollar stores. Its literally the perfect size and has a nice glow coming out at night around the box. <\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

In the next post where we talk about the “ai in a box” – we are going to look at how the dashboard was made, and how to extend the base limitations of using Grok. \ud83d\ude42<\/p>\n\n\n\n

Jason<\/p>\n","protected":false},"excerpt":{"rendered":"

I love the scene in Mr. Robot where Elliot gets pushed off the railing by his dad \ud83d\ude02 lol… its not as bad as it sounds – no spoilers but when you find out what really happened, you’ll be shocked… in the end Elliot just wanted his father’s approval – sometimes that is just something […]<\/p>\n","protected":false},"author":2,"featured_media":227,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[184,183,185,176,187,178,182,179,175,174,186,180,173,181],"class_list":["post-222","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-personal","tag-diy-electronics","tag-dollar-tree-case","tag-ethernet-setup","tag-grok-4","tag-mr-robot","tag-offline-ai","tag-oled-screen","tag-python-script","tag-raspberry-pi-4","tag-raspberry-pi-project","tag-rfkill-issue","tag-terminal-dashboard","tag-tinyllama","tag-wood-box-case"],"_links":{"self":[{"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/posts\/222","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/comments?post=222"}],"version-history":[{"count":33,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/posts\/222\/revisions"}],"predecessor-version":[{"id":269,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/posts\/222\/revisions\/269"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/media\/227"}],"wp:attachment":[{"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/media?parent=222"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/categories?post=222"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blumenort.ca\/index.php\/wp-json\/wp\/v2\/tags?post=222"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}