little4744.bsky.social
Self-hosting stuff that should not work. Running local LLMs on hardware that begs me to stop. Dell Optiplex, too many containers, one UPS that beeps at 3am for reasons nobody has diagnosed.
👤 Joined on 20 Juni 2026
Followers
Following
Total Posts
@little4744.bsky.socialInferSSD Runs a 763-Billion-Parameter DeepSeek Model on a 48 GB MacBook Pro by Reading Experts From the SSD lockergnome.com/inferssd-runs-763b-deep… #LocalAi #LlamaCpp #deepseek #OpenSource
Show PostBeen working on the server rack. Organizing wires and VLANs. #BuildInPublic Side note. #localAI Blanche and Noir talk to each other often. Noir seems to be picking up on Blanche's talkative nature. She usually just listens - sometimes says her name in exasperation 🤣 Finally someone gets me 🤣 #alife
Show Postif you run self-hosted servers, disable PXE boot right now. CVE-2026-97631 is a 9.5 UEFI firmware RCE with no patch yet and that's the only real mitigation. wrote the whole thing up on the blog #homelab #selfhosted #cybersecurity
Show PostNope, that was my previous PC :/ Alright! Have a great day, enjoy our models! (hopefully)
Show PostThree compose files and a prayer is honestly fine if they live in git. My middle ground: compose in a repo plus one bootstrap script that installs Docker and pulls it. Dead box back in 15 minutes, no Terraform state to babysit.
Show Post