setups for running big models on small machines
I run large AI models on ordinary laptops and let agents do the boring work while the laptop is closed. Every setup here is one I ran, with the numbers I measured.
- setups shipped
- 25
- last one
- 3d ago
- members
- 31 (16 sep)
setups
- ggufPick the right GGUF for your RAM (the quant picker)
- skillNine agent skills trending this week, plus a SKILL.md starter
- bitnetRun Microsoft BitNet on your CPU
- diyKeep your AI assistant running when your laptop is closed
- voiceElevenLabs $100, your GPU 6 cents? The exact VoiceStudio setup
- harnessNine harnesses, one model, and a 17x spread in the bill
- slotstreamRun a 125B model on a 48GB laptop (slotstream setup)
- soupFine tune an 8B model on a 4GB laptop GPU (Soup setup)
- minimindTrain your own LLM for 43 cents and 2 hours (minimind setup)
- pixelsSend your AI pictures of your code instead of the code (pxpipe setup)
- sandboxGive your coding agent a throwaway Linux VM (clawk setup)
- shipRebuild Redis from an empty file (Ship That Code setup)
- token7.4 billion free AI tokens a month
- mapleRun a 20B AI model in 7GB RAM
- carRun a 35B model on a 300 euro computer (CarWatch setup)
- qwenRun a 27B model in 6.2GB, no GPU (Qwen3.8 setup)
- birdRun a 744B model in 9.9GB of RAM (Colibri setup)
- runsRun a 30B model on a 2016 desktop (quantprobe setup)
- kimiRun a 2.78 trillion parameter model in 8GB (Kimi K3 setup)
- swiftRun an 80B model in 4.3GB of RAM (Swiftlet setup)
- localRun AI on a laptop with no graphics card
- needleRun a 14MB AI on a Raspberry Pi (Needle2 setup)
- airRun a 70B model on a 4GB card (AirLLM setup)
- weirdThe weird web list
- jarvisHow I Built My JARVIS
community
the rabbit hole
Free community where these setups live and where I answer questions. Join, then ask.
join freemyhermes
The agent that runs my recurring tasks with the laptop closed is MyHermes. I'm one of the two people building it. see the plans
about
Rupayan Chakraborty. Solo builder in Jalpaiguri, India. Reels daily, one setup per keyword, everything measured.