The Software Factory: Running a 24/7 Local AI Fleet
Why unlimited local inference is the new economic moat for solo builders
The conventional wisdom for the solo operator has long been to lean on the cloud. You pay twenty dollars a month for a subscription, or you pay per token to an API, and you call it a day. But Alex Finn is breaking that model. He isn't just using AI; he is running a continuous, automated software factory powered by a custom-built fleet of local machines. This isn't about saving a few dollars on a ChatGPT bill. It is about the shift from 'on-demand' intelligence to 'ambient' intelligence. When you own the hardware, the cost of thinking drops to the price of electricity. This changes the math of what is possible. You stop asking 'is this prompt worth the cost?' and start asking 'what can I run continuously?'
The Hardware Hierarchy
Finn's setup is not a monolith; it is a tiered ecosystem where different machines handle different cognitive loads. He uses Mac Studios with massive unified memory to run large, intelligent models like GLM 5.2. These act as the high-level thinkers, capable of complex reasoning but operating at a slower pace. For speed, he turns to an RTX 5090, which provides near-instantaneous responses for tasks that require quick iterations. Between these two poles sits the DGX Spark, providing the high-speed CUDA performance needed for heavy lifting. This isn't just a collection of computers; it is a coordinated workforce where tasks are routed based on the specific requirements of the model and the speed of the silicon.
The case for local AI isn’t ROI; it’s unlimited inference.
To manage this chaos, Finn uses Tailscale to create a single, seamless network. This allows a single agent to command the entire fleet, moving tasks between a Mac Studio and a high-speed GPU as if they were parts of a single brain. This connectivity is what enables the 'build-and-review' loop. One agent writes code, another reviews it, and a third runs security scans—all happening in a continuous cycle while the builder sleeps. It is a level of throughput that would bankrupt a user relying solely on cloud APIs.
- Mac Studio: For large-scale reasoning and massive models.
- RTX 5090: For low-latency, high-speed execution.
- DGX Spark: The middle ground for CUDA-accelerated tasks.
- Tailscale: The connective tissue for multi-machine orchestration.
This approach moves the competitive advantage away from those who can write the best prompts and toward those who can build the best infrastructure. The future belongs to the builders who treat AI as a utility they own, rather than a service they rent. By running a 24/7 loop, Finn has effectively decoupled his productivity from his personal time, creating a software factory that operates on its own schedule.
Owning your hardware turns AI from a variable cost into a fixed utility, enabling continuous, autonomous workflows.