Engineering

There is a large installed base of consumer GPUs, and there is a growing bill for LLM inference. The obvious trade, renting the former to pay the latter, has been attempted many times and mostly produces either a token with no callers or a box rental with no product. InferSpine is a project I am building to study the missing middle: the software control plane that turns untrusted, heterogeneous, residential GPUs into an OpenAI-compatible endpoint with routing, metering, and payout. This is a note on what that system has taught me so far, including the parts that don’t work yet. ...

When you start building a new service or product, setting up a payment integration is mostly on the critical path. Whether you are running an e-commerce storefront or building a marketplace that connects service providers with customer demand, choosing the right payment infrastructure matters. In our current stack, we use Chapa, and have designed our system with clean gateway interfaces so that plugging in another provider, such as Stripe, requires minimal code changes. ...