Category: AI

Read the full series: Running AI models locally gives you privacy, no rate limits, and better per-token cost once you pass the break-even point. This is the first article in a series documenting our AI Inference Server — a local AI setup built on affordable, mostly repurposed hardware. Read the full series: [Part 1: The…
Read more

Inside the DGX Spark Cluster: 2-Node Configuration Our DGX Spark Cluster is a pair of NVIDIA DGX Spark units running distributed inference with vLLM and Ray. This is the second article in a four-part series documenting each cluster size with real-world metrics, cost analysis, and operational details. Read the full series: [Part 1] Single-Node DGX…
Read more

Inside the DGX Spark Cluster: Single-Node Configuration The DGX Spark Cluster is a series of articles documenting each cluster size with real-world metrics, cost analysis, and operational details. This is the first article in the four-part series. Read the full series: [Part 1] Single-Node Configuration — Baseline performance, memory headroom, and cost efficiency [Part 2]…
Read more