Tag: AI Infrastructure
DeepSeek Plans a 160,000-Chip Huawei Cluster in Inner Mongolia
Bloomberg reports DeepSeek will deploy at least 160,000 Huawei Ascend 950DT accelerators in Inner Mongolia — for inference. Training stays on Nvidia.
NVIDIA’s $12.9B Hugging Face Deal Is a Bet on Open Models
NVIDIA will acquire Hugging Face for $12.9 billion. Why the deal's incentives favor open models — and where the neutrality risk actually sits.
Turbovec: Google’s TurboQuant in an Open-Source Rust Index
Turbovec is an MIT-licensed Rust vector index built on Google Research's TurboQuant quantizer, claiming 8x compression and faster search than FAISS.
NVIDIA Claims 30x Efficiency Gain for AI Agents on Vera Rubin
NVIDIA reports Vera Rubin NVL72 delivers up to 30x higher throughput per megawatt and 35x lower token cost than GB300 NVL72 on agentic coding workloads.
Why NVIDIA’s Moat Is Software, and What Would Break It
Rivals have shipped comparable silicon for years without shifting the market. The moat is the software above the chips and the rack around them.
Seven Chokepoints in the AI Chip Supply Chain
A walk down the chain behind one AI accelerator — design tools, foundry, scanner, memory, packaging, software, power — and why each link has no second source.
What One AI Query Costs: Tokens, Bytes, Joules, Cents
One question, one model, one machine — costed end to end. Then four dials that move the same answer by more than 10,000x.
Training vs Inference: Two Economies, Two Opposite Bottlenecks
Training is network-bound and paid once. Serving is memory-bound and paid forever. The crossover point, and why the 2024 chip-demand call was backwards.
From Token to Transistor: What Happens When You Send a Prompt
Follow one prompt through the machine — tokens, matrix multiplications, the memory that everything waits on, and the chips built around a single operation.
China Invests $295B in Huawei-Powered AI Infrastructure
China announces a $295B plan to build a nationwide AI data center network, aiming to replace Nvidia and AMD with domestic Huawei chips.