Why is it so hard to move AI workloads off NVIDIA?

1. The moat is day-one model support

AMD’s Anush Elangovan describes what the alternative platform used to feel like: ROCm support was a “port to platform.” Someone would launch a model, and then someone else would go in and make it work. The change he points to is that the recent frontier releases (DeepSeek, Llama, Qwen) run natively from day zero, as well as they do on the competing platform. That confidence is what a buyer is paying NVIDIA for: a model announced this morning runs on their cluster this afternoon.

Update, October 3, 2026: At 9:13 in episode 72, Anush Elangovan describes AMD’s expanded testing across frameworks and hardware generations. Elangovan says AMD can block upstream pull requests and test them on AMD hardware to help prevent regressions from changes tested only on NVIDIA. For a team evaluating the day-one support discussed above, upstream testing is an ongoing compatibility check to ask about.

2. The specs are the catchable part

Hardware differences show up on a roadmap and get closed on a roadmap. AMD’s CDNA4 generation added FP6 as a stepping stone toward FP4, so a team can move parts of a model down in precision in stages. The 350 series ships 288 GB of memory per GPU, which on AMD’s own framing puts a 500-billion-parameter model on a single card. NVIDIA’s Blackwell Ultra now matches that 288 GB, and AMD’s newer MI455X, launched in July 2026, raises it to 432 GB. Memory capacity is where AMD keeps pressing its case. None of that, by itself, moves a workload.

3. The other exit is owning the whole stack

Google took the path almost nobody else can afford. TPUs sit under XLA as the target compiler, and JAX sits on top of XLA, the framework Google DeepMind uses in research and in production. Paige Bailey’s point is that JAX is loved partly because it uses TPUs so well, and scales not just across many TPUs but across multiple data centers, which is what training Gemini requires. Vertical integration from silicon to framework is why the optimizations available to Google are not available to a team renting someone else’s stack.

4. Open is the counter-strategy, and it is a software strategy

AMD’s bet is that an open ecosystem out-innovates a closed one, and the tell is where they applied it: the software review process is moving outside the company, so any developer working in an area reviews the changes in it. Partners build switches, NICs, and interconnects around them rather than at the periphery of a proprietary fabric. The pitch is about the stack rather than the accelerator: you should not have to buy the whole thing from the company that sells you the chip.

Why it matters

If you are evaluating accelerators on FLOPS and memory, you are comparing the part that converges. Ask instead how long after a model release your team can run it, who fixes the kernel when it breaks, and what you would have to rewrite to leave. That answer is the switching cost.