OpenAI and Broadcom built the Jalapeño inference chip in about 9 months—from concept to tape-out—on a 3nm process.
OpenAI and Broadcom built the Jalapeño inference chip in about 9 months—from concept to tape-out—on a 3nm process. That's one of the fastest high-performance ASIC cycles on record. The chip is purpose-built for LLM inference, not a repurposed training design.
Broadcom CEO Hock Tan stated it delivers roughly 50% lower cost per inference compared to typical AI GPUs. This is a targeted move to cut one of the largest operating expenses in running large models at scale, with OpenAI exploring hardware options to achieve this goal.
The initial deployment window is late 2026, with ramping volume after that. If Jalapeño hits its targets, it could pressure Nvidia's inference margins, where much of the current AI infrastructure spend sits.
What makes this notable is the specificity: a named cost target, a clear timeline, and a partner like Broadcom with execution credibility. Most AI chip projects never make it to tape-out, let alone with a 50% cost delta in sight.
Broadcom's next earnings call will be worth watching. Any mention of volume commitments or production plans for Jalapeño could signal how serious this push really is.
For now, $AVGO trades at $363.35, down 2.8% today. The market hasn't priced in a near-term disruption to AI infrastructure economics, but OpenAI and Broadcom are clearly building as if they intend to make one.
Will this chip shift the balance, or just ease OpenAI's own costs? Depends on how widely it's adopted beyond their own stack.
Not financial advice. For informational and educational purposes only.
