OpenAI and Broadcom unveil Jalapeño LLM inference chip

OpenAI and Broadcom announced Jalapeño, a custom ASIC designed for large language model inference in data centers. The chip, developed over nine months, aims to deliver substantially better performance per watt than current state-of-the-art. OpenAI plans to reduce dependence on Nvidia through vertical integration.