OpenAI and Broadcom unveil LLM-optimized inference chip

OpenAI and Broadcom introduced Jalapeño, a custom AI chip designed for LLM inference to improve performance and efficiency. OpenAI plans to use enough of these chips to consume 10 gigawatts of electricity, an amount that could power millions of households.