OpenAI and Broadcom release Jalapeño, an inference chip optimized for LLMs

OpenAI and Broadcom have introduced a custom AI chip called Jalapeño, designed specifically for LLM inference. The two companies say the chip aims to improve AI systems' performance, efficiency, and scale.