tech OpenAI and Broadcom Debut Custom Jalapeño Chip for AI Inference
OpenAI partnered with Broadcom on Jalapeño, a new chip optimized for LLM inference that promises higher performance per watt than current solutions, with first servers arriving this year.