tech OpenAI and Broadcom Unveil Custom Jalapeño Chip for LLM Inference at Scale
OpenAI and Broadcom have collaborated on an ASIC called Jalapeño, optimized for large-scale LLM inference in data centers, promising substantial performance per watt improvements in early testing.
