NVIDIA-acquired Groq moves next-gen LPUs from SRAM to 3D stacked DRAM
According to Wccftech, NVIDIA-acquired Groq plans to use 3D stacked DRAM instead of SRAM in its next-generation LPUs. The company is betting on capacity over speed to address the memory demands of growing models. Current Groq LPUs pack 500 MB of SRAM with 150 TB/s of bandwidth.