Topic: Matmul

1 chapters across the catalog

Sand Battery
Episode 1672 1:15:05 - 1:18:09

1672: Sand Battery

Matrix Multiplication Breakthrough, Threat to Nvidia

Researchers have reportedly developed a way to run large language models (LLMs) without "matrix multiplication" (MatMul), the core computational task currently handled by Nvidia GPUs. This new method could allow AI to run on significantly less power (13 watts) using FPGA chips, potentially threatening Nvidia's 90% market share in the data center sector.