AI Companies with Custom Chips Can't Escape the 'Memory Wall'

I tried breaking down the bottlenecks in large model inference. Compute power is visible, but storage is the invisible ceiling. Anthropic reaching out to SK Hynix wasn’t a whim; once compute scales to a certain level, memory bandwidth and capacity become the unavoidable hurdle.