By putting 1TB of disk storage directly on the graphics card, AMD can move data much faster without going through PCIe and the rest of the PC system, possibly many times faster. At $10,000 per card, this is not a cheap solution, but when you have urgent work that cannot easily scale over multiple nodes, it may well be worth the investment.
Developers will have to create specific code to support the Radeon Pro SSG in their apps, so don’t expect a wide support right now. Niche markets will start first; then the bigger player may provide a software update if their clients’ workloads justify the effort.
Before you get too excited: this is not going to appear in consumer cards anytime soon. First, because game developers are mindful their apps need to work on a large install base, secondly because the extra dollars can probably be spent on something better like performance, a monitor or just a better SSD for your PC.