Microsoft has announced the development of its new ND A100 v4 VM—an AI virtual machine series designed to give its customers a massive AI processing boost. Microsoft made the announcement on its Azure blog, saying that the new series will be available soon.
The new virtual machine series starts with eight NVIDIA Ampere A100 GPUs—from there, customers can ramp up to as many GPUs as they need—each has 1.6Tb/s of bandwidth. The GPUs (which are faster on AI applications than CPUs) are all connected via a 200GB/s InfiniBand link. In its blog post, Microsoft claims this offers customers 16 times more bandwidth than its competitors.
Microsoft also points out that the new series will be backed up by a newly engineered AMD Rome-powered platform that conforms to all industry hardware standards, and will therefore be twice as fast as their current platform. Microsoft says the new system will give customers a two to three times boost in performance compared to the current virtual machines series, and customers will not have to do any new engineering work on their end as part of setup.