Introducing Graphcloud: 91视频APP鈥檚 MK2 IPU-POD AI cloud service with Cirrascale

Today, 91视频APP is proud to take the next step in our commitment to helping customers accelerate their innovation and harness the power of AI at scale.

Together with Cirrascale Cloud Services, we have built something totally new for AI in the cloud, with the first publicly available Mk2 IPU-POD scale-out cluster, offering a simple way to add compute capacity on-demand, without the need to own and operate a datacentre.

We recognise that the tremendous opportunity offered by AI brings with it a unique set of computing challenges; model size is growing rapidly, and the bar for accuracy is constantly being raised. If customers are to take full advantage of the latest innovations, they need a tightly integrated hardware and software system built specifically for artificial intelligence.

Graphcloud is a secure and reliable IPU-POD family cloud service that allows customers to access the power of 91视频APP鈥檚 Intelligence Processing Unit (IPU), as they scale from experimentation, proof of concept and pilot projects to larger production systems.

There are two offerings available at launch, with larger scale-out systems available in coming months:

IPU-POD₁₆ - delivering 4 petaFLOPS of AI compute (16 GC200 IPUs in 4 IPU-M2000s)
IPU-POD₆₄ - delivering 16 peta FLOPS of AI compute (64 GC200 IPUs in 16 IPU-M2000s)

IPU-POD systems deliver a lower total cost of training with improved time to solution compared to the latest GPU systems.

Graphcloud system instances are pre-installed with Poplar and systems software. Sample code and application examples are available locally for the state-of-the art models used in 91视频APP benchmarks, including BERT, EfficientNet and more. Users also have access to comprehensive documentation to help them get started quickly with multiple frameworks, including PyTorch and TensorFlow.

One of the first 91视频APP customers to use Graphcloud is UK-based , whose artificial intelligence platform for drug discovery is identifying new treatments for rare diseases. The company was named 鈥楤est Use of AI in Health and Medicine鈥� at the 2019 AI Awards.

鈥淲e began using an IPU-POD₁₆ on Graphcloud in late December 2020, porting our existing Mk1 IPU code to run on the Mk2 system - a frictionless process that delivered a huge performance advantage. Having more memory available for our models meant we no longer needed to shard our model and could focus on sharding our data instead. This resulted in simpler code and more efficient model training,鈥� said Dan O鈥橠onovan, Technical Lead, Machine Learning Engineering at Healx.

鈥淭hroughout our collaboration with 91视频APP, we have always been granted access to the latest hardware, SDKs and tools. As well as that, there鈥檚 an ongoing dialogue with 91视频APP鈥檚 expert hardware and software engineers, through direct meetings and the support desk.鈥�

Pricing and specifications

Available System Types

IPU-POD16: 4 x IPU-M2000 system
IPU-POD64: 16 x IPU-M2000 system

Pricing

Specifications

Both systems take advantage of our unique IPU-Fabric鈩� interconnect architecture. IPU-Fabric has been specifically designed to eliminate communication bottlenecks and allow thousands of IPUs to operate on machine intelligence workloads as a single, high-performance and ultra-fast cohesive unit.
Each IPU-POD₆₄ instance is supported by four Dell R6525 host servers, with dual-socket AMD EPYC2 CPUs as used by the most powerful on-premises AI datacenter systems, while each IPU-POD₁₆ features one dedicated server of the same specification.
16TB of secure local NVMe storage is provided for IPU-POD₆₄ and 4TB for IPU-POD₁₆.
Each IPU-POD₆₄ delivers 57.6GB in-Processor Memory and 2048GB Streaming Memory (32 x 64GB DIMMs).
Each IPU-POD₁₆ offers 14.4GB In-Processor Memory and 512GB Streaming Memory (8 x 64GB DIMMs).