posted by Hot Aisle 21 days ago

$0.01 / gpu / hour - 8 MI300Xs available from 04/03/2024 to 04/30/2024 (United States)

Unverified
Interconnect: RoCE
Cores per node: 128
RAM per node: 3027 GB
NVME storage per node: 155 GB
Location: United States
Cloud provider: Hot Aisle
Cluster interface: K8s, Slurm, VM (we have separate management servers)
Minimium bookable GPUs: 1
Minimium bookable duration: 1 week
Additional details
We're excited to announce that Hot Aisle (https://hotaisle.xyz) has just launched our business, with our first batch of AMD MI300x GPUs.
Hot Aisle is a cloud compute provider with a focus on delivering AMD hardware CPU/GPU resources for AI and ML workloads. We're offering direct bare metal access (ssh/bmi) to top-tier hardware, complemented by our premium white glove customer service.
Specifically focused around the MI300x and Bergamo/Genoa line of processors. The company caters to a variety of businesses, from startups to larger enterprises, offering them the computational capabilities they need without the upfront investment in physical hardware.
Our vision is to create a supercomputer powered by many more of these GPUs, accessible to anyone*, at competitive rates. While Nvidia has clearly cornered the market, we feel that having an alternative solution is critical to the long term safety and security of AI.
Our setup includes the Supermicro AS-8125GS-TNMR2 chassis, equipped with 8x MI300x GPUs (totaling 1.5TB of accelerator memory), dual 9754 CPUs, 3TB of system RAM, and 155TB of NVMe storage. It's a powerhouse! We also have more than capable management servers for all your K8s / slurm / ray workflow needs.
Given the novelty of the MI300x GPUs and the scarcity of information available, we're on the lookout for experts to conduct unbiased benchmarks and share their insights through public blog posts, highlighting both the pros and cons. We're flexible with the testing setup, offering either full system access or 1-2 GPUs via a VM (and PCIe pass-through), _completely free of charge_, for a limited time.
If this opportunity intrigues you, please get in touch. Thanks for your time and looking forward to your feedback.
* Legally allowed within US export restrictions
contact seller

seller email domain is hotaisle.xyz