Amazon EC2 P4 Instances
Amazon EC2 P4d instances deliver high performance for machine learning training and high-performance computing applications in the cloud. Powered by NVIDIA A100 Tensor Core GPUs, they offer industry-leading throughput and low-latency networking, supporting 400 Gbps instance networking. P4d instances provide up to 60% lower cost to train ML models, with an average of 2.5x better performance for deep learning models compared to previous-generation P3 and P3dn instances. Deployed in hyperscale clusters called Amazon EC2 UltraClusters, P4d instances combine high-performance computing, networking, and storage, enabling users to scale from a few to thousands of NVIDIA A100 GPUs based on project needs. Researchers, data scientists, and developers can utilize P4d instances to train ML models for use cases such as natural language processing, object detection and classification, and recommendation engines, as well as to run HPC applications like pharmaceutical discovery and more.
Learn more
Rocky Linux
CIQ empowers people to do amazing things by providing innovative and stable software infrastructure solutions for all computing needs. From the base operating system, through containers, orchestration, provisioning, computing, and cloud applications, CIQ works with every part of the technology stack to drive solutions for customers and communities with stable, scalable, secure production environments. CIQ is the founding support and services partner of Rocky Linux, and the creator of the next generation federated computing stack.
- Rocky Linux, open, Secure Enterprise Linux
- Apptainer, application Containers for High Performance Computing
- Warewulf, cluster Management and Operating System Provisioning
- HPC2.0, the Next Generation of High Performance Computing, a Cloud Native Federated Computing Platform
- Traditional HPC, turnkey computing stack for traditional HPC
Learn more
TrinityX
TrinityX is an open source cluster management system developed by ClusterVision, designed to provide 24/7 oversight for High-Performance Computing (HPC) and Artificial Intelligence (AI) environments. It offers a dependable, SLA-compliant support system, allowing users to focus entirely on their research while managing complex technologies such as Linux, SLURM, CUDA, InfiniBand, Lustre, and Open OnDemand. TrinityX streamlines cluster deployment through an intuitive interface, guiding users step-by-step to configure clusters for diverse uses like container orchestration, traditional HPC, and InfiniBand/RDMA architectures. Leveraging the BitTorrent protocol, enables rapid deployment of AI/HPC nodes, accommodating setups in minutes. The platform provides a comprehensive dashboard offering real-time insights into cluster metrics, resource utilization, and workload distribution, facilitating the identification of bottlenecks and optimization of resource allocation.
Learn more
NVIDIA Base Command Manager
NVIDIA Base Command Manager offers fast deployment and end-to-end management for heterogeneous AI and high-performance computing clusters at the edge, in the data center, and in multi- and hybrid-cloud environments. It automates the provisioning and administration of clusters ranging in size from a couple of nodes to hundreds of thousands, supports NVIDIA GPU-accelerated and other systems, and enables orchestration with Kubernetes. The platform integrates with Kubernetes for workload orchestration and offers tools for infrastructure monitoring, workload management, and resource allocation. Base Command Manager is optimized for accelerated computing environments, making it suitable for diverse HPC and AI workloads. It is available with NVIDIA DGX systems and as part of the NVIDIA AI Enterprise software suite. High-performance Linux clusters can be quickly built and managed with NVIDIA Base Command Manager, supporting HPC, machine learning, and analytics applications.
Learn more