NVIDIA Grace Software with Red Hat Enterprise Linux 9#

NVIDIA® Grace systems can run Red Hat® Enterprise Linux® (RHEL) and take advantage of the advanced Grace features. This document explains how to install and configure Grace systems with RHEL 9.2 and later.

Attention

Although it might be possible to use other Linux distributions that are related to (or inspired by) RHEL, for example CentOS Stream, only RHEL has been pre-validated with the steps described by this guide for installation on Grace platforms.

Document History#

Date

Description

July 21, 2023

  • Initial release.

September 18, 2023

  • Updated Appendix D with the minimum kernel versions that contain the fix for those issues.

December 18, 2023

  • Added Appendix A.1 and RHEL 9.3.

March 8, 2024

  • Clarifications to the install steps.

  • A boot workaround to Appendix D.1.

  • A note to Appendix A.1 about explicitly requiring the open-source GPU driver.

May 30, 2024

  • Updated Appendix A.1 with new driver level.

  • Added Appendix A.2.

  • Added additional clarification notes to the install steps.

September 16, 2024

  • Updated Appendix A.1 with an additional step to install the driver.

  • Updated Appendix D.1 with a known kernel issue and the recommended fix.

October 25, 2024

  • Added the following content to Appendix D.1:

    • NVIDIA BlueField-3 issue with RHEL 9.4 GA kernel.

    • Cpufreq issue seen with RHEL 9.4.

    • PCIe BAR assignment with NVIDIA BlueField-3.

December 17, 2024

  • Updated Appendix A.2 to NVIDIA DOCA-OFED.

March 7, 2025

  • Updated Appendix A.2 with extra steps for DOCA-OFED.

May 8, 2025

  • Modified Appendix A to require NVIDIA DOCA installation before NVIDIA GPU driver.

  • Updated Appendix with new driver level.

  • Updated Appendix with steps to use BFB bundle to flash NVIDIA BlueField-3 firmware.

Prerequisites#

This section lists the required (or recommended) prerequisites:

Red Hat Subscription#

A Red Hat subscription is required to install and use RHEL 9 on the Grace platform. A subscription allows you to obtain update packages and additional packages for RHEL. To purchase a subscription or obtain a free evaluation subscription, go to the Red Hat Software & Download Center.

Access to Repositories#

The repositories can be accessed from the internet. If you are using a proxy server, follow the instructions in the Red Hat Advanced Installation Guide to ensure that the system can access the necessary URIs.

Red Hat Repositories#

To install software for the Grace platform over RHEL 9, you need access to the following repositories:

  • Red Hat Enterprise BaseOS Repository: rhel-9-for-aarch64-baseos-rpms

  • Red Hat Enterprise AppStream Repository: rhel-9-for-aarch64-appstream-rpms