Broadcom adapter setup for WEKA system

Before a WEKA system can use a Broadcom adapters, the server must have the necessary drivers and firmware from Broadcom's download center.

Set up the drivers and software

Procedure:

1. Download software bundle: Access Broadcom's download center and download the software bundle onto the target server. Carefully review the instructions included in the bundle.

2. Compile and install: Follow the provided instructions to compile and install the following components:

   • bnxt_en driver.

   • sliff driver.

   • niccli command line utility.

3. Post-installation steps: After installation, run one of the following commands based on the Linux distribution:

   • dracut -f

   • update-initramfs -u

4. Reboot the server: Reboot the server to apply the changes.

Install the firmware

After installing Broadcom drivers and software, install the firmware included in the download bundle. Firmware files are typically named after the adapter they are intended for, such as BCM957508-P2100G.pkg.

Procedure:

1. Identify the target adapter: Use the command niccli --list to list Broadcom adapters and identify the target adapter by its decimal device number:

# niccli --list
----------------------------------------------------------------------------
Scrutiny NIC CLI v227.0.130.0 - Broadcom Inc. (c) 2023 (Bld-61.52.25.90.16.0) 
----------------------------------------------------------------------------
     BoardId     MAC Address        FwVersion    PCIAddr      Type   Mode
  1) BCM57508    84:16:0A:3E:0E:20  224.1.102.0  00:0d:00:00  NIC    PCI
  2) BCM57508    84:16:0A:3E:0E:21  224.1.102.0  00:0d:00:01  NIC    PCI

1. Identify the device: From the niccli --list output, choose the device identifier (for example, 1 for BCM57508).

# niccli --dev 1 install BCM957508-P2100G.pkg

1. Confirm and complete the installation: Follow the prompts to confirm and complete the firmware update.

Broadcom NetXtreme-C/E/S firmware update and configuration utility version v227.0.120.0
NetXtreme-E Controller #1 at PCI Domain:0000 Bus:3b Dev:00 Firmware on NVM - v224.1.102.0
NetXtreme-E Controller #1 will be updated to firmware version v227.1.111.0

Do you want to continue (Y/N)?y

NetXtreme-C/E/S Controller #1 is being updated....................................................
Firmware update is completed.
A system reboot is needed for the firmware update to take effect.

1. Reboot the server: Reboot the server to apply the firmware update.

Update NVM settings

To enable WEKA system compatibility, configure certain NVM options to increase the number of Virtual Functions (VFs) and enable TruFlow.

Procedure:

1. Increase the number of VFs to 64: Run the following commands:

   niccli --dev 1 nvm --setoption enable_sriov --value 1
   niccli --dev 1 nvm --setoption number_of_vfs_per_pf --scope 0 --value 0x40
   niccli --dev 1 nvm --setoption number_of_vfs_per_pf --scope 1 --value 0x40

2. Enable TruFlow: Run the following commands:

   niccli --dev 1 nvm --setoption enable_truflow --scope 0 --value 1
   niccli --dev 1 nvm --setoption enable_truflow --scope 1 --value 1

3. Additional configuration for BCM57508-P2100G: Run the following command:

   niccli --dev 1 nvm --setoption afm_rm_resc_strategy --value 1

4. Reboot the server: Reboot the server to apply the changes.

The adapter is ready for use by the WEKA system.