Broadcom NIC requirements for WEKA system

Learn the hardware and software requirements for using Broadcom network adapters with the WEKA system.

circle-info

This guidance applies to environments using Broadcom adapters. Adapter setup procedures may change. Always refer to Broadcom’s official documentation for current tools and firmware packages.

Hardware requirements

The following table lists the hardware requirements for Broadcom adapters.

Component
Requirement

Broadcom adapter

Confirm compatibility with WEKA-supported models. See Supported network adapters for backends and clients.

Virtual Function count

The adapter must support a sufficient number of VFs to match the WEKA core count per server.

SR-IOV enabled

The system BIOS and NIC BIOS must support and enable SR-IOV.

SeeEnable the SR-IOV.

IOMMU disabled

WEKA backend servers and clients with Broadcom NICs do not support IOMMU. You must disable IOMMU before installing the cluster.

To disable IOMMU, update the kernel boot parameters to include intel_iommu=off or amd_iommu=off, depending on the CPU type.

Software prerequisites

The following table lists the software prerequisites for Broadcom adapters.

Component
Requirement

OS

WEKA-supported Linux distribution.

Kernel Version

Compatible with bnxt_en driver version included in the OS.

NIC driver

Use the in-kernel bnxt_en driver. Avoid using legacy versions.

Management utility

Use the latest available version of the Broadcom niccli . Avoid using legacy versions.

Broadcom NIC setup

Follow this procedure to set up your Broadcom NICs for use with the WEKA system.

Procedure

  1. Install the firmware: Install the latest qualified firmware for your specific Broadcom NIC model. You can obtain the firmware from the official Broadcom downloads portal: Broadcom Driver and Firmware Downloadsarrow-up-right.

  2. Configure the VFs on the NIC: The number of Virtual Functions (VFs) configured on the NIC must be at least equal to the number of IO process cores on the server.

    The standard recommendation is to configure 64 VFs, which is sufficient for most deployments with 64 or fewer IO cores. To reduce the creation of unnecessary network interfaces, you can optionally configure the exact number of VFs to match your IO core count.

    Use the niccli utility to set the number of VFs. The following example configures the standard 64 VFs per physical function (PF).

    Replace <ID> with the appropriate device identifier. The -value 0x40 is the hexadecimal representation of 64. If a server has more than 64 IO cores, you must adjust this value to match the core count.

  3. Enable TruFlow and offload features: Run the following commands to ensure that TruFlow and other performance offload features are enabled on the NIC:

After installing the WEKA software

Configure the WEKA software to use the VFs. After installing the WEKA software, configure it to recognize and use the VFs you created on the NIC. You can do this during the WEKA container setup using one of the following methods:

  • Method 1: Using the weka local setup command When setting up the WEKA container, use the --net flag with the vfs@<num_vfs> syntax. The <num_vfs> value must match the number of VFs you configured on the NIC.

    Example: weka local setup container --net vfs@40 ...

  • Method 2: Using the resources file For automated or large-scale deployments, update the vfs_to_create field in the resources.yaml file. Set the value of this field to the number of VFs configured on the NIC.

    Example: vfs_to_create: 40

Last updated