Links

Upgrade Weka versions

This page describes how to upgrade to the latest Weka software version.

Upgrade prerequisites

Before upgrading your cluster, ensure the following:
  1. 1.
    The backend servers meet the prerequisites and compatibility of the target version.
  2. 2.
    All the backend servers are online.
  3. 3.
    Any rebuild has been completed.
  4. 4.
    There are no outstanding alerts that haven't been addressed.
  5. 5.
    There is at least 4 GB of free space in the /opt/weka directory.
Note: If you plan a multi-hop version upgrade, once an upgrade is done, a background process of converting metadata to a new format may occur (in some versions). This upgrade takes several minutes to complete and must finish before another upgrade can start. You can monitor the progress using the weka status CLI command and check if there is a data upgrade task in aRUNNING state.

Supported upgrade paths

The Weka upgrade process supports upgrading to higher minor versions and major versions of the Weka software.
When upgrading to a major version, always upgrade to the latest minor version in the new major version. This may require first upgrading to a specific minor version in the current software version, as follows:
  • To upgrade to Weka software version 4.0.x, go through version 3.14.1 or above
  • To upgrade to Weka software version 3.14.x, go through version 3.13.1 or above
  • To upgrade to Weka software version 3.13.x, go through version 3.12.1 or above
  • To upgrade to Weka software version 3.12.x, go through version 3.11.0 or above
  • To upgrade to Weka software version 3.11.x, go through version 3.10.0 or above
For more information, contact the Customer Success Team.

Prepare the cluster for upgrade

Download the new release on one of the backends using one of the following methods:
  • From the backend server, run weka version get <new-version> where <new-version> is the name of the new version (for example,4.0.1), followed by weka version prepare <new-version>.
    • If you don't have a distribution server set, you can add it explicitly to the command. For example, to get the 4.0.1 version from get.weka.io using a token as follows:
    weka version get 4.0.1 --from https://[GET.WEKA.IO-TOKEN]@get.weka.io
  • From the backend server, run the curl command described in the install tab on the get.weka.io new release page.
  • Download the new version tar file to the backend server and run the install.sh command. This method is helpful in environments without connectivity to get.weka.io, such as dark sites or private VPCs.

Prepare the backend servers for upgrade (optional)

When working with many backend servers, it is possible to prepare the backend servers separately from the upgrade process in advance to minimize the total upgrade time. For a small number of backend servers, this step is not required.
The preparation phase prepares all the connected backend servers for the upgrade, which includes downloading the new version and getting it ready to be applied.
Once the new version is downloaded to one of the backend servers (as described above), run the following CLI command:
weka local run --in <new-version> upgrade --prepare-only

Upgrade the backend servers

Once a new software version is installed on one of the backend servers, upgrade the cluster to the new version by running the following command on the backend server:
weka local run --in <new-version> upgrade
where <new-version> is the name of the new version (for example,4.0.1).
The upgrade command skips the download and preparation operations if you already ran the preparation step.
You can control the upgrade window time by setting the following parameters in the upgrade command:
Parameters
Name
Type
Value
Limitations
Mandatory
Default
--stop-io-timeout
String
Maximum time in seconds to wait for IO to stop successfully
No
90s
--host-version-change-timeout
String
Maximum time in seconds to wait for a host version update
No
180s
--disconnect-stateless-clients-timeout
String
Maximum time in seconds to wait for stateless clients to be marked as DOWN and continue the upgrade without them
No
60s
--prepare-only
Boolean
Download and prepare a new software version across all servers in the cluster without performing the actual upgrade
No
False
--health-check-timeout
String
Maximum time in seconds to wait for the health check to complete
No
10s
Note: To run the upgrade command, ensure you are logged in as a Cluster Admin (using a weka user login).
Before switching the cluster to the new release, the upgrade command distributes the new release to all cluster servers. It makes the necessary preparations, such as compiling the new wekafs driver.
If a failure occurs during the preparation, such as the disconnection of a server or failure to build a driver, the upgrade process stops, and a summary message indicates the problematic server.
In a successful process, the upgrade stops the cluster IO service, switches all servers to the new release, and then turns the IO service back on. This process takes about 1 minute, depending on the size of the cluster.
Note: In large deployments of Weka with many backend servers and hundreds or thousands of clients, it is recommended to adjust the following timeout parameters:
  • Set host-version-change-timeout to 600s
  • Set disconnect-stateless-clients-timeout to 200s
  • Set health-check-timeout to 30s
If further assistance and adjustments are required, contact the Customer Success Team.

Upgrade the clients

Once all backends are upgraded, the clients remain with the existing version and continue working with the upgraded backends.
For a stateless client, once it is rebooted, or a complete umount and mount is performed, the stateless client is automatically upgraded to the backend version.
For stateful clients, a manual upgrade is required, usually during a maintenance window.
For a manual upgrade of both stateless or stateful clients, run the following command line on the client:
weka local upgrade
An alert is raised if there is a mismatch between the clients' and the cluster versions.
For client source versions 4.0.1 and above, add the --prepare-driver flag to the command.
Note: Clients with two or more versions behind the version of the backends are not supported. Therefore, clients must be upgraded either automatically or manually before the next software version upgrade.

Check the status after the upgrade

Once the upgrade is complete, verify that the cluster is in the new version by running the weka status command.
Example: The following is returned when the system is upgraded to version 4.0.1:
# weka status Weka v4.0.1 ...

Upgrade revert on failure

The disruptiveness of the upgrade procedure is limited to a defined window of 10 minutes. Weka system ensures that either the upgrade process to the new version finishes successfully or the version is automatically reverted to the old one within this window.
If a failure occurs, the version is automatically reverted on the backends. In this case, verify that all the backends are reverted to the old version by running the weka cluster host command.