Upgrade Weka versions
This page describes how to upgrade to the latest Weka software version.
Before upgrading your cluster, ensure the following:
- 1.
- 2.All the backend servers are online.
- 3.Any rebuild has been completed.
- 4.There are no outstanding alerts that haven't been addressed.
- 5.There is at least 4 GB of free space in the
/opt/wekadirectory.
Note: If you plan a multi-hop version upgrade, once an upgrade is done, a background process of converting metadata to a new format may occur (in some versions). This upgrade takes several minutes to complete and must finish before another upgrade can start. You can monitor the progress using the
weka status CLI command and check if there is a data upgrade task in aRUNNING state.The Weka upgrade process supports upgrading to higher minor versions and major versions of the Weka software.
When upgrading to a major version, always upgrade to the latest minor version in the new major version. This may require first upgrading to a specific minor version in the current software version, as follows:
- To upgrade to Weka software version 4.0.x, go through version 3.14.1 or above
- To upgrade to Weka software version 3.14.x, go through version 3.13.1 or above
- To upgrade to Weka software version 3.13.x, go through version 3.12.1 or above
- To upgrade to Weka software version 3.12.x, go through version 3.11.0 or above
- To upgrade to Weka software version 3.11.x, go through version 3.10.0 or above
Download the new release on one of the backends using one of the following methods:
- From the backend server, run
weka version get <new-version>where<new-version>is the name of the new version (for example,4.0.1), followed byweka version prepare <new-version>.- If you don't have a distribution server set, you can add it explicitly to the command. For example, to get the
4.0.1version from get.weka.io using a token as follows:
weka version get 4.0.1 --from https://[GET.WEKA.IO-TOKEN]@get.weka.io - From the backend server, run the
curlcommand described in the install tab on the get.weka.io new release page. - Download the new version tar file to the backend server and run the
install.shcommand. This method is helpful in environments without connectivity to get.weka.io, such as dark sites or private VPCs.
When working with many backend servers, it is possible to prepare the backend servers separately from the upgrade process in advance to minimize the total upgrade time. For a small number of backend servers, this step is not required.
The preparation phase prepares all the connected backend servers for the upgrade, which includes downloading the new version and getting it ready to be applied.
Once the new version is downloaded to one of the backend servers (as described above), run the following CLI command:
weka local run --in <new-version> upgrade --prepare-onlyOnce a new software version is installed on one of the backend servers, upgrade the cluster to the new version by running the following command on the backend server:
weka local run --in <new-version> upgradewhere
<new-version> is the name of the new version (for example,4.0.1).The upgrade command skips the download and preparation operations if you already ran the preparation step.
You can control the upgrade window time by setting the following parameters in the
upgrade command:Parameters
Name | Type | Value | Limitations | Mandatory | Default |
--stop-io-timeout | String | Maximum time in seconds to wait for IO to stop successfully | | No | 90s |
--host-version-change-timeout | String | Maximum time in seconds to wait for a host version update | | No | 180s |
--disconnect-stateless-clients-timeout | String | Maximum time in seconds to wait for stateless clients to be marked as DOWN and continue the upgrade without them | | No | 60s |
--prepare-only | Boolean | Download and prepare a new software version across all servers in the cluster without performing the actual upgrade | | No | False |
--health-check-timeout | String | Maximum time in seconds to wait for the health check to complete | | No | 10s |
Note: To run the upgrade command, ensure you are logged in as a Cluster Admin (using a
weka user login).Before switching the cluster to the new release, the upgrade command distributes the new release to all cluster servers. It makes the necessary preparations, such as compiling the new
wekafs driver.If a failure occurs during the preparation, such as the disconnection of a server or failure to build a driver, the upgrade process stops, and a summary message indicates the problematic server.
In a successful process, the upgrade stops the cluster IO service, switches all servers to the new release, and then turns the IO service back on. This process takes about 1 minute, depending on the size of the cluster.
Note: In large deployments of Weka with many backend servers and hundreds or thousands of clients, it is recommended to adjust the following timeout parameters:
- Set
host-version-change-timeoutto600s - Set
disconnect-stateless-clients-timeoutto200s - Set
health-check-timeoutto30s
Once all backends are upgraded, the clients remain with the existing version and continue working with the upgraded backends.
For a stateless client, once it is rebooted, or a complete
umount and mount is performed, the stateless client is automatically upgraded to the backend version.For stateful clients, a manual upgrade is required, usually during a maintenance window.
For a manual upgrade of both stateless or stateful clients, run the following command line on the client:
weka local upgradeAn alert is raised if there is a mismatch between the clients' and the cluster versions.
For client source versions 4.0.1 and above, add the
--prepare-driver flag to the command.Note: Clients with two or more versions behind the version of the backends are not supported. Therefore, clients must be upgraded either automatically or manually before the next software version upgrade.
Once the upgrade is complete, verify that the cluster is in the new version by running the
weka status command.Example: The following is returned when the system is upgraded to version 4.0.1:
# weka status
Weka v4.0.1
...The disruptiveness of the upgrade procedure is limited to a defined window of 10 minutes. Weka system ensures that either the upgrade process to the new version finishes successfully or the version is automatically reverted to the old one within this window.
If a failure occurs, the version is automatically reverted on the backends. In this case, verify that all the backends are reverted to the old version by running the
weka cluster host command.Last modified 10d ago