Documentation revision history
Last updated
Last updated
WEKA version | Description of changes |
---|---|
4.4.1
This release includes a variety of optimizations to benefit customers operating the WEKA Data Platform at scale.
Improvements
Added weka driver commands: Introduced a set of tools for managing drivers, including capabilities for building and signing drivers, import/export functionality for easier administration, and readiness checks to enhance reliability. >>>
Added snapshot size estimations: Snapshot listings now include size estimations, helping customers understand the capacity occupied by chains of snapshots. >>>
Expanded CIDR-based security policies: In the previous release, CIDR-based security policies were introduced to manage access to WEKA clusters by client IP address ranges, enhancing security and simplifying administration for Organizations users. This release extends the security policy functionality to include filesystems. >>>
Added support for HashiCorp Vault AppRole: WEKA now supports HashiCorp Vault's security best practice, AppRole. Unlike the traditional token system with long-lived tokens requiring manual refresh, AppRole uses a RoleID and SecretID to retrieve short-lived tokens for accessing secrets. This enhances the security posture of the KMS configuration in WEKA. >>>
Added support for unique KMS Configuration per filesystem: WEKA now supports a separate KMS configuration for each filesystem, replacing the previous cluster-wide configuration. This feature enables customers to use distinct key hierarchies for individual filesystems. >>>
NFS-W enhancements
Added Support for NFSv4 ACLs in NFS-W: NFS-W now supports NFSv4 access control lists (ACLs) up to the extended attribute limit of inodes on WEKA clusters. The mode of NFS-related ACLs can be viewed with weka nfs global-config show
and enabled through weka nfs global-config set --acl on
. >>>
S3 enhancements
Enhanced WEKA S3 response statistics: WEKA S3 response statistics now include byte counts, response code distribution per minute, and the average time to first byte, providing deeper insights into S3 performance. >>>
Added WEKA S3 events for problem and recovery scenarios: New events for WEKA S3 now cover problem and recovery scenarios. The S3ContainerStatusSaturatedEvent
indicates that capacity thresholds have been met, while the S3ContainerStatusOnlineEvent
signals that the container is online and available. >>>
Updated weka s3 cluster -v
command output: The weka s3 cluster -v
command now includes SLB request output, highlighting the limits used in the new saturation event for improved visibility.
SMB-W enhancements
Enhanced UI for ACLs: Access control models that were previously available only via CLI are now visible and selectable in the UI during the Add SMB Share process. >>>
Added direct object store sync option in add SMB share: The new obsDirect
option in the add smb share
command allows customers to bypass time-based file retention policies. When files are created or written to a share with this option enabled, they are prioritized for immediate release. >>>
Additional enhancements
Added support for GCP regions asia-southeast2
and europe-central2
in Terraform configuration.
CDM Local version 1.2 updates: Supports automated Terraform deployment, removes the Windows installation package, updates the launch process, and enhances information gathering options. >>>
WEKA CSI Plugin version 2.5.0 updates: Provides NFS transport support designed for non-performance-critical scenarios or environments where installing the WEKA client is not feasible. >>>
Certified object stores: Added Dell PowerScale S3 (version 9.8.0.0 and higher) to the certified object stores. >>>
4.4.0
This release includes a variety of optimizations to benefit customers operating the WEKA Data Platform at scale.
Improvements
weka stats
performance enhancements reduce the latency of metric reporting, especially on large clusters.
To limit access to POSIX filesystems in Organizations, define access lists by network and role by weka security policy
hierarchy. Attach, detach, and test policies by weka org security policy
.
Customers using clients with multiple clusters can now store profile tokens and reference them by name for convenience. The profile token location is $HOME/.weka/auth-token-<profile>.json
, and invocation by the new profile parameter, such as weka user login [—-profile <profile-name>]
. >>>
SMB-W enhancements
WEKA now supports configuring shares with user permissions in advance of validating the user with directory services
Commands share add
and share update
now support allow-guest-access
.
Added the ACLs feature to enable or disable Windows Access-Control Lists for the share, offering options for POSIX, Windows, or Hybrid (default: POSIX) and allowing interoperability by prioritizing the most recent permission based on timestamps.
S3 enhancement
Introduced an updated health-check URL, /wekas3api/health/ready
, for load balancers to use in assessing the health of S3 servers, improving monitoring and load balancing capabilities.
Additional enhancements
WEKA client support is extended to: Debian 10, Rocky 8.6, Rocky 8.7, Rocky 8.8, Oracle Linux 9, and SLES 15 SP5.
Added a verification step for LLQ and WC in the upgrade workflow. To ensure proper LLQ functionality after upgrades, verify that Write Combining (WC) is enabled in the igb_uio driver. See .
Added a CLI reference guide, which is generated from the output of running the weka command with the help option. It provides detailed descriptions of available commands, arguments, and options.
Added the WEKApod Data Platform Appliance Guide, which provides comprehensive instructions for setting up and configuring the WEKApod™. The WEKApod is a turnkey data platform appliance designed as a high-performance datastore for NVIDIA DGX SuperPOD. Each appliance includes pre-configured storage servers and software, enabling simplified deployment and faster time to value. >>>
4.3.5
This release aims to enhance usability, focusing on WEKA SMB-W. It also contains field fixes and support for new platforms and hardware.
SMB-W enhancements
Case sensitivity in SMB-W shares, beyond the case insensitive limits of the Microsoft implementation.
Symbolic link following in SMB-W shares.
Named streams support in shares, sometimes called alternate data streams (ADS).
Optional reduction of shared state between SMB-W containers for workloads that don't rely on it.
Zero copy support for MacOS clients is enabled by default, but can be disabled in share options.
Share updates support read-only and hidden properties.
S3 enhancements
Updated the s3 cluster status
output to align with the style of weka cluster container
, showing details like Hostname, Status, Uptime, Last Error, and Active Requests. Use weka s3 cluster status-old
during upgrades, as initial output may be inaccurate until all frontend containers are updated.
Additional enhancements
The REST API for quota listing includes the full directory path, aligning with the CLI command output.
Extended support for operating systems:
Clients: RHEL/Rocky Linux 9.4, AlmaLinux 9.4, 8.10, Debian 12.
Backends: RHEL/Rocky Linux 9.4.
Improved NFS read operation performance.
Added support for Broadcom P2200.
Added support for colored output in the weka status
and other table-returning commands, configurable by the --color
option or WEKA_CLI_COLOR
environment variable. See .
Introduced the Data Services container for running resource-intensive background tasks, starting with the Quota Coloring task, with more tasks to be supported in future releases. >>>
4.3.4
This release contains an important enhancement for clusters under extreme memory pressure.
N/A
Added a new topic to WEKA and Slurm integration: Avoid conflicting CPU allocations.
4.3.3
NFS locking is fully supported for protocol versions 3 and 4, and configurable through global parameters.
Added support for additional QLC drives for higher density deployments while maintaining high performance and longevity standards.
SMB-W performance is optimized for macOS clients.
SMB-W share access now supports allow and deny statements based on IP address.
For Windows clients with many top-level entities, folder options appear without delay.
WEKA client support extended to Rocky 8.10, Rocky 8.9, Rocky 9.3, and Oracle Linux 9.
WEKA backend support extended to Rocky 8.10.
4.3.2
Added graceful container management to ensure safe stopping or restarting of a container. >>>
Added the WEKA Cloud Deployment Manager (CDM Web) User Guide, simplifying the deployment of WEKA clusters in public cloud environments (including AWS, Azure, and GCP). >>>
A new algorithm for multi-part uploads is now the default, decreasing resource overhead for most customers using WEKA S3.
WEKA S3 response codes are now in weka stats
, with types and categories listed under Operation (Envoy).
WEKA S3 logs now report real remote client addresses via the X-Forwarded-For header.
The default memory limit for SMB-W containers has been raised to 32GB to accommodate trends in customer requirements related to SMB protocol performance.
Deprecation
RHEL 7 and CentOS 7 support have reached EOL status.
Deployment on Amazon EC2 instance families M4, R3, R4, and C4 are no longer supported.
4.3.1
4.3.0
Initial support for ARM, specifically for ARM-based EC2 instances in AWS. To reflect the instruction set architecture of hosts in a cluster, APIs, and commands like the Weka cluster server list
now contain an architecture column.
Added NFS integration with Kerberos service. >>>
Synchronized snapshots have been re-enabled.
A new --client-only
flag in the weka version get
and weka version set
commands. When used, this flag ensures that only components necessary for stateless clients are considered for installation.
Discontinued support for Intel processor families SandyBridge (2011) and IvyBridge (2012).
Discontinued support for the legacy NFS stack in 4.3.0. If legacy NFS is enabled, upgrading to 4.3.0 will fail.
weka alerts
command output update
The muted
column is removed from the weka alerts
command output unless --muted
or -v
is provided.
weka nfs interface-group add
command update
The manage-gids
parameter, which was always set to true, has been eliminated from the weka nfs interface-group add
command and associated API.
weka fs tier s3
command output update
The following columns have been removed from the weka fs tier s3
command output: NODES UP, NODES DOWN, and NODES UNKNOWN. Instead, more detailed columns have been added in the verbose output (using -v
).