Documentation revision history
Last updated
Last updated
4.4.2.113
This release introduces several security and usability enhancements and new features for SMB-W parity with legacy SMB. Key updates include support for tagged VLANs for customers using network segregation in tenancy models, enhanced role-based access controls for the Kubernetes CSI driver, and automatic client removal timeouts for short-lifecycle clients. Additionally, users can choose their preferred numeric display format (Base-2 or Base-10) in the GUI.
New CSI operator role: A new csi operator role has been introduced, allowing essential tasks with elevated privileges, such as creating filesystems, monitoring cluster status, and managing snapshots. This role provides necessary functionality without granting full ClusterAdmin or OrgAdmin access. >>>
Tagged VLAN IDs: Tagged VLANs enable per-NIC VLAN assignments for containers, allowing advanced network configurations and integration with diverse setups when mounting filesystems. >>>
Legacy SMB support: As announced in the V4.2.8 release notes, support for legacy SMB is being discontinued. It will be removed in V4.4.5, ahead of the V4.4.6 LTS series. Systems with legacy SMB enabled will not be able to upgrade to V4.4.5.
Updated status values: WEKA S3 clusters now use updated status labels:
Down is now Offline.
Not Ready is now Faulty.
Ready is now Online.
A new status, Saturated, indicates temporary service disruption caused by an overload of S3 requests. The Faulty status reflects more severe issues than Saturated.
Improved Active Directory integration: The SMB-W service now supports the --server and --create-computer options for joining SMB-W clusters to Active Directory. These updates also facilitate the migration of legacy SMB configurations, ensuring improved compatibility. >>>
Dynamic client lifecycle support: The weka local setup container command now supports --auto-remove-timeout and --client options, streamlining management for short-lifecycle clients.
Customizable numeric display format: A new GUI option allows users to switch between Base-2 (binary) and Base-10 (decimal) numeric display formats. This provides flexibility in viewing capacities and metrics based on user preferences. >>>
New security APIs: Added REST APIs corresponding to the CIDR-based security policy CLI commands introduced in a previous release. >>>
AWS solutions: Introduced a new AWS solutions section, starting with the Integrate SageMaker HyperPod with WEKA using Slurm guide, which covers architecture and deployment workflow for the integration. >>>
Synchronous Snap: Updated the note to specify that only snapshots uploaded from version 4.3 or later can be downloaded using Synchronous Snap. Previously, the note indicated version 4.0 or later.
4.4.1
This release includes a variety of optimizations to benefit customers operating the WEKA Data Platform at scale.
Improvements
Added weka driver commands: Introduced a set of tools for managing drivers, including capabilities for building and signing drivers, import/export functionality for easier administration, and readiness checks to enhance reliability. >>>
Added snapshot size estimations: Snapshot listings now include size estimations, helping customers understand the capacity occupied by chains of snapshots. >>>
Expanded CIDR-based security policies: In the previous release, CIDR-based security policies were introduced to manage access to WEKA clusters by client IP address ranges, enhancing security and simplifying administration for Organizations users. This release extends the security policy functionality to include filesystems. >>>
Added support for HashiCorp Vault AppRole: WEKA now supports HashiCorp Vault's security best practice, AppRole. Unlike the traditional token system with long-lived tokens requiring manual refresh, AppRole uses a RoleID and SecretID to retrieve short-lived tokens for accessing secrets. This enhances the security posture of the KMS configuration in WEKA. >>>
Added support for unique KMS Configuration per filesystem: WEKA now supports a separate KMS configuration for each filesystem, replacing the previous cluster-wide configuration. This feature enables customers to use distinct key hierarchies for individual filesystems. >>>
NFS-W enhancements
Added Support for NFSv4 ACLs in NFS-W: NFS-W now supports NFSv4 access control lists (ACLs) up to the extended attribute limit of inodes on WEKA clusters. The mode of NFS-related ACLs can be viewed with weka nfs global-config show and enabled through weka nfs global-config set --acl on. >>>
S3 enhancements
Enhanced WEKA S3 response statistics: WEKA S3 response statistics now include byte counts, response code distribution per minute, and the average time to first byte, providing deeper insights into S3 performance.
Added WEKA S3 events for problem and recovery scenarios: New events for WEKA S3 now cover problem and recovery scenarios. The S3ContainerStatusSaturatedEvent indicates that capacity thresholds have been met, while the S3ContainerStatusOnlineEvent signals that the container is online and available. >>>
Updated weka s3 cluster -v command output: The weka s3 cluster -v command now includes SLB request output, highlighting the limits used in the new saturation event for improved visibility.
SMB-W enhancements
Enhanced UI for ACLs: Access control models that were previously available only via CLI are now visible and selectable in the UI during the Add SMB Share process. >>>
Added direct object store sync option in add SMB share: The new obsDirect option in the add smb share command allows customers to bypass time-based file retention policies. When files are created or written to a share with this option enabled, they are prioritized for immediate release. >>>
Additional enhancements
Added support for GCP regions asia-southeast2 and europe-central2 in Terraform configuration.
CDM Local version 1.2 updates: Supports automated Terraform deployment, removes the Windows installation package, updates the launch process, and enhances information gathering options. >>>
WEKA CSI Plugin version 2.5.0 updates: Provides NFS transport support designed for non-performance-critical scenarios or environments where installing the WEKA client is not feasible. >>>
Certified object stores: Added Dell PowerScale S3 (version 9.8.0.0 and higher) to the certified object stores. >>>
4.4.0
This release includes a variety of optimizations to benefit customers operating the WEKA Data Platform at scale.
Improvements
weka stats performance enhancements reduce the latency of metric reporting, especially on large clusters.
To limit access to POSIX filesystems in Organizations, define access lists by network and role by weka security policy hierarchy. Attach, detach, and test policies by weka org security policy.
Customers using clients with multiple clusters can now store profile tokens and reference them by name for convenience. The profile token location is $HOME/.weka/auth-token-<profile>.json, and invocation by the new profile parameter, such as weka user login [—-profile <profile-name>]. >>>
SMB-W enhancements
WEKA now supports configuring shares with user permissions in advance of validating the user with directory services
Commands share add and share update now support allow-guest-access.
Added the ACLs feature to enable or disable Windows Access-Control Lists for the share, offering options for POSIX, Windows, or Hybrid (default: POSIX) and allowing interoperability by prioritizing the most recent permission based on timestamps.
S3 enhancement
Introduced an updated health-check URL, /wekas3api/health/ready, for load balancers to use in assessing the health of S3 servers, improving monitoring and load balancing capabilities.
Additional enhancements
WEKA client support is extended to: Debian 10, Rocky 8.6, Rocky 8.7, Rocky 8.8, Oracle Linux 9, and SLES 15 SP5.
Added a verification step for LLQ and WC in the upgrade workflow. To ensure proper LLQ functionality after upgrades, verify that Write Combining (WC) is enabled in the igb_uio driver. See .
Added a CLI reference guide, which is generated from the output of running the weka command with the help option. It provides detailed descriptions of available commands, arguments, and options.
Added the WEKApod Data Platform Appliance Guide, which provides comprehensive instructions for setting up and configuring the WEKApod™. The WEKApod is a turnkey data platform appliance designed as a high-performance datastore for NVIDIA DGX SuperPOD. Each appliance includes pre-configured storage servers and software, enabling simplified deployment and faster time to value. >>>
4.3.5
This release aims to enhance usability, focusing on WEKA SMB-W. It also contains field fixes and support for new platforms and hardware.
SMB-W enhancements
Case sensitivity in SMB-W shares, beyond the case insensitive limits of the Microsoft implementation.
Symbolic link following in SMB-W shares.
Named streams support in shares, sometimes called alternate data streams (ADS).
Optional reduction of shared state between SMB-W containers for workloads that don't rely on it.
Zero copy support for MacOS clients is enabled by default, but can be disabled in share options.
Share updates support read-only and hidden properties.
S3 enhancements
Updated the s3 cluster status output to align with the style of weka cluster container, showing details like Hostname, Status, Uptime, Last Error, and Active Requests. Use weka s3 cluster status-old during upgrades, as initial output may be inaccurate until all frontend containers are updated.
Additional enhancements
The REST API for quota listing includes the full directory path, aligning with the CLI command output.
Extended support for operating systems:
Clients: RHEL/Rocky Linux 9.4, AlmaLinux 9.4, 8.10, Debian 12.
Backends: RHEL/Rocky Linux 9.4.
Improved NFS read operation performance.
Added support for Broadcom P2200.
Added support for colored output in the weka status and other table-returning commands, configurable by the --color option or WEKA_CLI_COLOR environment variable. See .
Introduced the Data Services container for running resource-intensive background tasks, starting with the Quota Coloring task, with more tasks to be supported in future releases. >>>
4.3.4
This release contains an important enhancement for clusters under extreme memory pressure.
N/A
Added a new topic to WEKA and Slurm integration: Avoid conflicting CPU allocations.
4.3.3
NFS locking is fully supported for protocol versions 3 and 4, and configurable through global parameters.
Added support for additional QLC drives for higher density deployments while maintaining high performance and longevity standards.
SMB-W performance is optimized for macOS clients.
SMB-W share access now supports allow and deny statements based on IP address.
For Windows clients with many top-level entities, folder options appear without delay.
WEKA client support extended to Rocky 8.10, Rocky 8.9, Rocky 9.3, and Oracle Linux 9.
WEKA backend support extended to Rocky 8.10.
4.3.2
Added graceful container management to ensure safe stopping or restarting of a container. >>>
Added the WEKA Cloud Deployment Manager (CDM Web) User Guide, simplifying the deployment of WEKA clusters in public cloud environments (including AWS, Azure, and GCP). >>>
A new algorithm for multi-part uploads is now the default, decreasing resource overhead for most customers using WEKA S3.
WEKA S3 response codes are now in weka stats, with types and categories listed under Operation (Envoy).
WEKA S3 logs now report real remote client addresses via the X-Forwarded-For header.
The default memory limit for SMB-W containers has been raised to 32GB to accommodate trends in customer requirements related to SMB protocol performance.
Deprecation
RHEL 7 and CentOS 7 support have reached EOL status.
Deployment on Amazon EC2 instance families M4, R3, R4, and C4 are no longer supported.
4.3.1
4.3.0
Initial support for ARM, specifically for ARM-based EC2 instances in AWS. To reflect the instruction set architecture of hosts in a cluster, APIs, and commands like the Weka cluster server list now contain an architecture column.
Added NFS integration with Kerberos service. >>>
Synchronized snapshots have been re-enabled.
A new --client-only flag in the weka version get and weka version set commands. When used, this flag ensures that only components necessary for stateless clients are considered for installation.
Discontinued support for Intel processor families SandyBridge (2011) and IvyBridge (2012).
Discontinued support for the legacy NFS stack in 4.3.0. If legacy NFS is enabled, upgrading to 4.3.0 will fail.
weka alerts command output update
The muted column is removed from the weka alerts command output unless --muted or -v is provided.
weka nfs interface-group add command update
The manage-gids parameter, which was always set to true, has been eliminated from the weka nfs interface-group add command and associated API.
weka fs tier s3 command output update
The following columns have been removed from the weka fs tier s3 command output: NODES UP, NODES DOWN, and NODES UNKNOWN. Instead, more detailed columns have been added in the verbose output (using -v).