All pages
Powered by GitBook
1 of 2

Loading...

Loading...

Documentation revision history

WEKA version
Description of changes

Added new topics:

  • Access S3 using AWS CLI: Configure and use the AWS CLI with WEKA’s S3 storage.

  • Install SMB on AWS: Set up SMB in AWS for secure file sharing and access control.

Removed Azure deployment sections due to a known network issue in Azure deployments that causes performance degradation in versions 4.1 to 4.4.0. This issue is resolved in version 4.4.1 and later.

For updated guidance, see the sections in the Version 4.4 documentation.

  • Updated the note to specify that only snapshots uploaded from version 4.3 or later can be downloaded using Synchronous Snap. Previously, the note indicated version 4.0 or later.

  • Added support for GCP regions asia-southeast2 and europe-central2 in Terraform configuration.

  • CDM Local version 1.2 updates: Supports automated Terraform deployment, removes the Windows installation package, updates the launch process, and enhances information gathering options.

4.3.5

This release aims to enhance usability, focusing on WEKA SMB-W. It also contains field fixes and support for new platforms and hardware.

SMB-W enhancements

  • Case sensitivity in SMB-W shares, beyond the case insensitive limits of the Microsoft implementation.

  • Symbolic link following in SMB-W shares.

4.3.4

  • This release contains an important enhancement for clusters under extreme memory pressure.

Introducing WEKA CSI Plugin version 2.5.0, which provides NFS transport support designed for non-performance-critical scenarios or environments where installing the WEKA client is not feasible.

  • Added the WEKApod Data Platform Appliance Guide, which provides comprehensive instructions for setting up and configuring the WEKApod™. The WEKApod is a turnkey data platform appliance designed as a high-performance datastore for NVIDIA DGX SuperPOD. Each appliance includes pre-configured storage servers and software, enabling simplified deployment and faster time to value. For details, see WEKApod.

  • Named streams support in shares, sometimes called alternate data streams (ADS).
  • Optional reduction of shared state between SMB-W containers for workloads that don't rely on it.

  • Zero copy support for MacOS clients is enabled by default, but can be disabled in share options.

  • Share updates support read-only and hidden properties.

  • S3 enhancements

    • Updated the s3 cluster status output to align with the style of weka cluster container, showing details like Hostname, Status, Uptime, Last Error, and Active Requests. Use weka s3 cluster status-old during upgrades, as initial output may be inaccurate until all frontend containers are updated.

    Additional enhancements

    • The REST API for quota listing includes the full directory path, aligning with the CLI command output.

    • Extended support for operating systems:

      • Clients: RHEL/Rocky Linux 9.4, AlmaLinux 9.4, 8.10, Debian 12, Ubuntu 24.04.

      • Backends: RHEL/Rocky Linux 9.4.

    • Extended support for OFED 24.04-07.0.0.

    • Improved NFS read operation performance.

    • Added support for Broadcom P2200.

    • Added support for colored output in the weka status and other table-returning commands, configurable by the --color option or WEKA_CLI_COLOR environment variable. See .

    • Introduced the Data Services container for running resource-intensive background tasks, starting with the Quota Coloring task, with more tasks to be supported in future releases. See .

    N/A

    • Added a new topic to WEKA and Slurm integration: Avoid conflicting CPU allocations.

    4.3.3

    • NFS locking is fully supported for protocol versions 3 and 4, and configurable through global parameters.

    • Added support for additional QLC drives for higher density deployments while maintaining high performance and longevity standards.

    • SMB-W performance is optimized for macOS clients.

    • SMB-W share access now supports allow and deny statements based on IP address.

    • For Windows clients with many top-level entities, folder options appear without delay.

    • WEKA client support extended to Rocky/RHEL 8.9 and 9.3, and Oracle Linux 9.

    4.3.2

    • Added graceful container management to ensure safe stopping or restarting of a container. See Graceful container management: ensuring safe actions.

    • Added the WEKA Cloud Deployment Manager (CDM) User Guide, simplifying the deployment of WEKA clusters in public cloud environments (including AWS, Azure, and GCP).

    • A new algorithm for multi-part uploads is now the default, decreasing resource overhead for most customers using WEKA S3.

    • WEKA S3 response codes are now in weka stats, with types and categories listed under Operation (Envoy).

    • WEKA S3 logs now report real remote client addresses via the X-Forwarded-For header.

    • The default memory limit for SMB-W containers has been raised to 32GB to accommodate trends in customer requirements related to SMB protocol performance.

    Deprecation

    • RHEL 7 and CentOS 7 support have reached EOL status.

    • Deployment on Amazon EC2 instance families M4, R3, R4, and C4 are no longer supported.

    4.3.1

    • Added a topic to restrict a stateless client’s operations to only the essential APIs for mounting and unmounting operations. See Isolated port for restricted stateless client operations.

    • Added the following instance types to the Client EC2 instances section: C7a, M7i, R7a, X2idn, X2iedn, R7iz, R7g, R7gd, R6g, R6gd, G6, GR6, F1, and Z1d.

    4.3.0

    • Initial support for ARM, specifically for ARM-based EC2 instances in AWS. To reflect the instruction set architecture of hosts in a cluster, APIs, and commands like the Weka cluster server list now contain an architecture column.

    • Added NFS integration with Kerberos service.

    • Synchronized snapshots have been re-enabled.

    • A new --client-only flag in the weka version get and weka version set commands. When used, this flag ensures that only components necessary for stateless clients are considered for installation.

    • Discontinued support for Intel processor families SandyBridge (2011) and IvyBridge (2012).

    • Discontinued support for the legacy NFS stack in 4.3.0. If legacy NFS is enabled, upgrading to 4.3.0 will fail.

    • weka alerts command output update The muted column is removed from the weka alerts command output unless --muted or -v is provided.

    • weka nfs interface-group add command update The manage-gids parameter, which was always set to true, has been eliminated from the weka nfs interface-group add command and associated API.

    • weka fs tier s3 command output update The following columns have been removed from the weka fs tier s3 command output: NODES UP, NODES DOWN, and NODES UNKNOWN. Instead, more detailed columns have been added in the verbose output (using -v).

    >>>
    >>>
    WEKA Installation on Azure
    Set up a Data Services container for background tasks

    WEKA v4.3 documentation

    Welcome to the WEKA Documentation Portal, your guide to the latest WEKA version. Whether you're a newcomer or a seasoned user, explore topics from system fundamentals to advanced optimization strategies. Choose your WEKA version from the top menu for version-specific documentation.

    WEKA version selector

    Important: This documentation applies to the WEKA system's latest minor version (4.3.X). For information on new features and supported prerequisites released with each minor version, refer to the relevant release notes available at get.weka.io.

    Check the release notes for details about any updates or changes accompanying the latest releases.

    Get answers from WEKA documentation with Sevii AI

    Sevii AI quickly delivers answers from WEKA documentation. Type your question and click . For the best results, ask clear, context-rich questions.

    About WEKA documentation

    This portal encompasses all documentation essential for comprehending and operating the WEKA system. It covers a range of topics:

    WEKA system overview: Delve into the fundamental components, principles, and entities constituting the WEKA system.

    Planning and installation: Discover prerequisites, compatibility details, and installation procedures for WEKA clusters on bare metal, AWS, GCP, and Azure environments.

    Getting started with WEKA: Initiate your WEKA journey by learning the basics of managing a WEKA filesystem through the GUI and CLI, executing initial IOs, and exploring the WEKA REST API.

    Performance: Explore the results of FIO performance tests on the WEKA filesystem, ensuring optimal system performance.

    WEKA filesystems & object stores: Understand the role and management of filesystems, object stores, filesystem groups, and key-management systems within WEKA configurations.

    Additional protocols: Learn about the supported protocols—NFS, SMB, and S3—for accessing data stored in a WEKA filesystem.

    Operation guide: Navigate through various WEKA system operations, including events, statistics, user management, upgrades, expansion, and more.

    Licensing: Gain insights into WEKA system licensing options. How to obtain a classic WEKA license and apply it to the WEKA cluster.

    Monitor the WEKA cluster: Deploy the WEKA Management Server (WMS) alongside tools like Local WEKA Home, WEKAmon, and SnapTool to effectively monitor your WEKA cluster.

    WEKA support: Find guidance on obtaining support for the WEKA system and effectively managing diagnostics.

    Best practice guides: Explore our carefully selected guides, starting with WEKA and Slurm integration, to discover expert-recommended strategies and insights for optimizing your WEKA system and achieving peak performance in various scenarios.

    WEKApod: Explore the WEKApod Data Platform Appliance Guide for step-by-step instructions on setting up and configuring the WEKApod™. This turnkey solution, designed for NVIDIA DGX SuperPOD, features pre-configured storage and software for quick deployment and faster value.

    Appendices: Explore the Appendices for various topics, including the WEKA CSI Plugin, which connects Kubernetes worker nodes to the WEKA data platform, and other tools and procedures that can enhance your work with WEKA.

    For maintenance and troubleshooting articles, search the WEKA Knowledge Base in the or contact the .

    Conventions

    • The documentation marks the CLI mandatory parameters with an asterisk (*).

    • New additions in V4.3 are marked with two asterisks (**) in the and topics.

    Documentation feedback

    We welcome your feedback to improve our documentation. Include the document version and topic title with your suggestions and email them to . For technical inquiries, contact our . Thank you for helping us maintain high-quality resources.

    WEKA support portal
    Customer Success Team
    WEKA REST API and equivalent CLI commands
    WEKA CLI hierarchy
    [email protected]
    Customer Success Team
    WEKA CLI command output colors