W E K A
3.14
3.14
  • WEKA v3.14 Documentation
  • Weka System Overview
    • About the WEKA System
    • SSD Capacity Management
    • Filesystems, Object Stores & Filesystem Groups
    • Weka Networking
    • Data Lifecycle Management
    • Weka Client & Mount Modes
    • Glossary
  • Getting Started with Weka
    • Quick Install Guide
    • Managing the Weka System
    • CLI Overview
    • GUI Overview
    • Serving IOs with WekaFS
  • Planning & Installation
    • Prerequisites for Installation
    • Bare Metal Installation
      • Planning a Weka System Installation
      • Setting Up the Hosts
        • SR-IOV Enablement
      • Obtaining the Weka Install File
      • Weka System Installation Process Using the CLI
      • Adding Clients
    • AWS Installation
      • Self-Service Portal
      • CloudFormation Template Generator
      • Deployment Types
      • AWS Outposts Deployment
      • Supported EC2 Instance Types
      • Adding Clients
      • Auto Scaling Group
      • Troubleshooting
  • Performance
    • Testing Weka Performance
      • Test Environment Details
  • WekaFS Filesystems
    • Managing Filesystems, Object Stores & Filesystem Groups
      • Managing Object Stores
      • Managing Filesystem Groups
      • Managing Filesystems
      • Attaching/Detaching Object Stores to/from Filesystems
      • KMS Management
    • Advanced Data Lifecycle Management
      • Advanced Time-based Policies for Data Storage Location
      • Data Management in Tiered Filesystems
      • Transition Between Tiered and SSD-Only Filesystems
      • Manual fetch and release of data
    • Mounting Filesystems
    • Snapshots
    • Snap-To-Object
    • Quota Management
  • Additional Protocols
    • NFS
    • SMB
      • SMB Management Using CLIs
      • SMB Management Using the GUI
    • S3
      • S3 Cluster Management
      • S3 Buckets Management
      • S3 Users and Authentication
      • S3 Information Lifecycle Management
      • Audit S3 APIs
      • S3 Limitations
      • S3 Examples using boto3
  • Operation Guide
    • Alerts
      • List of Alerts
    • Events
      • List of Events
    • Statistics
      • List of Statistics
    • System Congestion
    • Security
      • User Management
      • Organizations
    • Expanding & Shrinking Cluster Resources
      • Expand & Shrink Overview
      • Stages in Adding a Backend Host
      • Expansion of Specific Resources
      • Shrinking a Cluster
    • Background Tasks
    • Upgrading Weka Versions
  • Billing & Licensing
    • License Overview
    • Classic License
    • Pay-As-You-Go License
  • Support
    • Prerequisites and Compatibility
    • Getting Support for Your Weka System
    • The Weka Support Cloud
    • Diagnostics CLI Command
  • Appendix
    • Weka CSI Plugin
    • External Monitoring
    • Snapshot Management
  • REST API
Powered by GitBook
On this page
  • Overview
  • Managing Background Tasks
  • Viewing Running Background Tasks
  • ‌Limiting Background Task Resources
  • Pausing/Resuming/Aborting a Background Task
  1. Operation Guide

Background Tasks

This page describes the management of background tasks running on Weka clusters.‌

Overview

‌The Weka system has some internal/external asynchronous operations and maintenance tasks, such as migrating an object store and downloading/uploading snapshots. These tasks are performed in the background and should not interfere nor starve the Weka system from serving IOs with high performance.‌

The Weka system limits the CPU resources these tasks consume to 5% per host CPU.

Note: When the CPU is idle, background tasks can use more than the configured resources, but they are immediately freed if needed for serving IOs.

Note: The configured limit affects both external tasks (that are visible using the GUI/CLI) and internal low priority asynchronous operations.‌

Managing Background Tasks

Viewing Running Background Tasks

It is possible to view currently-running background tasks, including their status and progress.‌

Viewing Background Tasks Using the CLI

‌Command: weka cluster tasks‌

This command is used for viewing all background tasks. For each task, a range of data can be displayed, as shown in the following example:

# weka cluster tasks
Type       | State   | Progress | Description
-----------+---------+----------+-----------------------------------------------------------
OBS_DETACH | RUNNING | 94       | Detaching Object Storage `obs_1` from filesystem `default`

‌Limiting Background Task Resources

It is possible to limit the resources being used by background tasks.

Limiting Background Tasks Using the CLI

Command: weka cluster tasks limits

This command is used to view the defined limits.

Command: weka cluster tasks limits set [--cpu-limit cpu-limit]

This command is used to update the CPU limit.

Pausing/Resuming/Aborting a Background Task

It is possible to pause and later resume a background task, as well as completely abort it. This is useful in case there are other tasks/activities that are of higher priority.

Pausing/Resuming/Aborting Background Tasks Using the CLI

Command: weka cluster tasks pause / resume / abort <task-id>

This command is used to pause/resume/abort the running of a specific task.

Note: Up to 16 background tasks can run in parallel. A paused (or aborting) task still consumes one of these spots.

PreviousShrinking a ClusterNextUpgrading Weka Versions

Last updated 3 years ago