Quota Management
There are several levels on the Weka system where capacity usage can be restricted.
On an organization level - setting a different organization to manage its own filesystems, where quotas for an organization can be set, as described in the organization's usage and quota management section.
On a filesystem level - setting a different filesystem per department/project.
On a directory level - setting a different quota per project directory (useful when users are part of several projects) or per user home directory.
The organization admin can set a quota on a directory. Setting a quota will start the process of counting the current directory usage. Until this process is done, the quota will not be taken into account (for empty directories, this process is instantly done).
Note: Currently, a mount point to the relevant filesystem is required to set a quota on a directory, and the quota set command should not be interrupted until the quota accounting is over.
The organization admin sets quotas to inform/restrict users from using too much of the filesystem capacity. For that, only data in the user's control is taken into account. Hence, the quota doesn't count the overhead of the protection bits and snapshots. It does take into account data&metadata of files in the directory, regardless if tiered or not.
When working with quotas, consider the following:
Currently, to set a quota, the relevant filesystem must be mounted on the host setting where the set quota command is to be run.
When setting a quota, you should go through a new mount-point. Meaning, if you are using a host that has mounts from Weka versions before 3.10, first unmount all relevant mount point and then mount them again.
Quotas can be set within nested directories and over-provisioned under the same directory quota tree. E.g.,
/homecan have a quota of 1TiB, and each user directory under it can have a quota of 10GiB, while there are 200 users.Before a directory is being deleted, its quota must be removed. A directory tree cannot be deleted without removing all the inner directories quotas beforehand.
Moving files between two directories with quotas is not supported. The WekaFS filesystem returns
EXDEVin such a case, which is usually converted by the operating system to copy&delete but is OS dependant.Quotas and hardlinks:
An existing hardlink is not counted as part of the quota.
Once a directory has a quota, it is not allowed to create a hardlink to files residing under directories with different (or without) directory quotas.
Restoring a filesystem from a snapshot turns the quotas back to the configuration at the time of the snapshot.
Creating a new filesystem from a snap-2-obj does not preserve the original quotas.
When working with enforcing quotas along with a
writecachemount-mode, similarly to other POSIX solutions, getting above the quota might not sync all the cache writes to the backend servers. Usesync,syncfs, orfsyncto commit the cached changes to the system (or fail due to exceeding the quota).Default quotas are statically propagated at folder creation time and turned into regular quotas that can be independently manipulated.
Deletion of such a folder requires removing its propagated quota first.
Command: weka fs quota set / weka fs quota set-default
Use the following commands to set a directory quota:
weka fs quota set <path> [--soft soft] [--hard hard] [--grace grace] [--owner owner]
It is also possible to set a default quota on a directory. It does not account for this directory but will automatically set the quota on directories created directly under it. Use the following command to set a default quota of a directory:
weka fs quota set-default <path> [--soft soft] [--hard hard] [--grace grace] [--owner owner]
Name | Type | Value | Limitations | Mandatory | Default |
| String | Path to the directory to set the quota on. | The relevant filesystem must be mounted when setting the quota. | Yes | |
| Number | Soft quota limit; Exceeding this number will be shown as exceeded quota but will not be enforced until the | Capacity in decimal or binary units, e.g.: | No |
|
| Number | Hard quota limit; Exceeding this number will not allow any more writes before clearing some space in the directory. | Capacity in decimal or binary units, e.g.: | No |
|
| Number | Specify the grace period before the soft limit is treated as a hard limit. | Format: | No |
|
| String | An opaque string identifying the directory owner (can be a name, email, slack ID, etc.) This owner will be shown in the quota report and can be notified upon exceeding the quota. | Up to 48 characters. | No | |
Note: Currently, there is no grace period enforcement for soft quotas, and they are treated as advisory only. In the upcoming releases, these will get enforced.
To set advisory only quotas, use a soft quota limit without setting a grace period.
Command: weka fs quota list / weka fs quota list-default
Use the following command to list the directory quotas (by default, only exceeding quotas are listed) :
weka fs quota list [fs-name] [--snap-name snap-name] [--path path] [--under under] [--over over] [--quick] [--all]
Name | Type | Value | Limitations | Mandatory | Default |
| String | Shows quota report only on the specified filesystem. | A valid wekafs filesystem name. | No | All filesystems |
| String | Shows the quota report from the time of the snapshot. | Must be a valid snapshot name and be given along with the corresponding | No | |
| String | Path to a directory. Shows quota report only on the specified directory. | The relevant filesystem must be mounted in the host running the query. | No | |
| String | A path to a directory under a wekafs mount. | The relevant filesystem must be mounted in the host running the query. | No | |
| Number | Shows only quotas over this percentage of usage | 0-100 | No | |
| Boolean | Do not resolve inode to a path (provides quicker result if the report contains many entries). | | No | False |
| Boolean | Shows all the quotas, not just the exceeding ones. | | No | False |
Use the following command to list the directory default quotas:
weka fs quota list-default [fs-name] [--snap-name snap-name] [--path path]
Name | Type | Value | Limitations | Mandatory | Default |
| String | Shows the default quotas of the specified filesystem only. | A valid wekafs filesystem name. | No | All filesystems |
| String | Shows the default quotas from the time of the snapshot. | Must be a valid snapshot name and be given along with the corresponding | No | |
| String | Path to a directory. Shows the default quotas report only on the specified directory. | The relevant filesystem must be mounted in the host running the query. | No | |
Command: weka fs quota unset / weka fs quota unset-default
Use the following commands to unset a directory quota:
weka fs quota unset <path>
Use the following command to unset a default quota of a directory:
weka fs quota unset-default <path>
Name | Type | Value | Limitations | Mandatory | Default |
| String | Path to the directory to set the quota on | The relevant filesystem must be mounted when setting the quota | Yes | |
