Manage S3 buckets using the CLI
This page describes how to manage S3 buckets using the CLI.
Using the CLI, you can:
Create a bucket
Command: weka s3 bucket create
Use the following command line to create an S3 bucket:
weka s3 bucket create <name> [--policy policy] [--policy-json policy-json] [--hard-quota hard-quota] [--fs-name fs-name] [--fs-id fs-id] [--existing-path existing-path]
S3 does not support creating buckets on filesystems with names containing the characters '
', '(
',
')
', or '&
'. Verify that the filesystem name excludes these characters. Rename the filesystem if needed before creating the S3 bucket.
Parameters
policy
The name of a pre-defined bucket policy for anonymous access.
Possible values: none
, download
, upload
, public
.
none
policy-json
A path to a custom policy JSON file representing an S3 bucket policy for anonymous access.
hard-quota
Hard quota for the S3 bucket.
You can only set on a new bucket without existing data. You cannot set it when using existing-path
to an existing directory with data.
fs-name
Existing filesystem name to create the bucket within.
Possible values: fs-name
, fs-id
.
The default filesystem specified when creating the S3 cluster.
fs-id
Existing filesystem ID to create the bucket within.
Possible values: fs-name
, fs-id
.
The default filesystem specified when creating the S3 cluster.
existing-path
Existing directory path relative to the filesystem root to expose a bucket from.
List buckets
Command: weka s3 bucket list
Use this command to list existing buckets.
Set a bucket quota
Command: weka s3 bucket quota set
Use the following command line to set an S3 bucket quota:
weka s3 bucket quota set <bucket-name> <hard-quota>
Parameters
bucket-name
*
The name of an existing S3 bucket.
hard-quota
*
Hard quota for the S3 bucket. You can only set it initially on an empty bucket. Calling this command on a bucket that already has a quota changes the quota limitation.
Unset a bucket quota
Command: weka s3 bucket quota unset <bucket-name>
Use this command to unset an existing bucket quota.
If the bucket point to a directory shared with other protocols, changing the quota affects all protocols (changes the associated directory quota).
Delete a bucket
Command: weka s3 bucket destroy
Use this command to delete an existing bucket from the filesystem only if the bucket is empty. If the bucket is not empty, you can keep the data on the filesystem and remove the bucket from the S3 configuration.
weka s3 bucket destroy <name> [--unlink]
Parameters
name
*
The name of an existing S3 bucket.
unlink
Detaches the bucket from the S3 configuration and keeps the data and metadata in place. Consequently, you can recreate the bucket while preserving the data and metadata (see weka s3 bucket create
using the existing-path
option).
Note: If the intent is to keep the data files for use outside of the S3 configuration and delete only the S3 metadata, contact the Customer Success Team for assistance.
Manage bucket policies
It is possible to set bucket policies for anonymous access. You can choose a pre-defined policy or add a customized policy.
Set a pre-defined bucket policy
A bucket is automatically created without any anonymous access permissions. You can use one of the pre-defined policies: download
, upload
, or public
.
Example: For a bucket named mybucket
, the following are the pre-defined policy values:
Command: weka s3 bucket policy set
Use the following command line to set a pre-defined bucket policy:
weka s3 bucket policy set <bucket-name> <bucket-policy>
Parameters
bucket-name
*
Name of an existing S3 bucket.
bucket-policy
*
Name of a pre-defined bucket policy for anonymous access.
Possible values: none
, download
, upload
, public
.
Set a custom bucket policy
To create a custom policy, you can use AWS Policy Generator and select S3 Bucket Policy
type. With a custom policy, it is possible to limit anonymous access only to specific prefixes.
For example, to set a custom policy for mybucket
to allow read-only access for objects with a public/
prefix, the custom policy, as generated with the calculator, is:
Command: weka s3 bucket policy set-custom
Use the following command line to set a custom bucket policy:
weka s3 bucket policy set-custom <bucket-name> <policy-file>
Parameters
bucket-name
*
Name of an existing S3 bucket.
policy-file
*
A path to a custom JSON file representing an S3 bucket policy for anonymous access.
Wildcards (such as s3:*
) are not allowed as an Action
in the custom policy file.
See Supported Policy Actions.
View a bucket policy
Command: weka s3 bucket policy get / weka s3 bucket policy get-json
Use the following command line to view an S3 bucket policy name/JSON:
weka s3 bucket policy get <bucket-name> / weka s3 bucket policy get-json <bucket-name>
Parameters
bucket-name
*
Name of an existing S3 bucket.
Unset a bucket policy
Command: weka s3 bucket policy unset
Use the following command line to unset an S3 bucket policy:
weka s3 bucket policy unset <bucket-name>
Parameters
Name
Value
bucket-name
*
Name of an existing S3 bucket.
Last updated