How to manage storage buckets¶
Storage buckets let you store and manage object-based data using non-local object storage.
Unlike custom storage volumes, storage buckets cannot be attached to instances. Instead, applications access them directly via a URL using the S3 protocol.
A Ceph RADOS Gateway endpoint provides the S3-compatible URL.
View storage buckets¶
To list all available storage buckets in a storage pool, run:
lxc storage bucket list <pool-name>
To show detailed information about a specific bucket, run:
lxc storage bucket show <pool-name> <bucket-name>
Select Buckets from the Storage section of the main navigation.
Create a storage bucket¶
Requirements¶
Your LXD server must have access to a Ceph Object storage pool.
To view available storage pools, run:
lxc storage list
If you see a storage pool in the output with the cephobject driver, you’re all set. Continue on to the instructions below to create a storage bucket.
If you don’t see a pool that uses a cephobject storage driver, you must create one before you can continue. This requires a Ceph cluster with a RADOS Gateway (radosgw) enabled. See our how-to guide for storage pools: Requirements for Ceph-based storage pools.
To create a storage bucket, select Buckets from the Storage section of the main navigation.
On the resulting screen, click Create bucket in the upper-right corner.
In the form that appears, set a unique name for the storage bucket and select a storage pool. You can optionally configure the bucket’s size and description.
Finally, click Create bucket.
Create a bucket on a single, non-clustered LXD server¶
To create a storage bucket on a non-clustered LXD server, run:
lxc storage bucket create <pool-name> <bucket-name> [configuration_options...]
See the Ceph Object documentation for a list of available storage bucket configuration options for the driver.
Create a bucket on a cluster member¶
Distributed storage buckets¶
Storage buckets created in cephobject storage pools are available from any LXD cluster member. Thus, to create this bucket, the command remains the same as for a non-clustered LXD server:
lxc storage bucket create <pool-name> <bucket-name> [configuration_options...]
Configure storage bucket settings¶
See the Ceph Object documentation for a list of available storage bucket configuration options for the driver.
Use the following command to set configuration options for a storage bucket:
lxc storage bucket set <pool-name> <bucket-name> <key> <value>
For example, to set the size (quota) of a bucket, use the following command:
lxc storage bucket set my-pool my-bucket size 1MiB
You can also edit the storage bucket configuration by using the following command:
lxc storage bucket edit <pool-name> <bucket-name>
Use the following command to delete a storage bucket and its keys:
lxc storage bucket delete <pool-name> <bucket-name>
To configure a storage bucket, select Buckets from the Storage section of the main navigation.
The resulting screen shows a list of existing storage buckets. Click the Edit button on the row of the desired bucket to access its details.
After making changes, click the Save changes button. This button also displays the number of changes you have made.
Resize a storage bucket¶
By default, storage buckets do not have a quota applied.
To set or change a quota for a storage bucket, set its size configuration:
lxc storage bucket set <pool-name> <bucket-name> size <new-size>
Important
Growing a storage bucket usually works (if the storage pool has sufficient storage).
You cannot shrink a storage bucket below its current used size.
To configure a storage bucket, select Buckets from the Storage section of the main navigation.
The resulting screen shows a list of existing storage buckets. Change the quota of the bucket by changing the values in the Size fields.
After making changes, click the Save changes button. This button also displays the number of changes you have made.
Manage storage bucket keys¶
To access a storage bucket, applications must use a set of S3 credentials made up of an access key and a secret key. You can create multiple sets of credentials for a specific bucket.
Each set of credentials is given a key name. The key name is used only for reference and does not need to be provided to the application that uses the credentials.
Each set of credentials has a role that specifies what operations they can perform on the bucket.
The roles available are:
admin- Full access to the bucketread-only- Read-only access to the bucket (list and get files only)
If the role is not specified when creating a bucket key, the role used is read-only.
View storage bucket keys¶
Use the following command to see the keys defined for an existing bucket:
lxc storage bucket key list <pool-name> <bucket-name>
Use the following command to see a specific bucket key:
lxc storage bucket key show <pool-name> <bucket-name> <key-name>
To view storage bucket keys, select Buckets from the Storage section of the main navigation.
Click the name of a storage bucket to display its key management page, where you can view and manage a list of keys for that bucket.
Create keys¶
Use the following command to create a set of credentials for a storage bucket:
lxc storage bucket key create <pool-name> <bucket-name> <key-name> [configuration_options...]
Use the following command to create a set of credentials for a storage bucket with a specific role:
lxc storage bucket key create <pool-name> <bucket-name> <key-name> --role=admin [configuration_options...]
These commands will generate and display a random set of credential keys.
To create a storage bucket key, go to the key management page of the desired bucket.
On the resulting screen, click Create key in the upper-right corner.
In the form that appears, set a unique name for the key. You can optionally configure the role, description of your storage bucket key.
While you can enter values for the Access and Secret Key fields, this is not necessary. You can leave them blank, and LXD will generate random values for those credential keys.
Finally, click Create key.
Edit or delete storage bucket keys¶
Use the following command to edit an existing bucket key:
lxc storage bucket key edit <pool-name> <bucket-name> <key-name>
Use the following command to delete an existing bucket key:
lxc storage bucket key delete <pool-name> <bucket-name> <key-name>
To edit or delete storage bucket keys, go to the key management page of the desired bucket.
From here, use the Edit or Delete button in the row of the target key.