OpenStack Object Storage

Red Cloud object storage can be accessed using the following interfaces:

Web Interface

Red Cloud object storage is accessible via Openstack web interface. After logging into the web interface,

• Under the "Project" tab, click on "Object Store,", or
• Go to https://redcloud.cac.cornell.edu/dashboard/project/containers for direct access.

Swift

• CLI client: the swift command is part of the Openstack CLI client.
• Swift SDKs in a variety of languages.

S3

1. To use the S3 interface, first create ec2 credentials for your Openstack account using the openstack ec2 credentials create command in the Openstack CLI client.
   • List existing ec2 credentials in your Openstack account using the openstack ec2 credentials list command or revoke one using openstack ec2 credentials delete.
2. You can use an s3 client or SDK to access the object storage. For reference, here's a configuration file for s3cmd

    [default]
    access_key = <>
    secret_key = <>
    host_base = redcloud.cac.cornell.edu:8443
    host_bucket = redcloud.cac.cornell.edu:8443
    signature_v2 = True
    bucket_location = US
    default_mime_type = binary/octet-stream
    delete_removed = False
    dry_run = False
    encoding = UTF-8
    encrypt = False
    follow_symlinks = False
    force = False
    get_continue = False
    gpg_command = /usr/local/bin/gpg
    gpg_decrypt = %(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
    gpg_encrypt = %(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
    gpg_passphrase =
    guess_mime_type = True
    human_readable_sizes = False
    list_md5 = False
    preserve_attrs = True
    progress_meter = True
    recursive = False
    recv_chunk = 4096
    reduced_redundancy = False
    send_chunk = 4096
    skip_existing = False
    socket_timeout = 300 
    urlencoding_mode = normal
    use_https = True
    verbosity = WARNING

Globus

Red Cloud object storage is accessible via the cac#redcloud Globus collection. See documentation here on Globus access.

Access Red Cloud Object Storage via Globus

1. First create ec2 credentials for your Openstack account using the openstack ec2 credentials create command in the Openstack CLI client.
   • List existing ec2 credentials in your Openstack account using the openstack ec2 credentials list command or revoke one using openstack ec2 credentials delete.
   • If you have multiple Red Cloud accounts, you can only configure one account for Globus access at any given time.
2. Follow Globus instructions on how to access files on AWS S3 with Globus using
   • The cac#redcloud Globus collection, and
   • The ec2 credentials you obtained using the openstack ec2 credentials list command in the previous step.