Purpose OVH Swift object storage is widely used. It's crucial for

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

Add OVH swift storage backend about ralph HOT 1 CLOSED

jmaupetit commented on July 18, 2024

Add OVH swift storage backend

from ralph.

Comments (1)

jmaupetit commented on July 18, 2024

@SergioSim a draft implementation has been made in a Jupyter notebook. Parts of this draft implementation follows.

Requirements

python-keystoneclient
python-swiftclient

Configuration

Configure your OpenStack environment:

$ export OS_AUTH_URL="https://auth.cloud.ovh.net/"
$ export OS_TENANT_ID="xxx"
$ export OS_TENANT_NAME="xxx"
$ export OS_PASSWORD="xxx"
$ export OS_USERNAME="xxx"
$ export OS_LRS_CONTAINER_URL="xxx"```

Download archives

import logging
import os

from swiftclient.service import SwiftService, SwiftError
logging.basicConfig(level=logging.INFO)
logging.getLogger("requests").setLevel(logging.ERROR)
logging.getLogger("swiftclient").setLevel(logging.ERROR)
logger = logging.getLogger(__name__)


def download(container, objects, options=None):
    with SwiftService(options=options) as swift:
        try:
            for download in swift.download(container=container, objects=objects):
                if download['success']:
                    logger.info("Successfully downloaded: %s", download['object'])
                else:
                    logger.error("Failed to download: %s", download['object'])
        except SwiftError as e:
            logger.error(e.value)
            raise e

container = "lrs-xapi-statements"
archives = ["2020-04-29.gz", ]
options = {
    "os_storage_url": os.environ["OS_LRS_CONTAINER_URL"].replace(f"/{container}", "")
}

download(container, archives, options)