Giter Club home page Giter Club logo

multiminio's Introduction

MultiMinio: High-Availability Minio/S3 Client Wrapper

MultiMinio

MultiMinio is a Python library designed to provide a high-availability wrapper around multiple Minio client instances. By orchestrating the behavior of multiple Minio clients, MultiMinio ensures resilience and failover, enhancing the reliability of your data storage operations.

This library acts as a wrapper around multiple Minio client instances, offering seamless failover and health-check capabilities.

If one Minio instance becomes unreachable or is detected as unhealthy, the MultiMinio automatically reroutes requests to the next available Minio client, ensuring uninterrupted access to your object storage.

With its built-in health check mechanism, configurable timeouts, and logging features, MultiMinio ensures optimal performance and reliability for mission-critical applications leveraging Minio's storage capabilities.

Features

  • Multiple Minio Clients: Manage and utilize multiple Minio client instances simultaneously.
  • Health Checks: Automated health checks for the Minio instances to determine their availability.
  • Resilience Mechanisms:
  • Fallback: Currently, MultiMinio supports the Fallback resilience mechanism, ensuring requests are directed to healthy Minio instances when others are unavailable. This assumes that Minio instances are synchronized in an Eventually Consistent manner.
  • Future Implementations: In upcoming versions, MultiMinio will introduce RoundRobin and Random load balancing techniques, adding more flexibility and options for directing traffic among Minio instances.
  • Customizable Settings: Configure health check intervals, timeouts, and other parameters to suit your needs.

Installation

Install MultiMinio directly from PyPi using pip (https://pypi.org/project/multiminio/):

pip install multiminio

Usage

Here's a basic example of how to use MultiMinio with two Minio client instances:

from multiminio import MultiMinio
from minio import Minio

# Create two Minio client instances
client1 = Minio("localhost:9001")
client2 = Minio("localhost:9002")

# Bundle the Minio clients into a MultiMinio instance
minio_client = MultiMinio(clients=[client1, client2])

Configuration

Initialization Parameters

  • clients: List of initialized Minio client instances.
  • fallback_timeout: Maximum time to wait for a healthy client to become available. Default is 60.0 seconds.
  • health_check_timeout: Duration to wait for the health check request to complete. Default is 5.0 seconds.
  • health_check_heartbeat: Interval between health checks. Default is 300.0 seconds.
  • max_try_timeout: Maximum time to wait for a single request to complete. Default is 60.0 seconds.
  • health_check_interval`: Minimum interval between consecutive health checks. Default is 10.0 seconds.

Contribution

If you'd like to contribute to the development of MultiMinio, please fork the repository and submit a pull request.

License

MultiMinio is licensed under MIT license.

Author

Andrei Suiu

Support

For any queries or issues, please open an issue on the GitHub repository, and we'll address it promptly.

multiminio's People

Contributors

asuiu avatar

Stargazers

 avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.