Giter Club home page Giter Club logo

stargate-grpc-rust-client's Introduction

Maven Central

Stargate

An open source data API gateway.

Stargate is a data gateway deployed between client applications and a Cassandra database. For developers, it makes it easy to use Cassandra for any application workload by adding plugin support for new APIs, data types, and access methods - even secondary database models. It's built with extensibility as a first-class citizen to enable rapid innovation. For operators, Stargate introduces microservice architecture, allowing independent deployment and scale of storage nodes, API Service nodes, and coordinator nodes in Cassandra clusters.

  • For quick instructions on how to bring up Stargate on your desktop using Docker, check out the Docker compose instructions.
  • If you wish to deploy in Kubernetes, there is also a Helm chart you can use to install Stargate alongside an existing Cassandra cluster, or visit the K8ssandra project for a distribution that packages Cassandra, Stargate, and additional tooling.
  • For more information about how to deploy and use Stargate, visit stargate.io
  • To learn how to participate in our community, visit our community page
  • To set up and use a Stargate development environment, see the instructions for the coordinator and APIs.

Contents

Introduction

We created Stargate because we got tired of using different databases and different APIs depending on the work that we were trying to get done. With "read the manual" fatigue and lengthy selection processes wearing on us every time we started a new project, we thought - why not create a framework that can serve many APIs for a range of workloads?

This project enables customization of all aspects of data access and has modules for authentication, APIs, request handling / routing, and persistence backends.
The current form is specific to Apache Cassandra (C*) compatible backends.

As shown in the figure below, Stargate is often deployed behind a load balancer or proxy and exposes multiple endpoints to client applications, including HTTP APIs, gRPC, and the Cassandra Query Language (CQL). Stargate sits in front of a Cassandra cluster which is used as the storage backend.

image

Stargate consists of the following components, which we introduce briefly here with links to the corresponding modules in this monorepo.

API Services

These are independently scalable microservices which various APIs, typically HTTP based. These modules can be found under the apis directory:

  • sgv2-restapi: API implementation for exposing Cassandra data over REST
  • sgv2-graphqlapi: API implementation for exposing Cassandra data over GraphQL
  • sgv2-docsapi: API implementation for exposing Cassandra data over a Document API

Each API Service contains its own integration test suite that tests it against the coordinator node and supported Cassandra backends. There is also a sgv2-quarkus-common module containing utilities that may be used by all Java/Quarkus based API services.

Coordinator Node

Coordinator nodes participate as non-data storing nodes in the backing Cassandra cluster, which enables them to read and write data more efficiently. Stargate Coordinator nodes can also be scaled independently. Coordinator nodes expose gRPC and CQL interfaces for fast access by client applications. The following are the key modules comprising the coordinator and its exposed interfaces:

  • core: Common classes used throughout the other coordinator modules
  • cql: API implementation for the Cassandra Query Language
  • grpc: fast CQL over gRPC implementation (HTTP-based interface equivalent to CQL performance)
  • bridge: gRPC-based interface used by API services
  • health-checker: HTTP endpoints useful for health checking coordinator nodes
  • metrics-jersey: metrics collection for the coordinator node and its exposed interfaces
  • stargate-starter: the main Java application used to start the coordinator via the starctl script

Persistence Services

Stargate coordinator nodes support a pluggable approach for implementing the coordination layer to execute requests passed by API services and other interfaces to underlying data storage instances. Persistence service implementations are responsible handling and converting requests to database queries, dispatching to a specific version of Cassandra, and returning and serving responses.

  • persistence-api: Interface for working with persistence services
  • persistence-common: Utilities shared by the persistence services
  • persistence-cassandra-3.11: Joins C* 3.11 cluster as coordinator-only node (does not store data) mocks C* system tables for native driver integration, executes requests with C* storage nodes using C* QueryHandler/QueryProcessor, converts internal C* objects and ResultSets to Stargate Datastore objects.
  • persistence-cassandra-4.0: (same as above but for Cassandra 4.0)
  • persistence-dse-6.8: (same as above but for DataStax Enterprise 6.8)

Authentication and Authorization Services

Stargate coordinator nodes also support a pluggable authentication and authorization approach.

Coordinator Node Testing

The following modules provide support for testing:

  • testing: Integration test suite for the coordinator node modules
  • testing: Testing helpers
  • persistence-test: Common utilities for testing persistence services

Instructions for running and extending the test suite can be found in the developer guide.

Repositories

Here is an overview of the key repositories in the Stargate GitHub organization:

The organization also contains several gRPC client libraries for various languages.

Issue Management

You can reference the CONTRIBUTING.md for a full description of how to get involved, but the short of it is below.

  • If you've found a bug (use the bug label) or want to request a new feature (use the enhancement label), file a GitHub issue
  • If you're not sure about it or want to chat, reach out on our Discord
  • If you want to write some user docs 🎉 head over to the stargate/docs repo, Pull Requests accepted!

Supported Versions and Branching Strategy

The Stargate project maintains support for the current major version number and one major version number previous. We mark the previous major version number as deprecated in order to encourage usage of the latest version. We anticipate supporting a major version number release N for one year after the subsequent major version number release (N+1), or until the major version number release (N+2), whichever comes first. For example, v1 will be supported until when Stargate v3 is released, but no later than October 2023 (1 year after release date of Stargate v2). We anticipate producing a new major version number release every 6-12 months.

Supporting a release entails making bug fixes, keeping dependencies up to date, and making sure Docker images are free from vulnerabilities.

The current major version is maintained on the default main branch. The prior major version number is maintained on a version branch, for example, v1.

We make bug fixes in all supported releases. The recommended approach is to commit a fix first to the previous major version branch (if applicable) and merge it forward into the current major version branch.

We use minor version numbers to indicate any changes to the coordinator that would cause compatibility changes for Stargate APIs. For example, a breaking change to the bridge API in v2.0.x would cause creation of a v2.1.0 release, and any API implementations would need to explicitly update in order to be compatible. You can use any version of the coordinator and API that have same the major and minor version number without issues.

We iterate forward rather than producing patch releases. For example, for a vulnerability found in v2.0.3, we'd make any required fixes and dependency updates and release v2.0.4. We maintain a regular release cadence of approximately twice a month but can iterate more quickly as the situation dictates.

Thanks

YourKit Logo

This project uses tools provided by YourKit, LLC. YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.

stargate-grpc-rust-client's People

Contributors

dougwettlaufer avatar jeffreyscarpenter avatar mlr avatar pkolaczk avatar

Stargazers

avatar avatar avatar avatar avatar avatar avatar

Watchers

avatar avatar avatar avatar

stargate-grpc-rust-client's Issues

How to use Blob?

Hi. I'm developing a Rust application using stargate-grpc-rust to connect to astra db. When issuing query one of my result set columns is of blobl type in astradb. how can I transform my ResultSet into rust specific struct.
Here is my struct:

struct location {
  city: String,
  longitude: f32,
  latitude: f32,
  name: String,
  image: Blob <-- how to get this?
}

Uuid query bind & result try_into invalid

Uuid conversion is not working in 0.3, see the following samples & errors:

let userid = uuid::Uuid::new_v4(); let query = Query::builder().keyspace("...").query("...").bind((userid)).build();

Error:

the trait bound uuid::Uuid: DefaultCqlType is not satisfied
required because of the requirements on the impl of From<uuid::Uuid> for Value
required because of the requirements on the impl of Into<Value> for uuid::Uuid
required because of the requirements on the impl of IntoValue<stargate_grpc::types::Any> for uuid::Uuid
2 redundant requirements hidden
required because of the requirements on the impl of Into<stargate_grpc::proto::Values> for (uuid::Uuid, std::string::String, std::string::String, std::string::String, bool, i64, i64)

let userid: Uuid = userid_res.rows.first().try_into()?;

Error:

the trait bound uuid::Uuid: From<std::option::Option<&Row>> is not satisfied
required because of the requirements on the impl of Into<uuid::Uuid> for std::option::Option<&Row>
required because of the requirements on the impl of TryFrom<std::option::Option<&Row>> for uuid::Uuid
required because of the requirements on the impl of TryInto<uuid::Uuid> for std::option::Option<&Row>

Remove use of `Payload`

Payload and use of Any have been removed from the API in favor of using the concrete types Values and ResultSet directly: stargate/stargate#1370

This should simplify usage, but it requires client changes.

Set user-agent

Set a custom user-agent string on connections, preferably of the form stargate-grpc-rust-client/<version>.

How to use StargateClient in webframe work like axum?

Hi. In a web framework like axum you can have a shared state and share it via axum State to end points. What axum does is actually creating a clone of its state to requests. My question is:
Is it ok to clone StargateClient every time we want to use it? Is there any problem? any consideration over that?

Feature: WASM/WASI support

WASM and WASI support would enable integration of this package into the web and native applications respectively. Further, it would remove the necessity to support the other drivers.

Testing with Stargate Docker container

I followed the guide to create a Stargate Docker container in README.md, and exposed the ports as instructed; however, I have trouble connecting to Stargate using the driver.

Is it sufficient to forward port 8090 from the container?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.