Giter Club home page Giter Club logo

openmetadata-sdk's Introduction

openmetadata-sdk

This project is used as a python library to ingest data to a openmetadata server

Install the requirements

To install the dependencies

python3 -m pip install -r requirements.txt

Notice that the client (this library) and the server(Openmetadata) must have the same version. So when installing the requirements in the requirements.txt is it possible to modify the version of openemetadata-ingestion dependency. When installing the openmetada from the https://docs.open-metadata.org/v1.1.x/quick-start it is possible to check the version

Usage

The main use of this library is to create a MetadataServer object this object will be used as a connector to openmetadata host, in particular the MetadataServer takes 3 aguments token for the autentication, host is the ip to the openmetadata while authprovider is the provider for the token, this parameters can be read from the environment variables when they are not explicit. If there is no environments varible an exception will be thrown.

The three environment variable are:

OPEN_META_DATA_TOKEN
OPEN_META_DATA_HOST
OPEN_META_DATA_AUTH_PROV
metaData = MetaDataServer(token,host,authProvider) 
table = TableCustom(metaData)

Then there is going to be the entity that we want to create, (table only supported for now). The entity will need the MetaDataServer as a parameter, then each entity might have custom fields. But in order to ingest the data each entity has to call the method:

ingest_data(self,...)

which will be pushing the entity to the metadata server, each ingest_data() will have some specific parameters.

openmetadata-sdk's People

Contributors

lattaruoloandrea avatar

Watchers

James Cloos avatar Gabriele Zacco avatar  avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.