Giter Club home page Giter Club logo

seatunnel's Introduction

Apache SeaTunnel

SeaTunnel Logo

Build Workflow Join Slack Twitter Follow

Table of Contents

Overview

SeaTunnel is a next-generation, high-performance, distributed data integration tool, capable of synchronizing vast amounts of data daily. It's trusted by numerous companies for its efficiency and stability.

Why Choose SeaTunnel

SeaTunnel addresses common data integration challenges:

  • Diverse Data Sources: Seamlessly integrates with hundreds of evolving data sources.

  • Complex Synchronization Scenarios: Supports various synchronization methods, including real-time, CDC, and full database synchronization.

  • Resource Efficiency: Minimizes computing resources and JDBC connections for real-time synchronization.

  • Quality and Monitoring: Provides data quality and monitoring to prevent data loss or duplication.

Key Features

  • Diverse Connectors: Offers support for over 100 connectors, with ongoing expansion.

  • Batch-Stream Integration: Easily adaptable connectors simplify data integration management.

  • Distributed Snapshot Algorithm: Ensures data consistency across synchronized data.

  • Multi-Engine Support: Works with SeaTunnel Zeta Engine, Flink, and Spark.

  • JDBC Multiplexing and Log Parsing: Efficiently synchronizes multi-tables and databases.

  • High Throughput and Low Latency: Provides high-throughput data synchronization with low latency.

  • Real-Time Monitoring: Offers detailed insights during synchronization.

  • Two Job Development Methods: Supports coding and visual job management with the SeaTunnel web project.

SeaTunnel Workflow

SeaTunnel Workflow

Configure jobs, select execution engines, and parallelize data using Source Connectors. Easily develop and extend connectors to meet your needs.

Supported Connectors

For a list of connectors and their health status, visit the Connector Status.

Getting Started

Download SeaTunnel from the official website.

Choose your runtime execution engine:

Use Cases

Explore real-world use cases of SeaTunnel, such as Weibo, Tencent Cloud, Sina, Sogou, and Yonghui Superstores. More use cases can be found on the SeaTunnel blog.

Code of Conduct

Participate in this project following the Contributor Covenant Code of Conduct.

Contributors

We appreciate all developers for their contributions. See the list of contributors.

How to Compile

Refer to this document for compilation instructions.

Contact Us

Landscapes

SeaTunnel enriches the CNCF CLOUD NATIVE Landscape.

Apache SeaTunnel Web Project

SeaTunnel Web is a web project that provides visual management of jobs, scheduling, running and monitoring capabilities. It is developed based on the SeaTunnel Connector API and the SeaTunnel Zeta Engine. It is a web project that can be deployed independently. It is also a sub-project of SeaTunnel. For more information, please refer to SeaTunnel Web

Our Users

Companies and organizations worldwide use SeaTunnel for research, production, and commercial products. Visit our user page for more information.

License

Apache 2.0 License

Frequently Asked Questions

1. How do I install SeaTunnel?

Follow the installation guide on our website to get started.

2. How can I contribute to SeaTunnel?

We welcome contributions! Please refer to our Contribution Guidelines for details.

3. How do I report issues or request features?

You can report issues or request features on our GitHub repository.

4. Can I use SeaTunnel for commercial purposes?

Yes, SeaTunnel is available under the Apache 2.0 License, allowing commercial use.

5. Where can I find documentation and tutorials?

Our official documentation includes detailed guides and tutorials to help you get started.

7. Is there a community or support channel?

Join our Slack community for support and discussions: SeaTunnel Slack.

seatunnel's People

Contributors

garyelephant avatar rickyhuo avatar hisoka-x avatar ericjoy2048 avatar tyrantlucifer avatar calvinkirs avatar ashulin avatar hailin0 avatar kid-xiong avatar ruanwenjun avatar liugddx avatar ic4y avatar asdf2014 avatar taozex avatar carl-zhou-cn avatar simon824 avatar songjianet avatar lightzhao avatar zhilinli123 avatar wuchunfu avatar yx91490 avatar mans2singh avatar monsterchenzhuo avatar flechazow avatar laglangyue avatar zhaomin1423 avatar cheneyyin avatar zhongjiajie avatar xleoken avatar fwlamb avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.