Giter Club home page Giter Club logo

Comments (12)

findinpath avatar findinpath commented on May 30, 2024 2

@retrry exactly, snapshot will likely land very soon on dbt-trino.

from dbt-trino.

hovaesco avatar hovaesco commented on May 30, 2024 1

Sure, we'll release it tomorrow, sorry for the delay.

from dbt-trino.

hovaesco avatar hovaesco commented on May 30, 2024

MERGE statement support in Trino engine is required for the implementation of Snapshot, related PR: trinodb/trino#7933

from dbt-trino.

p11o avatar p11o commented on May 30, 2024

@hovaesco it may be a while until that PR gets merged. I noticed that other features that use the merge statement have been re-written here (i.e. incremental materialization). Would it be acceptable to take the same approach here?

from dbt-trino.

hovaesco avatar hovaesco commented on May 30, 2024

In order to have atomic merge incremental strategy, we do require MERGE statement support in Trino. My belief is that the only acceptable solution. Do you refer to other incremental strategies?

from dbt-trino.

p11o avatar p11o commented on May 30, 2024

Do you refer to other incremental strategies?

Hey thanks for taking the time to respond. Just so I'm on the same page, what do you mean by incremental strategies?

On my end I was referring to how dbt-trino overrides this merge statement for incremental models.

from dbt-trino.

hovaesco avatar hovaesco commented on May 30, 2024

https://docs.getdbt.com/docs/building-a-dbt-project/building-models/configuring-incremental-models#about-incremental_strategy

from dbt-trino.

mdesmet avatar mdesmet commented on May 30, 2024

At this moment dbt_trino only supports append incremental models. See https://github.com/starburstdata/dbt-trino/blob/master/dbt/include/trino/macros/materializations/incremental.sql

We have an open PR for adding the delete+insert strategy. However to be able to test it, we need to expand the test setup with iceberg and delta.

I actually concur with @p11o that we could implement this feature using delete+insert but still would suggest getting above two PR's in first.

from dbt-trino.

retrry avatar retrry commented on May 30, 2024

Now that both merge and delete+insert is merged to main there are no blockers for this ticket?

from dbt-trino.

retrry avatar retrry commented on May 30, 2024

Could you release dbt-trino 1.2.2 with snapshot support?

from dbt-trino.

hovaesco avatar hovaesco commented on May 30, 2024

@retrry here you go https://github.com/starburstdata/dbt-trino/releases/tag/v1.2.2

from dbt-trino.

retrry avatar retrry commented on May 30, 2024

@hovaesco thanks!

from dbt-trino.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.