Comments (12)
@retrry exactly, snapshot
will likely land very soon on dbt-trino
.
from dbt-trino.
Sure, we'll release it tomorrow, sorry for the delay.
from dbt-trino.
MERGE statement support in Trino engine is required for the implementation of Snapshot, related PR: trinodb/trino#7933
from dbt-trino.
@hovaesco it may be a while until that PR gets merged. I noticed that other features that use the merge statement have been re-written here (i.e. incremental materialization). Would it be acceptable to take the same approach here?
from dbt-trino.
In order to have atomic merge
incremental strategy, we do require MERGE
statement support in Trino. My belief is that the only acceptable solution. Do you refer to other incremental strategies?
from dbt-trino.
Do you refer to other incremental strategies?
Hey thanks for taking the time to respond. Just so I'm on the same page, what do you mean by incremental strategies?
On my end I was referring to how dbt-trino overrides this merge statement for incremental models.
from dbt-trino.
from dbt-trino.
At this moment dbt_trino only supports append incremental models. See https://github.com/starburstdata/dbt-trino/blob/master/dbt/include/trino/macros/materializations/incremental.sql
We have an open PR for adding the delete+insert strategy. However to be able to test it, we need to expand the test setup with iceberg and delta.
I actually concur with @p11o that we could implement this feature using delete+insert
but still would suggest getting above two PR's in first.
from dbt-trino.
Now that both merge and delete+insert is merged to main there are no blockers for this ticket?
from dbt-trino.
Could you release dbt-trino 1.2.2 with snapshot support?
from dbt-trino.
@retrry here you go https://github.com/starburstdata/dbt-trino/releases/tag/v1.2.2
from dbt-trino.
@hovaesco thanks!
from dbt-trino.
Related Issues (20)
- dbt-trino 1.0.3 needs to use a compatibility pin on dbt-core 1.0 HOT 1
- upgrade to support dbt-core v1.4.0 HOT 1
- Add CI tests for python 3.11
- Using seeds produces empty files in the seed dir HOT 6
- 'dbt docs generate' command doesn't create sources block in catalog.json file HOT 2
- Support release branches HOT 2
- `host` value parsing: more flexible and fault-tolerant HOT 2
- `ROLE` as standalone field? HOT 1
- Merge Strategy creating model__dbt_tmp at the same S3 location as configured in config where my main table got created HOT 2
- Add Materialized View materialization
- compatibility pin the trino python client HOT 1
- Add cleanup for tests on galaxy HOT 2
- Alter table not working for managed tables HOT 3
- dbt docs generate is very slow if many tables exist in the catalog, even if they are not used in the dbt project HOT 1
- oauth authentication not working in dbt Core HOT 2
- Upgrade dbt-core to 1.5.0
- upgrade to support dbt-core v1.5.0 HOT 1
- TestPersistDocs fails on galaxy
- Table 'system.metadata.materialized_view' does not exist error since dbt-trino 1.4.2 HOT 1
- Implement query comments
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-trino.