Comments (5)
I would like to work on this!
from dbt-expectations.
Hi @makotonium ! I haven't made much any progress here, since it hasn't been a blocker for development (yet). So far, I'm testing against my own BigQuery and Snowflake instances (in addition to a local postgres instance) which hasn't incurred any costs yet. I think your other note on documentation updates is probably much more impactful to the broader package user community, so if you had to chose a project, that's the one I'd direct the most energy to! :)
from dbt-expectations.
Hey, github explorer & dbt fan here.
I know what Dylan Baker over at Spectacles did was for bigquery column / schema tests was to run queries with limit 0
appended. Basically, the query would succeed but return no data.
I think this could be used for your schema expectation tests without incurring charges?
from dbt-expectations.
Hi @sgoley, interesting! I think in our case though, we need all the data to come back from both the test model as well as the test output, so I'm not super sure where we'd inject the limit 0
? Btw, on BigQuery, limit n
has no effect on cost.
from dbt-expectations.
@clausherther I am curious to see how this is coming, and I may be able to offer help on getting something set up. How are you currently testing locally? Maybe we could replicate that as a start on GitHub Actions.
from dbt-expectations.
Related Issues (20)
- [BUG] restrictive dbt_date pin HOT 1
- Update calogica/dbt_date version. HOT 1
- [Feature Request] Add Spark Support
- [Feature Request] Test row-on-row percent change
- [Feature Request] HOT 2
- [Feature Request] Update the package version for dbt-date HOT 3
- [BUG] The quote: parameter in the model .yaml breaks the expect_column_to_exist() macro.
- [Feature Request] Add suport for AWS Athena HOT 1
- [BUG] Invalid SQL compiled when extracting relation columns from duckdb adapter
- [Feature Request] Improving Data Validation Output HOT 1
- [BUG] expect_multicolumn_sum_to_equal fails if sum_total is another column
- Trino support
- [BUG] expect_row_values_to_have_data_for_every_n_datepart can fail if model has never been run HOT 2
- [Feature Request] Add variable for row_cnt for expect_row_values_to_have_data_for_every_n_datepart test
- [BUG] With expect expect_column_values_to_be_of_type test
- [BUG] expect_select_column_values_to_be_unique_within_record Doesn't Allow for Different Data Types
- [BUG] Table columns names that contain spaces trigger runtime errors.
- Improve performance by moving to count(1) instead of count(*)
- [BUG] expect_table_aggregation_to_equal_other_table doesn't work with dates HOT 1
- expect_column_proportion_of_unique_values_to_be_between throwing a compilation error HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-expectations.