Comments (2)
@ammarchalifah-bolt Do you mean a single .pre-commit-config.yaml
file?
from dbt-checkpoint.
Hello,
I also have the exact same use case : I have a centralized "dbt" folder, each of them containing a store, e.g :
- dbt/store_a/target/manifest.json
- dbt/store_b/target/manifest.json
etc
It would be ideal to be able to either have a configuration supporting multiple folders or to at least give a glob-like path to find the manifest.json, from a single .pre-commit-config.yaml. It could probably be added in the .dbt-checkpoint.yaml,
something like this :
Solution 1
version: 1
dbt-project-dirs:
store_a:
- dbt/store_a/target
store_b:
- dbt/store_b/target
or
Solution 2
dbt-projects-glob: dbt/*/target
I know that this sound quite exotic, yet I believe that this dbt architecture could be more and more used as more people are advocating for multi-repo dbts (examples :
- https://discourse.getdbt.com/t/how-to-configure-your-dbt-repository-one-or-many/2121
- https://docs.getdbt.com/best-practices/how-we-mesh/mesh-2-structures )
Now I guess that the change could be quite tricky, yet it would help tremendously when an engineer modifies multiple identical marts for distinct companies to ensure that the commits are ok.
from dbt-checkpoint.
Related Issues (20)
- Add skip functionality to "dbt-deps" hook
- Support for multiple data types for check-column-name-contract hook HOT 1
- `check-column-name-contract` doesn't output the name of the files HOT 1
- check-model-name-contract support for snapshots HOT 1
- Typo in docs for how to use --exclude
- Following the instructions for github actions failed (re: profile.yml)
- unable to exclude specific model from pre-commit
- check_source_has_all_columns reports failure due to use of lower() HOT 1
- check-script-ref-and-source erroneously checks refs in comments
- Generate docs for only the staged/changed model(s) HOT 3
- `check-source-has-tests` has the wrong argument documented for test count HOT 1
- check-source-loaded-at-field-is-valid
- check-column-name-contract (and maybe other checkpoints based on Catalog) does not work with Versioned models HOT 1
- dbt-docs-generate speedup possibility with --no-compile? HOT 9
- check-script-ref-and-source hook not accounting for versioned models
- check_model_has_tests_by_name being applied to all models
- `check-model-has-description` raises `IsADirectoryError` intermittently
- generate-model-properties-file hook "When to use it" is wrong
- get_source_schemas function checks yaml files that are located outside of dbt project's directory
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-checkpoint.