Comments (2)
Additional context
- This is easily solved by moving to UC. However if
hive_metastore
is not supported, I believe this should be made explicit - This was also tested with
elementary 0.9.3
, following the exact repro steps. This used to work, but now it errors out.
This gave a different result, but after digging myself I am sure they are related. See snippet of log output (different to what's reported)
01:51:30 Finished running 14 incremental models, 14 view models, 1 table model, 2 hooks in 0 hours 1 minutes and 25.68 seconds (85.68s).
01:51:30
01:51:30 Completed with 2 errors and 0 warnings:
01:51:30
01:51:30 Runtime Error in model filtered_information_schema_columns (models/edr/metadata_store/filtered_information_schema_columns.sql)
[TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`INFORMATION_SCHEMA`.`COLUMNS` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.; line 25 pos 13
01:51:30
01:51:30 Runtime Error in model dbt_columns (models/edr/dbt_artifacts/dbt_columns.sql)
[TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`INFORMATION_SCHEMA`.`COLUMNS` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.; line 72 pos 13
Note: there is no such entity created called hive_metastore.INFORMATION_SCHEMA.columns
- it looks like it assumes it is a UC catalog.
from dbt-data-reliability.
Hi @hazvk !
Thanks for opening this issue and very sorry we are just replying now.
This is actually strange since we have routine tests that are running on both modes of Databricks.
In any case though, in the most recent version of the Elementary dbt package we actually removed completely the information_schema_columns
and enriched_columns
models so I tend to believe this issue is no longer relevant.
If you still encounter it, please feel free to open a new issue in the main Elementary repo - we are trying to concentrate issues there so it will be easier to manage and prioritize.
Thank you,
Itamar
from dbt-data-reliability.
Related Issues (20)
- [FEATURE] support postgresql HOT 1
- On-run-end macros for storing dbt_tests throws an error HOT 4
- dbt_utils dependency is too strict HOT 3
- Incorrect name for : athena__generate_elementary_profile_args in macros/utils/cross_db_utils/generate_elementary_profile_args.sql HOT 2
- Test failing to run since upgrading to 0.13 HOT 4
- PostgreSQL Replica Issue when Using Elementary HOT 1
- on-run-end failed, error: value too long for type character varying(65535) HOT 1
- Provides dbt metrics on Elementary's models HOT 1
- error "Pass a string for project" or "Column created_at is not present in table my_project.dbt_elementary.data_monitoring_metrics" if upgrade dbt package version from 0.7.3 to 0.14.0 HOT 1
- Error `The query is too large. The maximum standard SQL query length is 1024.00K characters` when using insert_rows_method `chunk` HOT 4
- [BUG] elementary.dbt_columns merge 0 rows, execution takes > 2500s HOT 2
- dbt_invocations model > job_name column showing up as 'null' HOT 1
- Feature request: Add installed packages information HOT 1
- elementary column anomalies tests fail on redshift with error 'Relation name is longer than 127 characters' HOT 2
- Instruct users to explicitly override `view` and `incremental` materializations HOT 4
- Temporary tables for volume and freshness tests are not properly cleaned on Athena HOT 1
- detection_period propery works wrong HOT 2
- Error creating ELEMENTARY.DBT_METRICS model HOT 1
- Want to open an issue / make a contribution to Elementary? 🤩 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dbt-data-reliability.