Giter Club home page Giter Club logo

dbt_shop's People

Contributors

dbrtly avatar

Watchers

 avatar  avatar

dbt_shop's Issues

BUG: dbt source snapshot-freshness error message is borked

response doesnt look like the documentation

https://docs.getdbt.com/docs/building-a-dbt-project/using-sources#snapshotting-source-data-freshness

config:

version: 2

sources:
  - name: jaffle_shop
    database: raw
    freshness: # default freshness
      warn_after: {count: 12, period: hour}
      error_after: {count: 24, period: hour}
    loaded_at_field: _etl_loaded_at
    tables:
      - name: orders

output:

(.venv) Daniels-MBP:models daniel$ dbt source snapshot-freshness
Running with dbt=0.20.0
Found 3 models, 6 tests, 0 snapshots, 0 analyses, 164 macros, 0 operations, 0 seed files, 4 sources, 0 exposures

15:38:47 | Concurrency: 4 threads (target='dev')
15:38:47 | 
15:38:47 | 1 of 2 START freshness of jaffle_shop.customers...................... [RUN]
15:38:47 | 2 of 2 START freshness of jaffle_shop.orders......................... [RUN]
15:38:49 | 2 of 2 ERROR freshness of jaffle_shop.orders......................... [ERROR in 1.33s]
15:38:50 | 1 of 2 ERROR freshness of jaffle_shop.customers...................... [ERROR in 2.13s]

Database Error in source orders (models/sources/js.yml)
  The project raw has not enabled BigQuery.

Database Error in source customers (models/sources/js.yml)
  The project raw has not enabled BigQuery.
15:38:50 | Done.

change config:

  - name: iowa_liquor_sales
    description: A fictional e-commerce store for tutorial and demo purposes
    project: bigquery-public-data
    
    freshness:
      warn_after: {count: 1, period: year}
      error_after: {count: 2, period: year}
    loaded_at_field: date
    
    tables:
      - name: sales

result:

(.venv) Daniels-MBP:models daniel$ dbt source snapshot-freshness
Running with dbt=0.20.0
Encountered an error:
Compilation Error
  Invalid sources config given in models/sources/iowa_liquor_sales.yml @ sources: {'name': 'iowa_liquor_sales', 'description': 'A fictional e-commerce store for tutorial and demo purposes', 'database': 'bigquery-public-data', 'loader': 'bigquery-public-data', 'quoting': {'database': True}, 'freshness': {'warn_after': {'count': 1, 'period': 'year'}, 'error_after': {'count': 2, 'period': 'year'}}, 'loaded_at_field': 'date', 'tables': [{'name': 'sales', 'description': 'bigquery public dataset for Iowa liquor sales', 'columns': [{'name': 'invoice_and_item_number', 'description': 'Concatenated invoice and line number associated with the liquor order. This provides a unique identifier for the individual liquor products included in the store order.'}, {'name': 'date', 'description': 'Date of order.'}, {'name': 'store_number', 'description': 'Unique number assigned to the store who ordered the liquor.'}, {'name': 'store_name', 'description': 'Name of store who ordered the liquor.'}, {'name': 'address', 'description': 'Address of store who ordered the liquor.'}, {'name': 'city', 'description': 'City where the store who ordered the liquor is located'}, {'name': 'zip_code', 'description': 'Zip code where the store who ordered the liquor is located'}, {'name': 'store_location', 'description': 'Location of store who ordered the liquor. The Address, City, State and Zip Code are geocoded to provide geographic coordinates. Accuracy of geocoding is dependent on how well the address is interpreted and the completeness of the reference data used.'}, {'name': 'county_number', 'description': 'Iowa county number for the county where store who ordered the liquor is located'}, {'name': 'county', 'description': 'County where the store who ordered the liquor is located'}, {'name': 'category', 'description': 'Category code associated with the liquor ordered'}, {'name': 'category_name', 'description': 'Category of the liquor ordered.'}, {'name': 'vendor_number', 'description': 'The vendor number of the company for the brand of liquor ordered'}, {'name': 'vendor_name', 'description': 'The vendor name of the company for the brand of liquor ordered'}, {'name': 'item_number', 'description': 'Item number for the individual liquor product ordered.'}, {'name': 'item_description', 'description': 'Description of the individual liquor product ordered.'}, {'name': 'pack', 'description': 'The number of bottles in a case for the liquor ordered'}, {'name': 'bottle_volume_ml', 'description': 'Volume of each liquor bottle ordered in milliliters.'}, {'name': 'state_bottle_cost', 'description': 'The amount that Alcoholic Beverages Division paid for each bottle of liquor ordered'}, {'name': 'state_bottle_retail', 'description': 'The amount the store paid for each bottle of liquor ordered'}, {'name': 'bottles_sold', 'description': 'The number of bottles of liquor ordered by the store'}, {'name': 'sale_dollars', 'description': 'Total cost of liquor order (number of bottles multiplied by the state bottle retail)'}, {'name': 'volume_sold_liters', 'description': 'Total volume of liquor ordered in liters. (i.e. (Bottle Volume (ml) x Bottles Sold)/1,000)'}, {'name': 'volume_sold_gallons', 'description': 'Total volume of liquor ordered in gallons. (i.e. (Bottle Volume (ml) x Bottles Sold)/3785.411784)'}]}]} - at path ['freshness']: {'warn_after': {'count': 1, 'period': 'year'}, 'error_after': {'count': 2, 'period': 'year'}} is not valid under any of the given schemas

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.