[Feature Request] Allow for percentage of rows to be null about dbt-expectations HOT 6 OPEN

Hi @clausherther I'm happy to work on this feature.

from dbt-expectations.

@danhphan that'd be amazing, thanks! 👏 Let me know if I can help with anything. I think we already have a couple of tests that implemented some sort of tolerance level.

from dbt-expectations.

Yes, let me look into the code base and its tests in more details. Thank you!

from dbt-expectations.

This is an amazing feature! Any updates?

from dbt-expectations.

@rlh1994 you can set tolerances for any test in terms of the absolute number of failing records:

- not_null:
  - config:
    - error_if: ">1000"
    - warn_if: ">500"
   

But it would be a nice enhancement if you could specify it as a proportion rather than an absolute number...

from dbt-expectations.

dbt-utils has this feature
https://github.com/dbt-labs/dbt-utils/tree/1.1.1/#not_null_proportion-source

              - dbt_utils.not_null_proportion:
                  at_least: 0.99

from dbt-expectations.