fal should know about dbt Cloud Artifacts about dbt-fal HOT 3 CLOSED

Hi 👋

Could you please clarify:

This action outputs the run artifacts of this job

Questions:

• how would the connection to the warehouse work? I guess we would need to provide all necessary credentials in GH actions?

(but all in all that proposal makes sense to me, is anyone working on it?)

from dbt-fal.

Hello @sparrovv!

Could you please clarify:

This action outputs the run artifacts of this job

fal currently needs run_results.json dbt artifact to decide which models to run (unless ran using --all flag, and other flags coming soon), since the dbt run would happen in dbt-cloud environment, we do not have access to said artifact by default.

Part of the tasks the fal-ai/fal-dbt-cloud action would get done is download said artifact and making it available for the fal run to be executed.

How would the connection to the warehouse work? I guess we would need to provide all necessary credentials in GH actions?

This is probably the case, yes. Just like dbt-cloud gets a "profile" for the connection information, we would need profile information too; and we currently use the same behavior as dbt, we read the profiles-dir... so we may need to set it up with fal-ai/fal-dbt-cloud to match the expected environment for fal. We still need to look into these details.

Any ideas are welcome!

By the way, @mkam039 already started working on this approach, but we are still open to comments or contributions.

from dbt-fal.

@sparrovv we just implemented this proposal and wrote a blog post on it.

As part of the implementation, we also published a new Github Action to trigger dbt Cloud runs.

Looking forward to your feedback.

Join us on Discord or the #tools-fal channel on dbt Slack.

from dbt-fal.