Zero Downtime options for table materialization about dbt-athena HOT 4 CLOSED

Right now it is not possible to use the rename command since the rename actually works but an error is raised because results can't be found according to athena API.

A case has been opened by my company on AWS. They are investigation.

from dbt-athena.

This can be done by using views but Athena views are not supported by either Spark or Redshift, which causes trouble in my use-case.

Another approach could be using the ALTER TABLE SET LOCATION 'new location' command. The same table can be created in a different folder like a partition and once the data is ready, the table location can be updated.

With this approach metadata (partition information) would mostly be the same but to cover everything MSCK REPAIR TABLE can be executed after the alter command.

from dbt-athena.

@hiltercoty we merged the feature to address ha for hive tables.
Iceberg support for ha is still on on-hold as we are missing an alter table rename working properly.

from dbt-athena.

As found by @Jrmyy this issue is not longer blocked as the athena team fixed the ALTER TABLE target RENAME TO statement.

from dbt-athena.