Global asset page not showing partitioned assets as unsynced even though partitions are out of sync about dagster HOT 10 OPEN

@ion-elgreco Incase you're also still struggling with this issue, I wrote a lil script to identify stale partitions and poop out a dagster range selection: https://dagster.slack.com/archives/C01U5LFUZJS/p1721244848573849?thread_ts=1721161575.536879&cid=C01U5LFUZJS

Just provide your asset names and partition range (if you're using date partitions, you'll have to modify it if not)

from dagster.

Can you share screenshots of what specific UI you are referring to?

from dagster.

@salazarm

the global asset lineage page, never shows an unsynced symbol for a partitioned asset, it shows everything is green, even though a partition might be out of date due to an upstream change.

from dagster.

cc @smackesey is this related to the unsynced changes we made recently?

from dagster.

Could be related: #22704

from dagster.

IMO this is THE top issue Dagster has right now. I cannot understate how much time has been spent searching for outdated portions.

from dagster.

The plan here is to proceed post-1.8: we'll show unsynced status of the latest partition for time-partitioned assets while retaining the status quo for non-time-partitioned assets.

cc @smackesey is this related to the unsynced changes we made recently?

Same product area but conceptually separate issue.

from dagster.

@smackesey just showing the latest wouldn't be correct though. In our case we have late data arrivals for partitions that go back a half year, so we update those partitions upstream.

In this case the unsynced status would be still incorrect if you look only at last partition

from dagster.

The plan here is to proceed post-1.8: we'll show unsynced status of the latest partition for time-partitioned assets while retaining the status quo for non-time-partitioned assets.

cc @smackesey is this related to the unsynced changes we made recently?

Same product area but conceptually separate issue.

Will the "Backfill only failed and missing partitions within selection" button include "Unsynced" partitions too?

from dagster.

@smackesey @braunjj

The plan here is to proceed post-1.8

Does that mean we can expect the fix in 1.8? When will that be released?

My team is having to do some extremely tedious workaround because of this issue. I would really appreciate some clarity on how we should handle this and when a fix is expected to land.

from dagster.