Infer when a subset or the index needs to be written to a new location about fondant HOT 5 CLOSED

@RobbeSneyders the evolve method should also include updating the metadata of the manifest (based on args.metadata). This is enough to get the updated locations right? As the locations are based on the metadata (run_id and component_id).

from fondant.

Yes they should be indeed. I'm not sure when the run_id and component_id will become available though. They might only be available at runtime.

from fondant.

The run_id is only available at run time, but the component_id is just the name of the component, which is also present in the component spec. (FondantComponentSpec).

from fondant.

Shouldn't the component_id also contain the version of the component (eg. the commit hash)? Unless this would be completely captured by the run_id.

from fondant.

Previously, the Manifest had a separate commit_hash key included in its metadata, besides the run_id, component_name.

from fondant.