databricks-industry-solutions / auto-data-linkage Goto Github PK

This project looks great! I am having an issue getting it to run however, following the readme guide I am coming up against:

AttributeError: 'dict' object has no attribute 'spec'

on the autolinker.auto-link() line. Can share logs if required.

I have installed all the necessary modules, as well as following the instructions in the RUNME file.

I hope this is the correct forum for this message, please do let me know if not!

Thanks,
Robbie

Has there been any consideration about adding support for inference via a registered model on Databricks?

Running the notebooks/example.py on Databricks Runtime 13.3 ML throws a py4j.Py4JException within arc.enable_arc.

Issue with running the ITs on UC cluster when reading a df instead of table.
Fix:
write the df to a temp table and run arc on the temp table

In https://github.com/databricks-industry-solutions/auto-data-linkage/blob/main/example-notebooks/01_Run_Example_Deduplication.py

Line 64 - currently:
print(f"There are {data.count} records in total.")

I needed to change it to:
print(f"There are {data.count()} records in total.")

Just letting you know!

Thanks.