Nested structure about delta HOT 5 CLOSED

Hi @balluashok,

By nested structure, do you mean nested columns in a Delta table? We've made an effort to have everything in Delta Lake work with nested columns; please let us know if you encounter any issues.

from delta.

Thanks @mukulmurthy

Yest nested columns assume : Person can have multiple addresses(work address, home address), can have multiple contact numbers ( mobile, home, work).

we have to represented this relation in nested structure -> one person can have many addresses and can have many contact numbers.

And Person can change only his cell number or can change work address.. then we have to keep the history and SANPSHOT(latest data).. let me know we can achieve this use case using Delta.

from delta.

Delta column types support all columns Spark supports, including ArrayType and StructType (nested types) if that's what you're using. Partitioning on nested columns is also supported.

from delta.

Thanks @mukulmurthy , i will do a POC.

from delta.

Partition on nested columns (ie partitionBy("struct.column")) is not possible. I assume that https://issues.apache.org/jira/browse/SPARK-18084 is the reason.

from delta.