Insert support with data chunk or Arrow about duckdb-rs HOT 4 OPEN

According to the issue you mentioned, they had support append datachunks

• test example: https://github.com/duckdb/duckdb/blob/f44e77c7ec356ca6aee96dc84b0e00a6d3c6973a/test/api/capi/test_capi_data_chunk.cpp#L51
• doc: https://duckdb.org/docs/api/c/data_chunk

We need to add API in appender.rs . I maintain this crate in my spare time, can't guarantee when it will be available. It would be great if you can help on this.

from duckdb-rs.

If the inmemory data is arrow format, we may also choose to add api for table functions

• https://github.com/duckdb/duckdb/blob/f44e77c7ec/src/function/table/arrow.cpp#L1111
• https://duckdb.org/docs/api/c/table_functions
• https://github.com/duckdb/duckdb/blob/5079e8e7f05057b10e97d0dd028a3e1d636c798b/src/include/duckdb.h#L1330

from duckdb-rs.

I can definitely take a look at adding this. I had missed the crucial duckdb_vector_get_data from the Data Chunk API that returns a pointer that can be both read and written to, so I think it will cover what I need. Would this necessarily be implemented in the appender.rs though - the C API seems to have split these out sufficiently that maybe a new datachunk.rs might make more sense?

I do have an arrow format currently in memory, so I might try to tackle the table functions after the data chunks.

from duckdb-rs.

Yes, you are free to create a new file for this

from duckdb-rs.