flush() support? about node-pg-copy-streams HOT 4 CLOSED

Can I use submit(connection) for this?

from node-pg-copy-streams.

This works, however, not too elegant...

from node-pg-copy-streams.

The problem you have here is that the COPY operation is atomic in the sense that the data is sent to the database on-the-fly, but not visible until the end of the COPY operation.

you cannot send interim commits that would "commit" the changes every 1000 rows.

your solution in the gist creates many 1000-lines COPY operations. Every time 1 COPY operation finishes, the 1000 added rows are immediatly visible. I cannot say if it is the most elegant way of doing it, there are probably other solutions.

The current API does not handle such a multi-COPY abstraction.

Can I ask what is your use case exactly and why one COPY is not enough ?

from node-pg-copy-streams.

At this stage, there is no plan to integrate a batch mode inside this module. I can understand the use case but there is no way to to interim commits on a COPY so the only solution I can think of is the one you mentioned in your example : several calls to COPY.

from node-pg-copy-streams.