erwin-t-hoen / flat-file-importer Goto Github PK

When an imports fails due to a failed commit, the real cause of the error is hidden. All you can see in the log is there was an error with the message "General in the method" and the stack trace "Failed to commit". When the option "Log to console" is set to true, the logline in the console shows even less: no stack trace.

Could you please change this, so when an error occurs, the cause of the error is properly logged.

With the cases for Float, Currency, Decimal etc. the following code block seems to be inappropriate. When one or more trimmedColumnValues are empty the object is not committed to the database, because the variable tryCommit is set to false. This variable is used to add the new object to a commit list, any other values on the same row are not stored because of it.

else tryCommit = false;

I have an interface definition which contains a column of Data Type: Decimal.
When I import the data, the module skips all rows where the decimal value is null.
This means I am unable to import my datasets correctly. I expected the module to import the row but to leave that Decimal column null (as per the csv)?

It's a valid scenario for me to have some decimal values that are null:
Example - A list of users where Age was optional:

Name,Age,Address
Tim Cook,59,1 infinite loop
Bill Gates,,Redmond Washington
Lewis Hamilton,35,1 Race Drive

In this scenario Bill Gates didn't import, only Tim Cook and Lewis Hamilton.

Module version: 7.23.5
Mendix Version: 8.5.0

Any plans to support the new Decimal datatype?

Hello Erwin,

This could be a setting issue but I tried both the UTF-8 and CP1252 file encoding settings and this made no difference.
When I import a csv file with for example 'één maand' it comes out in the database as ��n maand. I checked the hex code that is comming in (e9) so with the CP1252 it should come out if I am not mistaken as é. Any suggestions?

Regards,

Ronald

Hi Erwin and Team,

I am using flat file importer. I don't see any option to associate the file document with the records going to insert. Please help me to get through

Hello,

Please update this awesome app for Mendix 6.8 or greater. We are trying to use it but it is not compatible with our current Mendix version 6.8.1

Thank you.

Hoang

I noticed that when using the internal queue the fileEncoding is not used on line 236 by the InputStreamReader. Can you explain why and/or update with the ,fileEncoding?

"BufferedReader br = new BufferedReader(new InputStreamReader(fstream, fileEncoding));"

The export of definitions with skipped columns was not working as the column and interface definitions were passing (empty) values to non-nillable fields, updating those fields within the xsd to nillable=true fixes this issue.

InterfaceDefinitionUpdated.txt

I've configured the File Importer and importing works great. I have a file however with a | as delimiter and " "(double quotes) as text indicators. When configuring this and setting a text indicator e.g it does not remove the text indicator whilst importing.

The module does not work in Mendix 8.3.0.61600 (build 61600) in the log in the modeler it states that it can not create entity "Unable to create entity record1,2,3,4'

In previous versions it was possible to pass an "Association name" parameter when using the ExecuteInterface_Delimited_4_1_00 Java action. This would associate all the newly created objects to an already existing object (for instance the original file object). This was handy for retrieving the objects afterwards. In the latest version (7.1.0) this parameter is missing. Could you please bring it back?

Thanks for this great module!

In previous versions it was possible to process files with different number of columns with the same interface definition. It looks like non-existing columns were added before processing.

In newer versions this doesn't work anymore, which is causing us a lot of remodelling.
It would be awesome if the option to process files with different nr of columns in the same interface definition again.

Thanks for your answer guys