pcchynoweth / xml2csv-conv Goto Github PK

In my XML file name bill.xml I have something like this:

<?xml version = '1.0' encoding = 'ISO-8859-2'?>
<BILL date="2013-07-15" nr="24000000009" text="some texts">
<POZ>
<NAME1>FIRST LINE</NAME1>
<NAME2>SECOND LINE</NAME2>
<NAME3></NAME3>
<NAME4></NAME4>
</POZ>
<POZ>
<NAME1>FIRST LINE 2</NAME1>
<NAME2>SECOND LINE 2</NAME2>
<NAME3>THIRD LINE 2</NAME3>
<NAME4></NAME4>
</POZ>
<POZ>
<NAME1>FIRST LINE 3</NAME1>
<NAME2>SECOND LINE 3</NAME2>
<NAME3>THIRD LINE 3</NAME3>
<NAME4></NAME4>
</POZ>
</BILL>

NAME4 is empty in every  positions. After standard command "xml2csv-conv -s ";" 
bill.xml bill.csv" I have output file:

BILL [date];BILL [nr];BILL [text];NAME1;NAME2;NAME3
2013-07-15;24000000009;some texts;FIRST LINE;SECOND LINE;-
2013-07-15;24000000009;some texts;FIRST LINE 2;SECOND LINE 2;THIRD LINE 2

First problem is one record missed in output file, but someone wrote about this 
problem.

Main problem is missing of row NAME4 in output file. 
In my XML file all NAME4 seccions were empty, but in some sytuaction is 
possible to have NEME1, or NAME3 empty.
When I load few csv to excel I will have diferent number of columns. 

What steps will reproduce the problem?
1. get bix xml file ( I use 0.5Gb )
2. run tool
3. receive error

What is the expected output? What do you see instead?
proper cvs file

What version of the product are you using? On what operating system?
0.0.1
WinXP

Please provide any additional information below.
Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at java.util.Arrays.copyOfRange(Unknown Source)
        at java.lang.String.<init>(Unknown Source)
        at com.sun.org.apache.xerces.internal.xni.XMLString.toString(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.AbstractDOMParser.characters(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.dtd.XMLDTDValidator.characters(Unknown Source)
        at com.sun.org.apache.xerces.internal.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XML11Configuration.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.XMLParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.parsers.DOMParser.parse(Unknown Source)
        at com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderImpl.parse(Unknown Source)
        at javax.xml.parsers.DocumentBuilder.parse(Unknown Source)
        at xml2csvconv.Main.convert(Main.java:194)
        at xml2csvconv.Main.main(Main.java:493)

The order of columns in the list given to the -k parameter (columns to keep) 
should be used to set the column order in the output CSV file.

What steps will reproduce the problem?
java -jar c:\xml2csv-conv\xml2csv-conv.jar
-l value -i probability-of-precipitation,hazards,weather,conditions-icon -k "par
ameters,temperature,name,type,value" "http://graphical.weather.gov/xml/sample_pr
oducts/browser_interface/ndfdBrowserClientByDay.php?citiesLevel=1&format=24+hour
ly&numDays=7" "myfile.csv"

What is the expected output? What do you see instead?
see attached files.  myfile1 is result, myfile2 is expected result.  by 
inserting cells a15-f15 and shifting all cells down, expected result is 
achieved.  because of the nature of the application, must be done with not 
manual steps.

What version of the product are you using? On what operating system?
downloaded xml2csv-conv on 7/09/2013
JAVA 7.1
Windows 7 on 64 bit machine

Please provide any additional information below.

If no output file is given, the CSV output should go to System.out (so that we 
can pipe it to somewhere else).

Also, error messages should not go to System.out, but to System.err (so that 
this piping works properly).

What steps will reproduce the problem?
1. Create a file called records.xml with the following contents:

<?xml version="1.0" encoding="UTF-8"?>
<collection>
  <record>
    <datafield tag="020">
      <subfield code="a">version</subfield>
    </datafield>
    <datafield tag="040">
      <subfield code="b">stuff</subfield>
    </datafield>
  </record>
  <record>
    <datafield tag="020">
      <subfield code="a">version1</subfield>
      <subfield code="9">annotation1</subfield>
    </datafield>
    <datafield tag="020">
      <subfield code="a">version2</subfield>
      <subfield code="9">annotation2</subfield>
    </datafield>
    <datafield tag="040">
      <subfield code="b">yadda</subfield>
    </datafield>
  </record>
</collection>

2. Execute the following:
   xml2csv-conv.bat -l datafield records.xml records.csv

What is the expected output? 

See one row for each datafield element in the .xml file.

What do you see instead?

All datafield records except the last one are output to the .csv file.

What version of the product are you using? On what operating system?

Latest downloaded today 2012/04/10

Please provide any additional information below.

Windows, JDK 1.6.0_29

In my XML two nodes are present means I am getting only one node 
Similar way 3 nodes 2 nodes are writes to excel file 

 <Request = 1>
    <FirstName>dd</FirstName>
     <lastname>BB</lastname>
 <Request = 2>
     <FirstName>ddf</FirstName>
      <LastName>sss<LastName>
 <Request>

where Request 1 is writed to excel but request 2 is not writing to excel

What steps will reproduce the problem?
1.
2.
3.

What is the expected output? What do you see instead?


What version of the product are you using? On what operating system?


Please provide any additional information below.

I changed the source a little so I keep the accumulating result in a

StringBuffer so it's much faster with large files

I also added an option -h to exclude header column names from output

Hi, 

I think this tool is useful, but I can't figure out what the -l option does. 
Whenever I experiment with a different field, it seems to just erase the 
contents of the csv. Do you have an example of usage of the -l option? I am not 
clear what the expected output should be, but am trying to understand what that 
parameter can be used for.

Thanks,
Daniel