missing XML files? about edh_etl HOT 3 CLOSED

in the xml data for download (version from August 12, 2020), there is currently 81156 xml files. 5 of these files are empty (zero bytes):

['./xml/HD070403.xml',
 './xml/HD071377.xml',
 './xml/HD071378.xml',
 './xml/HD072745.xml',
 './xml/HD072755.xml']

That means we have 81,151. That is somehow less than we can via the API, which currently returns 81,476.

from edh_etl.

The following five XML files have a 0 bytes size in the data dump, but they exist on EDH web when searching for individual records - I will report them to EDH directly, so they can be fixed and added to the dump.

edhEpidocDump_HD070001-HD082046/xml/HD070403.xml
edhEpidocDump_HD070001-HD082046/xml/HD071377.xml
edhEpidocDump_HD070001-HD082046/xml/HD071378.xml
edhEpidocDump_HD070001-HD082046/xml/HD072745.xml
edhEpidocDump_HD070001-HD082046/xml/HD072755.xml

The files HD082047 - HD082389 do not have their XML files yet available in the dump, but they are available through the API. Their XML file is available when searching for individual records but not as bulk-data, since they were created post 12 Aug 2020 (the date when the latest XML dump was created).

We know there is nothing wrong with our script, but it's the problem with the source of the data.

from edh_etl.

old problem, solved long time ago

from edh_etl.