Giter Club home page Giter Club logo

dblparser's Introduction

DBLParser

A parser to parse the DBLP dataset Please change the settings (i.g., dbUrl, user, password) in db/DBConnection.java accordingly.

  1. Run the parser a. If you are using IDE, e.g., Eclipse. You need to add mysql-connector-java-6.0-bin.jar to the build path. See this post if you need any help. http://www.wikihow.com/Add-JARs-to-Project-Build-Paths-in-Eclipse-(Java)

And then run Parser.java with proper program argument (the path of dblp.xml) and VM arguments (-Xmx1G -DentityExpansionLimit=2500000). You may see this post on how to specify arguments in Eclipse. http://www.cs.colostate.edu/helpdocs/eclipseCommLineArgs.html

b. If you are using command line Similarly, you need to add mysql-connector-java-6.0-bin.jar in the classpath, and set the arguments. The command will be something like: java -cp mysql-connector-java-6.0-bin.jar -Xmx1G -DentityExpansionLimit=2500000 Parser [path_of_dblp.xml]

The program will run for a while. For example, it takes 974 seconds to parse dblp-2014.xml using my desktop.

Known Issues

  1. Out Of Memory Error If the default memory for JVM is too small, please increase the allocation by specifying JVM argument -Xmx[memory size] (e.g., -Xmx1G).

  2. Too small entity limit The parser has encountered more than "64,000" entity expansions in this document; this is the limit imposed by the application Please specify another JVM argument -DentityExpansionLimit=2500000 #more The example.xml is part of dblp dataset,you can use it to test the program.

dblparser's People

Contributors

gymn avatar jiarongqiu avatar

Stargazers

 avatar abdul dakkak avatar

Watchers

 avatar

dblparser's Issues

Encoding Error

An error occur when I tried to parse the example.xml,and here is the some debugging outputs:
value:Martin Necask
value:ý
author:

In this circumstance, author name being seperated into two parts resulted into database will only receive ý as the author name rather than Martin Necaský.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.