Giter Club home page Giter Club logo

almalaurea-scraper's Introduction

almalaurea-scraper

Description

This project is a scraper for the italian almalaurea website. It allows you to extract data from the website and store it in a structured format.

Installation

To install the project, follow these steps:

  1. Clone the repository: git clone https://github.com/your-username/almalaurea-scraper.git
  2. Navigate to the project directory: cd almalaurea-scraper
  3. Install the dependencies (e.g. using Conda): conda env create -f environment.yml

Usage

To use the scraper, follow these steps:

  1. Configure the scraper by editing the scraper.py file.
  2. Run the scraper: python3 scraper.py
  3. The scraped data will be saved in the results directory.

Main functions

disaggregation_all(anni, filename=None, ateneo="tutti")

  • Performs disaggregation for all years.

  • @param {Array} anni - An array of years to perform disaggregation for.

  • @param {string} [filename] - Optional filename to save the disaggregated data.

  • @param {string} [ateneo="tutti"] - Optional parameter to specify the university. Defaults to "tutti" (all universities).

disaggregazione_genere(anni, filename=None, ateneo="tutti")

Performs disaggregation for genders.

  • @param {Array} anni - An array of years to perform disaggregation for.
  • @param {string} [filename] - Optional filename to save the disaggregated data.
  • @param {string} [ateneo="tutti"] - Optional parameter to specify the university. Defaults to "tutti" (all universities).

disaggregazione_dipartimenti(anni, filename=None, ateneo='tutti') Performs disaggregation for departments.

Warning

The department list is based on the ones for Politecnico di Torino. Modify the list based on the departments of the university of your interest.

  • @param {Array} anni - An array of years to perform disaggregation for.
  • @param {string} [filename] - Optional filename to save the disaggregated data.
  • @param {string} [ateneo="tutti"] - Optional parameter to specify the university. Defaults to "tutti" (all universities).

disaggregazione_lavoro(anni, filename=None, ateneo='tutti')

  • Performs disaggregation for work conditions.

  • @param {Array} anni - An array of years to perform disaggregation for.

  • @param {string} [filename] - Optional filename to save the disaggregated data.

  • @param {string} [ateneo="tutti"] - Optional parameter to specify the university. Defaults to "tutti" (all universities).

Contributing

Contributions are welcome! If you find any issues or have suggestions for improvements, please open an issue or submit a pull request.

License

This project is licensed under the GNU GENERAL PUBLIC LICENSE. See the LICENSE file for more information.

almalaurea-scraper's People

Contributors

rondinamr avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.