Giter Club home page Giter Club logo

web-scraping-uoc's Introduction

web-scraping-uoc

Application to get job offers information.

Table of Contents
  1. About The Project
  2. Getting Started
  3. Usage
  4. Roadmap
  5. Contributing
  6. Zenodo
  7. License
  8. Contact

About The Project

This project aims to create an application to get information about job offers. Its development is in its early stages. The idea of making a bot that collects the information of the different offers, arises from the need to avoid looking for this information manually and thus save time for the user. Within Linkedin, in order to create an API that collects this information, you need a Linkedin developer account. For this reason, a Python code is implemented to do this for free. It is proposed to search for job vacancies using a keyword and a location. It is interesting to gather information that allows you to filter the most interesting offers for the user. For example, you can get information such as how long these offers take on Linkedin, the type of schedule they ask for, the experience needed to get the job done, and so on.

(back to top)

Built With

(back to top)

Getting Started

To run the application please follow the next steps.

Prerequisites

  1. In order to use this aplicatin you must have a user and password in LinkedIn. Both will be required as parameters at the beginning of the main script (main.py)

  2. Download the chromedriver.exe and save it in your local.

Installation

  1. Download Spyder Spyder.js

  2. The application is using the following packages. Please install them before running.

  selenium
  time
  pandas

Usage

You can run this application opening Spyder and pressing the Run button to run the main.py script.

  • You need to specify the driver path:

    driver_path = 'replace_your_driver_path/chromedriver.exe'

  • You need to specify the user and the password in order to log in in LinkedIn:

    email = "replace_your_email_account"

    password = "replace_your_password_account"

  • You need to specify the keywords of the type of job offer you are looking for and the location:

    keywords = "Analista de datos"

    location = "Barcelona"

  • You can also specify the amount of pages you want to fetch the information offers from:

    num_pag = 11

Roadmap

  • Create a config file with all the parameters.
  • Clean data so that it can be further processed in Power BI or other visualization tools.

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

  1. Fork the Project
  2. Create your Feature Branch (git checkout -b feature/AmazingFeature)
  3. Commit your Changes (git commit -m 'Add some AmazingFeature')
  4. Push to the Branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

(back to top)

Zenodo

DOI del dataset: 10.5281/zenodo.6413079

License

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

(back to top)

Contact

Oriol Toll - [email protected] Laura Gassó - [email protected]

(back to top)

web-scraping-uoc's People

Contributors

laugamo avatar

Watchers

 avatar

Forkers

otollro

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.