Giter Club home page Giter Club logo

django_google_map_scraper's Introduction

GoogleMapScraping

Google Maps scraping allows user to get business locations' details of the location within few clicks!

Google Maps scraper can provide businesses with valuable location-based data that can be used for market analysis, local SEO optimization, lead generation, targeted advertising, logistics optimization, and business expansion efforts.

Steps to follow:

Give location name as input file in home page and click scrap button

Home Page

  • Website will start scraping business locations' details for the given input
  • Website will be loading till scraping process gets completed. (NOTE: scraping speed depends on number of locations available for given input)

Download CSV button will be available once the scraping process gets completed.

CSV Download Page

  • Click on download csv button to download csv of your desired place

And That's it!!!!! You will be having location details for your desired place in csv file

Libraries Used

Django

For developing website(both frontend and backend)

  • Django is a high-level Python web framework that encourages rapid development and clean, pragmatic design. Built by experienced developers, it takes care of much of the hassle of web development, so you can focus on writing your app without needing to reinvent the wheel.
  • It’s free and open source. It follows the model-view-template (MVT) architectural pattern. Django aims to make it easier to build web applications by providing reusable components and a robust development environment.

Features

  • Batteries-Included: Django comes with a variety of built-in features for web development, such as an ORM (Object-Relational Mapper), authentication system, URL routing, template engine, and more.

  • Admin Interface: Django provides a powerful admin interface out-of-the-box, which allows developers to manage application data through a web-based interface without writing custom code.

  • Security: Django helps developers avoid many common security mistakes by providing built-in protection against XSS, CSRF, SQL injection, and clickjacking.

  • Scalability: Django applications can scale well both vertically and horizontally. With proper architecture and optimization, Django can handle heavy traffic loads.

  • Versatility: Django is suitable for building different types of web applications, including content management systems (CMS), social networks, e-commerce platforms, and more.

  • Community and Ecosystem: Django has a large and active community of developers, which means plenty of resources, packages, and third-party integrations are available.

Getting Started with Django

  • Installation: You can install Django using pip, Python's package manager:
    pip install django
  • Creating a Django Project: Once Django is installed, you can create a new Django project using the following command:
    django-admin startproject <myproject>
  • Running the Development Server: You can start the Django development server using the following command. This will start the development server on http://127.0.0.1:8000/ by default:
    cd <myproject>
    python manage.py runserver
  • Creating Apps: Django projects are composed of one or more apps. You can create a new app within your project using the following command:
    python manage.py startapp myapp
    

For more information you can check Django documentation: https://www.djangoproject.com/

Selenium

For Scraping Process

Web Scraping with Selenium allows you to gather all the required data using Selenium Webdriver Browser Automation. Selenium crawls the target URL webpage and gathers data at scale.

Steps for Project Setup

  1. Clone the repository:

    git clone <REPOSITORY URL>
    cd GoogleMapScraping
  2. Install the required libraries by running the following command:

    pip install -r requirements.txt
  3. Run website

    cd googlemap
    python3 manage.py makemigrations
    python3 manage.py migrate
    python3 manage.py runserver
    

Steps for Database Setup

  1. Before running any postgresql commands we need to switch user to postgres:
    sudo -u postgres psql
  2. Create Database
    CREATE DATABASE <DATABASE_NAME>;
  3. Create User
    CREATE USER <USERNAME> WITH PASSWORD '<PASSWORD>';
  4. Grant Database privileges to User
    GRANT ALL PRIVILEGES ON DATABASE <DATABASE_NAME> to <USERNAME>;
  5. Exit
    \q

django_google_map_scraper's People

Contributors

ishika-mi avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.