Giter Club home page Giter Club logo

google-play-scraper's Introduction

Google Play Store Scraper

This gem allows you to search the Google Play App store by means of scraping the html search results. An example search result can be seen here

Usage

Start with:

gem install google_play_scraper

or

gem 'google_play_scraper', '~> 0.0.1'

Doing a search

search = GooglePlayScraper::Search.new('Angry Birds')
results = search.run # an array of GooglePlayScraper::App

You can customize the results you get back by passing a hash as the second parameter to GooglePlayScraper::Search constructor.

module GooglePlayScraper
  module SearchOptions
    CATEGORY = :c
    LANGUAGE = :hl
    APPLY_SORTING = :sort
    SAFE_SEARCH = :safe
    NUMBER_OF_RESULTS = :num
  end
end

DEFAULT_OPTIONS = {
  CATEGORY => 'apps',
  LANGUAGE => 'en',
  APPLY_SORTING => 1, # 0 means no sorting
  SAFE_SEARCH => 0, # apply safesearch to results
  NUMBER_OF_RESULTS => 10 # number of results to display
}

Your gem doesn't do __ >:(

Create a fork request and provide some kind of rspec test for it - otherwise I might break it accidentially in future.

License

MIT

google-play-scraper's People

Contributors

mikeemery avatar

Stargazers

 avatar  avatar

Watchers

 avatar

google-play-scraper's Issues

License missing from gemspec

Some companies will only use gems with a certain license.
The canonical and easy way to check is via the gemspec
via e.g.

spec.license = 'MIT'
# or
spec.licenses = ['MIT', 'GPL-2']

There is even a License Finder to help companies ensure all gems they use
meet their licensing needs. This tool depends on license information being available in the gemspec.
Including a license in your gemspec is a good practice, in any case.

How did I find you?

I'm using a script to collect stats on gems, originally looking for download data, but decided to collect licenses too,
and make issues for missing ones as a public service :)
https://gist.github.com/bf4/5952053#file-license_issue-rb-L13 So far it's going pretty well

Appstats not working anymore

As of today the appstats download is not working anymore. I'd guess the URL has changed. If I try to access the url directly in the browser I see a Google Error Page saying:
400. That’s an error.

The requested URL was not found on this server. That’s all we know.

Please finde the Console Output of the scraper below:

URL = https://play.google.com/apps/publish/v2/statistics/download?package=my.package&sd=20130804&ed=20130804&dim=overall,country,language,os_version,device,app_version,carrier&met=active_device_installs,daily_device_installs,daily_device_uninstalls,daily_device_upgrades,active_user_installs,total_user_installs,daily_user_installs,daily_user_uninstalls,daily_avg_rating,total_avg_rating
/var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:306:in fetch': 400 => Net::HTTPBadRequest for https://play.google.com/apps/publish/statistics/download?package=my.package&sd=20130804&ed=20130804&dim=overall,country,language,os_version,device,app_version,carrier&met=active_device_installs,daily_device_installs,daily_device_uninstalls,daily_device_upgrades,active_user_installs,total_user_installs,daily_user_installs,daily_user_uninstalls,daily_avg_rating,total_avg_rating -- unhandled response (Mechanize::ResponseCodeError) from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:974:inresponse_redirect'
from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:298:in fetch' from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:974:inresponse_redirect'
from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:298:in fetch' from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:974:inresponse_redirect'
from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/http/agent.rb:298:in fetch' from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize.rb:1272:inpost_form'
from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize.rb:539:in submit' from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/form.rb:223:insubmit'
from /var/lib/gems/1.9.1/gems/mechanize-2.7.1/lib/mechanize/form.rb:229:in click_button' from /var/lib/gems/1.9.1/gems/googleplay_scraper-0.2.2/lib/googleplay_scraper/scraper_base.rb:55:intry_get'
from /var/lib/gems/1.9.1/gems/googleplay_scraper-0.2.2/lib/googleplay_scraper/scraper.rb:156:in get_appstats' from /var/lib/gems/1.9.1/gems/googleplay_scraper-0.2.2/bin/googleplay_scraper:136:inappstats'
from /var/lib/gems/1.9.1/gems/googleplay_scraper-0.2.2/bin/googleplay_scraper:41:in main' from /var/lib/gems/1.9.1/gems/googleplay_scraper-0.2.2/bin/googleplay_scraper:146:in<top (required)>'
from /usr/local/bin/googleplay_scraper:23:in load' from /usr/local/bin/googleplay_scraper:23:in

'

Thanks for your effort.
Kind regards
Nicow

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.