Giter Club home page Giter Club logo

scraping-trailhead-scores's Introduction

scraping-trailhead-scores

You can get the data of trailhead scores as tsv-style.

clone

git clone https://github.com/takahitomiyamoto/scraping-trailhead-scores.git
cd scraping-trailhead-scores

prepare data (data/trailhead_users.csv)

Format:

1 2
User Name User ID

Example:

@takahito0508,takahito0508
Taro Yamada,005XXXXXXXXXXXXXXX

execute

sudo chmod +x ./scrapingTrailheadScores.sh
./scrapingTrailheadScores.sh

check result (result/trailhead_scores.tsv)

Format:

1 2 3 4 5 6 7
User Name User ID Badges Points Trails Completed Superbadges Trailblazer Ranks

Example:

@takahito0508	takahito0508	238	174,305	27	7	Ranger
Taro Yamada	005XXXXXXXXXXXXXXX	100	100,000	10	0	Mountaineer

scraping-trailhead-scores's People

Contributors

acn-takahito-miyamoto avatar takahitomiyamoto avatar

Watchers

avatar avatar avatar

scraping-trailhead-scores's Issues

'NoneType' object has no attribute 'text'

Hi,

I get stuck on this error:
AttributeError: 'NoneType' object has no attribute 'text'

Any advise?

Cheers

[2022/06/14 12:51:53] Read /Users/timdries/scraping-trailhead-scores/data/trailhead_users.csv
[2022/06/14 12:51:53] CSV Size: 65

[WDM] - ====== WebDriver manager ======
[WDM] - Current google-chrome version is 102.0.5005
[WDM] - Get LATEST chromedriver version for 102.0.5005 google-chrome
[WDM] - Driver [/Users/timdries/.wdm/drivers/chromedriver/mac64_m1/102.0.5005.61/chromedriver] found in cache
Traceback (most recent call last):
File "/Users/timdries/scraping-trailhead-scores/src/Main.py", line 50, in
main.main()
File "/Users/timdries/scraping-trailhead-scores/src/Main.py", line 34, in main
_trailhead_score = service.get_trailhead_score(user_list_row)
File "/Users/timdries/scraping-trailhead-scores/src/services/TrailheadService.py", line 53, in get_trailhead_score
_numbers_of_points = driver.find_element_by_xpath(
AttributeError: 'NoneType' object has no attribute 'text'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.