Comments (6)
mrcaseb
commented on June 12, 2024
1
This won't fix the problem in this issue of course but could prevent future problems
from espnscraper.
jthomasmock
commented on June 12, 2024
Interesting!
I just tested for season level data and that seems to be working out ok. I don't have local data stored for college (only NFL stuff) unfortunately. I hope that they fix the data source, but will take a peek at the endpoints to see if there's anything awry.
library(tidyverse)
library(espnscrapeR)
all_college <- 2010:2020 %>%
map_dfr(get_college_qbr)
all_college %>%
distinct(season)
# A tibble: 11 x 1
# season
# <int>
# 1 2010
# 2 2011
# 3 2012
# 4 2013
# 5 2014
# 6 2015
# 7 2016
# 8 2017
# 9 2018
# 10 2019
# 11 2020
from espnscraper.
mrcaseb
commented on June 12, 2024
I don't have local data stored for college (only NFL stuff) unfortunately.
Sorry to barge into the discussion like this but I have a suggestion:
How about setting up a scheduled GitHub action that loads and saves the data in a repo? I could help with the setup as I am doing this in multiple repos now.
from espnscraper.
jthomasmock
commented on June 12, 2024
Yah I have the start of a data repo but have been lagging on getting it completed due to my own lack of time.
I have local copies of everything else as an intention to build the data repo, but seemed to have failed on the college QBR stuff.
from espnscraper.
jthomasmock
commented on June 12, 2024
I just revamped everything to use httr and it solved a host of issues rather than relying on reading in the JSON raw.
@christianlohr9 - can you confirm this is working with latest release (0.5.1)? Also please note the new syntax get_college_qbr(season = 2020, type = "weekly"). Their API updated so it does paginated calls rather than a specific week of interest.
all_qbr <- purrr::pmap_dfr(data.frame(season = 2017:2020, type = "weekly"), espnscrapeR::get_college_qbr)
Scraping QBR for all weeks of 2017!
Scraping QBR for all weeks of 2018!
Scraping QBR for all weeks of 2019!
Scraping QBR for all weeks of 2020!
all_qbr
# A tibble: 6,064 x 35
season week week_text week_type player_id player_uid player_guid first_name
<int> <int> <chr> <chr> <chr> <chr> <chr> <chr>
1 2017 1 Week 1 Regular 3915776 s:20~l:23~a:… cb87cd32ec44b6… Kyle
2 2017 1 Week 1 Regular 550373 s:20~l:23~a:… 5bb4376ad089e3… Baker
3 2017 1 Week 1 Regular 4036210 s:20~l:23~a:… 72bd418b3cd541… Tyrrell
4 2017 1 Week 1 Regular 3116407 s:20~l:23~a:… 779f3cff73ebdc… Mason
5 2017 1 Week 1 Regular 3917810 s:20~l:23~a:… d3095f49b0478d… TaQuon
6 2017 1 Week 1 Regular 4240689 s:20~l:23~a:… b910f6e3c25865… Jake
7 2017 1 Week 1 Regular 3728240 s:20~l:23~a:… 778de00a350eea… Kelly
8 2017 1 Week 1 Regular 3916251 s:20~l:23~a:… 79ec907a5c1322… Zach
9 2017 1 Week 1 Regular 550448 s:20~l:23~a:… b1b5449071e0bd… Jesse
10 2017 1 Week 1 Regular 3124092 s:20~l:23~a:… f3c9aea4bff630… John
# … with 6,054 more rows, and 27 more variables: last_name <chr>, display_name <chr>,
# short_name <chr>, headshot_href <chr>, team_name <chr>, team_short_name <chr>,
# slug <chr>, team_id <chr>, team_uid <chr>, age <int>, game_id <chr>,
# game_date <chr>, player_home_away <chr>, score <chr>, opp_team_id <chr>,
# opp_team_name <chr>, opp_team_short_name <chr>, qbr_total <dbl>, pts_added <dbl>,
# qb_plays <dbl>, epa_total <dbl>, pass <dbl>, run <dbl>, exp_sack <dbl>,
# penalty <dbl>, qbr_raw <dbl>, sack <dbl>
from espnscraper.
jthomasmock
commented on June 12, 2024
Closing this for now as I can confirm it's working again, but @christianlohr9 let me know if you run into any problems.
from espnscraper.
Related Issues (20)
- Wrong team in ESPN API? HOT 4
- Error in player name for players on multiple teams throughout the year HOT 1
- ESPN Data inconsistent HOT 3
- Intragame win probability HOT 3
- Unable to pull 2020 College QBR HOT 2
- Two stray commas causing get_nfl_schedule to fail HOT 1
- keep venue in get_schedule_data HOT 1
- get_nfl_boxscore_players(game_id = "401220131") HOT 4
- Connection Error HOT 2
- get_nfl_teams() Error 403 HOT 3
- get_college_qbr() only pulling 2020 data HOT 6
- get_athlete() Error: Not Found (HTTP 404) HOT 1
- List of Player ID's HOT 1
- Some boxscores do not appear HOT 1
- 2022 Pass Win Rates Update HOT 2
- Installation Assistance HOT 1
- `scrape_team_stats_nfl` gives error when `role="defense"` HOT 2
- Defense type in scrape_espn_stats() HOT 1
- Add 2023 win rates? HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from espnscraper.