snapzie / showdashboard Goto Github PK

Database model

• Think the design through
  • Year competitions?
  • Ad hoc queries?

Tables to make:

Disjoint tasks

• Scrape SPK show URLs
• Create json of breed id's (raids) for easy import.
  • Make table in #2 ?
• Create list of SPK breeds to limit scraping

Dog data to scrape:

• Pedigree
• CK (Binary)
• Judgement (Excellent, Very Good etc...)
• Top4 (placed x in best of sex)
• BoS (BiR or BiM binary)
• Result (3. BHK CERT etc... whole line)
• Critique
• Sex
• Breed
• Class
• Age?

Show data to scrape:

• Name
• Date

Larger tasks

• Create upload of data to #2
• Create breed scraping loop
• Create show scraping loop

Dog Specific

• Comparison of results across time / per show

Breed specific

• Distribution of classes, per year?
• Distribution of CK, excellent, very good?
• Word cloud from critiques
• BIR index? To measure if the same dog in the breed is BiR every show
• Compare veteran judgement to champion / Compare junior judgement to champion
• Ranking of dogs based on points (year competition rules) obtained normalized by number of shows attended
• Dog vs. bitch (points, CK, BiR)

Across breeds

• Number of dogs in official classes over time
• Minor puppy, puppy, junior over time, per year?
• Distributions of classes, per year?
• Distribution of CK, excellent, very good?