ches-ctrl / cheddar Goto Github PK

Stages:

• Install Tailwind - done
• Create all (~21 total) components from Protocol Tailwind template - https://protocol.tailwindui.com/ - in progress
• Create index page
• Create home page

Acceptance criteria

• Reusable components built (able to be used in other areas of the application)
• Aligned with new colour palette
• Pages look of the same quality as the template on the Tailwind UI website

Timeline

• Monday - all components (x5)
• Tuesday - index page
• Tuesday - home page
• Wed-Fri - remaining components (x16)

Reference branch - https://github.com/Ches-ctrl/Cheddar/tree/tailwind_protocol_template

Description

• Create query object that means we can filter jobs according to certain criteria

Acceptance criteria

• Can pull all jobs from each of the ATS APIs
• Can see all jobs in development
• Can filter jobs according to the query object in production
• Are able to use this to analyse the quality of the data (e.g. by ATS system / by company)

Timeline

• Suggested Fri 31st but no worries if not possible)

(Shout if any edits)

Tagging the branch for visibility

https://github.com/Ches-ctrl/Cheddar/tree/company-crawler

Update the job show page according to the Figma

Features

• Chrome extension
• Button only to add job

Acceptance criteria

• Can add a job based on the page the user is on via the url

Dependencies

• API post endpoint to add URL to saved jobs (CC to sort)

Working:

• https://github.com/Ches-ctrl/Cheddar/tree/chrome-extension

Problems

• Loading all of the jobs at the moment for every query

Discussion

• Query all the categories on LHS, only get 20 jobs on the RHS

Notes

• Happy to rearrange schema if that may help things e.g. parsing out industry & sub_industry
• Dan has recently pushed a branch with some updates - #136

Acceptance Criteria

• Ideally we get the category sidebar loading on the LHS and doesn't cause N+1 issues

Instructions

• Setup the XML importer from Workable's XML feed
• Current code: Services/Importer/XML/workable.rb (also a background job)
• Docs: https://help.workable.com/hc/en-us/articles/4420464031767-Utilizing-the-XML-Job-Feed
• The importer needs to
  • Request the import
    • NB. the Workable XML feed is sensitive to 403 Forbidden errors (too many requests)
  • Stream and store the XML file locally & in Amazon S3
    • Stream the XML file using Faraday (gem already installed)
    • Use a block to parse the XML systematically
    • NB. The feed includes urls of the format: https://apply.workable.com/j/9A5B371BA0 (i.e. without the ats_identifier)
    • Build an S3 uploader so that (some code already exists in the repo)
    • Chat with Charlie about the best folder structure to store this
  • Find the redirected URLs
    • i.e. URLs with the ats_identifier of the company e.g. papier - https://apply.workable.com/papier/j/67BE15191B/
    • There is often a staging page that needs to be waited for - check for the interim response code and use a different IP address to bypass if required
    • This may require using a proxy e.g. SCRAPE_UP is included in the repo
  • Save the redirected URLs locally

    • Please submit a check in with Charlie at this point - once you have the list of URLs with ats_identifiers

  • Pass the URL to URL::CreateJobFromUrl

Notes

• Request contributor access on the repo
• Setup a draft PR in the repo with your code to submit

Acceptance Criteria

• Can use rake xml:workable to import all the jobs from the XML feed
• Must count the number of URLs in the XML
• Can save the XML file locally
• Can save the redirect URLs in a JSON locally (format TBD)
• Can create jobs for all the URLs