Giter Club home page Giter Club logo

bad_link_finder's Introduction

Bad link finder

Crawls a mirrored site and checks that all links either return a successful response or redirect to somewhere that does.

Usage

Set environment variables:

  • MIRROR_DIR, to the location of your mirrored site. Local files will be read in alphabetical order.
  • REPORT_OUTPUT_FILE, to the location you'd like the CSV saved to.
  • SITE_HOST, to the full host of the live site you'd like to test against, including protocol. For example, https://www.example.com
  • START_FROM, optional, specify a file on disk from which to start, e.g. example-folder/example.html. Will check this file and all following files. Useful for restarting aborted runs.

Then execute bad_link_finder.

bad_link_finder's People

Contributors

elliotcm avatar tekin avatar heathd avatar bradwright avatar evilstreak avatar bishboria avatar dhwthompson avatar benilovj avatar

Watchers

 avatar James Stewart avatar Simon Whatley avatar Mark Norman Francis avatar Richard Pope avatar Rebecca Cottrell avatar Steve Laing avatar Anika Henke avatar David Mann avatar minglis avatar Minno avatar David Illsley avatar Jacob Ashdown avatar Richard Baker avatar Tom avatar James Cloos avatar Mateusz Grotek avatar Lisa Scott avatar Mark Hurrell avatar Chris Heathcote avatar Tara Stockford avatar Ben Terrett avatar Andrew Leimdorfer avatar Alice Newton avatar Rhian Lewis avatar Christopher Pugh avatar  avatar  avatar Dr Keith Mitchell avatar Ash Chohan avatar Somme avatar Keith Lawrence avatar  avatar Barbara Slawinska avatar Dilwoar Hussain avatar  avatar  avatar Leena Gupte avatar Rosa Fox avatar David Trussler avatar Jonathon Shire avatar Stephen Harker avatar  avatar  avatar  avatar  avatar Shahina Rahman avatar z-gooch avatar George Eaton avatar  avatar

bad_link_finder's Issues

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.