Dragonfish is a proof of concept dark web search / indexer.
- Run
bundle install
- Install / start redis (sidekiq won't work well)
- Install / configure tor. BE CAREFUL.
- run
bundle exec rake:db:seed
(this will seed your crawler wtih some wikis) - Start sidekiq by running
sidekiq
- Redis K/V store for url:crawl_date
- Elasticsearch indexing for html and stripped text