josh0xa / darkdump Goto Github PK

Ahmia.fi Interface for Deep Web Parsing

License: MIT License

Python 100.00%

darkdump's Introduction

Darkdump

About Darkdump (Recent Notice - 12/27/22)

Darkdump is a simple script written in Python3 in which it allows users to enter a search term (query) in the command line and darkdump will pull all the deep web sites relating to that query.

Installation

git clone https://github.com/josh0xA/darkdump
cd darkdump
python3 -m pip install -r requirements.txt
python3 darkdump.py --help

Usage

Example 1: python3 darkdump.py --query programming
Example 2: python3 darkdump.py --query="chat rooms"
Example 3: python3 darkdump.py --query hackers --amount 12

Note: The 'amount' argument filters the number of results outputted

Usage With Increased Anonymity

Darkdump Proxy: python3 darkdump.py --query bitcoin -p


     ____          _     _
    |    \ ___ ___| |_ _| |_ _ _____ ___
    |  |  | .'|  _| '_| . | | |     | . |
    |____/|__,|_| |_,_|___|___|_|_|_|  _|
                                    |_|

        Developed By: Josh Schiavone
        https://github.com/josh0xA
            joshschiavone.com
              Version 2.0

usage: darkdump.py [-h] [-v] [-q QUERY] [-a AMOUNT] [-p]

options:
  -h, --help            show this help message and exit
  -v, --version         returns darkdump's version
  -q QUERY, --query QUERY
                        the keyword or string you want to search on the deepweb
  -a AMOUNT, --amount AMOUNT
                        the amount of results you want to retrieve (default: 10)
  -p, --proxy           use darkdump proxy to increase anonymity

Visual

Ethical Notice

The developer of this program, Josh Schiavone, is not resposible for misuse of this data gathering tool. Do not use darkdump to navigate websites that take part in any activity that is identified as illegal under the laws and regulations of your government. May God bless you all.

License

MIT License
Copyright (c) Josh Schiavone

darkdump's People

Contributors

Stargazers

Watchers

Forkers

swagkarna marciopocebon rafaeldrs insightvault hartl3y94 jon1scr crackercat cbk914 optionalg usapp-stack wwilson83 jr69ss isiaon sashka3076 gh0st0ne death-angel-141 amaymonk glyynr sharanvijaydev 0xsv1 slooppe mkdirlove 4n0n-5p1d3r fenajojuk tommalvoriddle sumeersyed sofienelkamel konstantindjairo sp3ctralm0nki3 yalonso7 abhishekpp str0wberry serverbombhub ali135hack teraxl hausfrau17 jdomzhang thelast-paladin 4jinetes cyberfury101 5l1v3r1 brynza112 horror23 userado zszvezdazs umiterkol smallfive13 downerboy securitystuffbackup lowgun c3n7ral051nt4g3ncy 9cat deepseabusch 1n1t6sh3ll trepanador meetkool cryptofrye qqqqtest123 flencrypto bmelim djpentester eze714 sirbaek stnert ivanpierre waldi084 godfidence01 orguetta mlynchcogent mathzrocha p34t1k fiebererdi 0rx1 makingw cvlabsio dash4vatar cordobes9parabelum stanhardy evertprakkie docta-cyber alabazatam thomasrgx sastry17 yousuf9963 laozhudetui 1nter5e0 orinocoz sen4l akz747 shreecontent01 robang74 yadhumanikandan cyberpunk-1982 technologiespro sec-js cyb3rhex jarek-bir cristiancmoises ratlesv anirudh-r-2506

darkdump's Issues

Error while running tool

What's going on？

HTTPSConnectionPool(host='darksearch.io', port=443): Max retries exceeded with url: /api/search?query=cats&page=1 (Caused by SSLError(SSLEOFError(8, 'EOF occurred in violation of protocol (_ssl.c:1129)')))

Awesome Repo

Awesome Repo sir I love this repo keep rocking

Error while searching

python3 darkdump.py --query testing

Output:

Operating System: linux

 ____          _     _               
|    \ ___ ___| |_ _| |_ _ _____ ___ 
|  |  | .'|  _| '_| . | | |     | . |
|____/|__,|_| |_,_|___|___|_|_|_|  _|
                                |_|  

    Developed By: Josh Schiavone
    https://github.com/josh0xA  
        joshschiavone.com

Searching For: testing on page: 1...

Traceback (most recent call last):
  File "darkdump.py", line 169, in <module>
    darkdump_main()
  File "darkdump.py", line 165, in darkdump_main
    Darkdump(cfg.__darkdump_api__, query).crawl_api()
  File "darkdump.py", line 105, in crawl_api
    json_data = darksearch_url_response.json()
  File "/usr/local/lib/python3.7/dist-packages/requests/models.py", line 900, in json
    return complexjson.loads(self.text, **kwargs)
  File "/usr/lib/python3.7/json/__init__.py", line 348, in loads
    return _default_decoder.decode(s)
  File "/usr/lib/python3.7/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/lib/python3.7/json/decoder.py", line 355, in raw_decode
    raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

I get this error while running it on google compute engine. But it works fine in windows. What must be the reason for this error?

errors in different modules

Error while searching

Traceback (most recent call last):
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 670, in urlopen
httplib_response = self._make_request(
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 381, in _make_request
self._validate_conn(conn)
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 978, in validate_conn
conn.connect()
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/connection.py", line 362, in connect
self.sock = ssl_wrap_socket(
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/util/ssl.py", line 386, in ssl_wrap_socket
return context.wrap_socket(sock, server_hostname=server_hostname)
File "/usr/lib/python3.10/ssl.py", line 513, in wrap_socket
return self.sslsocket_class._create(
File "/usr/lib/python3.10/ssl.py", line 1071, in _create
self.do_handshake()
File "/usr/lib/python3.10/ssl.py", line 1342, in do_handshake
self._sslobj.do_handshake()
ssl.SSLError: [SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:997)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/adapters.py", line 489, in send
resp = conn.urlopen(
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/connectionpool.py", line 726, in urlopen
retries = retries.increment(
File "/home/oz200247/.local/lib/python3.10/site-packages/urllib3/util/retry.py", line 446, in increment
raise MaxRetryError(_pool, url, error or ResponseError(cause))
urllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='ahmia.fi', port=443): Max retries exceeded with url: /search/?q=hacking (Caused by SSLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:997)')))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/oz200247/Hacking-Tools/darkdump/darkdump.py", line 220, in
darkdump_main()
File "/home/oz200247/Hacking-Tools/darkdump/darkdump.py", line 214, in darkdump_main
Darkdump().crawl(args.query, 10)
File "/home/oz200247/Hacking-Tools/darkdump/darkdump.py", line 141, in crawl
page = requests.get(Configuration.darkdump_api + query)
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/api.py", line 73, in get
return request("get", url, params=params, **kwargs)
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/api.py", line 59, in request
return session.request(method=method, url=url, **kwargs)
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/sessions.py", line 587, in request
resp = self.send(prep, **send_kwargs)
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/sessions.py", line 701, in send
r = adapter.send(request, **kwargs)
File "/home/oz200247/.local/lib/python3.10/site-packages/requests/adapters.py", line 563, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: HTTPSConnectionPool(host='ahmia.fi', port=443): Max retries exceeded with url: /search/?q=hacking (Caused by SSLError(SSLError(1, '[SSL: WRONG_VERSION_NUMBER] wrong version number (_ssl.c:997)')))

error

gh

01/03/2022 : DarkSearch public access is now ended || Also an UnboundLocalError

Hello Josh
darkdump is not working anymore.
When I tried to run the program for the first time, I was getting the following error:
"UnboundLocalError: local variable 'json_data' referenced before assignment"

When I opened the code and started to examine it, I found that you are using two try and two except statements, that if the top try statement fails, 'Json_data' will be kind of undefined, which is why python throws UnboundLocalError. We can solve this problem by combining two try statements and write a total expect statement like the following:
(lines 103 - 118)

   try:
            darksearch_url_response = requests.get(self.api, params=self.query)
            json_data = darksearch_url_response.json()
            #json_dump = json.dumps(json_data, indent=2)
            darksearch_url_response.headers["User-Agent"] = random.choice(hdrs.useragent)
            if json_data['total'] >= cfg.DARKDUMP_MIN_DATA_RETRIEVE_LENGTH: # data >= 1
                for key in range(0, 18):
                    site_title = json_data['data'][key]['title']
                    site_onion_link = json_data['data'][key]['link']
                    print(clr.BOLD + clr.G + f"[+] Site Title: {site_title}\n\t> Onion Link: {clr.R}{site_onion_link}\n" + clr.END)
        except (IndexError, requests.RequestException) as re:
            print(clr.BOLD + clr.R + str(re) + clr.END)
            print(clr.BOLD + clr.R + f"[-] No results found for query: {self.query}\n" + clr.END)

And the second issue is that the api specified darkdump_api = "https://darksearch.io/api/search" on line 64 is no longer publicly accessible.

If anyone else knows a way to solve the second problem, please let me know.