This tool is really great, but sometimes i need to test it against self signed certs or expired/invalid ones.
what about to add a flag to ignore invalid or self signed certs?

root@kali:/Tools/OpenDoor# pip install -r requirements.txt
Requirement already satisfied: urllib3 in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 1)) (1.22)
Collecting json2html (from -r requirements.txt (line 2))
Downloading https://files.pythonhosted.org/packages/23/33/e6367858c5da6795d3277e9ea4e58a70a7fd55f97f4bcc90b1ecec1c1410/json2html-1.2.1.tar.gz
Collecting tabulate (from -r requirements.txt (line 3))
Downloading https://files.pythonhosted.org/packages/12/c2/11d6845db5edf1295bc08b2f488cf5937806586afe42936c3f34c097ebdc/tabulate-0.8.2.tar.gz (45kB)
100% |████████████████████████████████| 51kB 2.8MB/s
Building wheels for collected packages: json2html, tabulate
Running setup.py bdist_wheel for json2html ... done
Stored in directory: /root/.cache/pip/wheels/c8/8a/ae/daa5ab4d808a6b7f77d8fd967efd85ccf2e18364ed87b0c694
Running setup.py bdist_wheel for tabulate ... done
Stored in directory: /root/.cache/pip/wheels/2a/85/33/2f6da85d5f10614cbe5a625eab3b3aebfdf43e7b857f25f829
Successfully built json2html tabulate
Installing collected packages: json2html, tabulate
Successfully installed json2html-1.2.1 tabulate-0.8.2
root@kali:/Tools/OpenDoor# chmod +x opendoor.py
root@kali:~/Tools/OpenDoor# python3 opendoor.py --host https://www.placeholder.org
[!] Several dependencies wasn't installed!
Please run sudo pip install -r requirements.txt

root@kali:/Tools/OpenDoor# sudo pip install -r requirements.txt
Requirement already satisfied: urllib3 in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 1)) (1.22)
Requirement already satisfied: json2html in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 2)) (1.2.1)
Requirement already satisfied: tabulate in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 3)) (0.8.2)
root@kali:/Tools/OpenDoor# python3 opendoor.py --host https://www.placeholder.org
[!] Several dependencies wasn't installed!

Issue started occuring about a week ago but beforehand everything was fine. Tool is currently up to date with issue.

It would be great if the actual response codes were also printed out and written in the reports.

LONG_DESCRIPTION = open('README.rst', 'r+', encoding='utf-8').read()

Can you include status response size in output? This could really help.

Great tool btw

Improve WIKI pages. Currently the pages has no informations

[2016-08-08 03:05:01] CRITICAL : /opt/OpenDoor/Data/directories.dat file can not be read

Progress of coverage must be > %60

Hi, the dependencies already meet when I install them.

sudo pip install -r requirements.txt
Requirement already satisfied: urllib3 in /usr/lib/python2.7/dist-packages (from -r requirements.txt (line 1))
Requirement already satisfied: json2html in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 2))
Requirement already satisfied: tabulate in /usr/local/lib/python2.7/dist-packages (from -r requirements.txt (line 3))

But, I ran the script got error as the title

v3.4.48

In ./src/core/http/https.py (and other like), parameter timeout not defined in "request" function:

response = PoolManager().request(self.__cfg.method, url,
headers=self._headers,
retries=self.__cfg.retries,
assert_same_host=False,
redirect=False)

so i got totally stoped scan progress if any not-responsable domain was requested, eg
"https://mail3.1tv.ru"

Adding timeout=3 helps me.

While trying to install via pip3 I get:

$ pip3 install opendoor
Collecting opendoor
  Downloading opendoor-4.2.0.tar.gz (1.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 2.4 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [6 lines of output]
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-zisqpebd/opendoor_18f697a3bda544c2a618f40c0f594f9f/setup.py", line 21, in <module>
          fVersion = open('VERSION').readline().rstrip()
      FileNotFoundError: [Errno 2] No such file or directory: 'VERSION'
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

while executing the opendoor python file this error message shown (error: 'Worker' object has no attribute 'isAlive') please help to resolve this issue...

What is the problem for this issue?
Thanks

when running python3 opendoor.py --host example.com
I get:

[!] Several dependencies wasn't installed!
Please run sudo pip install -r requirements.txt

after logging in as root and running the command above for req install, I get a message that all 3 reqs have been installed.

runnig ubuntu 17.10 x64

Consider adding checks for Spring Boot Actuator, which if openly accessible in production can be leveraged to run trace, dump memory, manipulate environment variables, etc. [1][2][3]

Looks like patterns might be added here to directories.dat.

/actuator
/actuator/auditevents
/actuator/autoconfig
/actuator/beans
/actuator/caches
/actuator/conditions
/actuator/configprops
/actuator/env
/actuator/flyway
/actuator/health
/actuator/httptrace
/actuator/info
/actuator/integrationgraph
/actuator/loggers
/actuator/liquibase
/actuator/metrics
/actuator/mappings
/actuator/scheduledtasks
/actuator/sessions
/actuator/shutdown
/actuator/threaddump
/actuator/heapdump
/actuator/jolokia
/actuator/logfile
/actuator/prometheus

Hello, I have tried both sudo pip install -r requirements.txt and pip install -r requirements.txt but I am still getting errors. Any help would be appreciated!

python3 opendoor.py --host https://somesite.com
Traceback (most recent call last):
  File "opendoor.py", line 25, in <module>
    __import__(_)
ModuleNotFoundError: No module named 'json2html'

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "opendoor.py", line 27, in <module>
    sys.exit("""\t\t[!] Several dependencies wasn't installed! Please run pip install -r requirements.txt. Details : %s.""" %(error))
NameError: name 'error' is not defined

When I try to do pip install -r requirements.txt:

pip install -r requirements.txt
Collecting urllib3 (from -r requirements.txt (line 1))
  Using cached https://files.pythonhosted.org/packages/9f/f0/a391d1463ebb1b233795cabfc0ef38d3db4442339de68f847026199e69d7/urllib3-1.25.10-py2.py3-none-any.whl
Collecting json2html (from -r requirements.txt (line 2))
Collecting tabulate (from -r requirements.txt (line 3))
Installing collected packages: urllib3, json2html, tabulate
Successfully installed json2html-1.3.0 tabulate-0.8.7 urllib3-1.25.10

I installed it on Global ,when I finished it, I typed "opendoor --version", and it showed this error "error: PackageError: str: data/directories.dat is not a file".

So how can I fix it. THX.

Provide dictionary extension filer like -extension php,jsp ...etc

Traceback (most recent call last):
File "/root/OpenDoor/opendoor.py", line 35, in
bootstrap = Controller()
^^^^^^^^^^^^
File "/root/OpenDoor/src/controller.py", line 54, in init
self.ioargs = args().get_arguments()
^^^^^^^^^^^^^^^^^^^^^^
File "/root/OpenDoor/src/lib/io/arguments.py", line 37, in get_arguments
args = options().get_arg_values()
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/OpenDoor/src/core/options/options.py", line 387, in get_arg_values
args = Filter.filter(args)
^^^^^^^^^^^^^^^^^^^
File "/root/OpenDoor/src/core/options/filter.py", line 45, in filter
filtered['host'] = Filter.host(value)
^^^^^^^^^^^^^^^^^^
File "/root/OpenDoor/src/core/options/filter.py", line 95, in host
regex = re.compile(r"" + Filter.URL_REGEX + "")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/init.py", line 227, in compile
return _compile(pattern, flags)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/init.py", line 294, in _compile
p = _compiler.compile(pattern, flags)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_compiler.py", line 743, in compile
p = _parser.parse(p, flags)
^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_parser.py", line 980, in parse
p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_parser.py", line 455, in _parse_sub
itemsappend(_parse(source, state, verbose, nested + 1,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_parser.py", line 863, in _parse
p = _parse_sub(source, state, sub_verbose, nested + 1)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_parser.py", line 455, in _parse_sub
itemsappend(_parse(source, state, verbose, nested + 1,
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/lib/python3.11/re/_parser.py", line 841, in _parse
raise source.error('global flags not at the start '
re.error: global flags not at the start of the expression at position 69

eg.
i want to scan in ip/hello/*
but when i input command:
python3 opendoor.py --host ip/hello/ --port 80

the scanner just scan in directory "/"

Hey @stanislav-web,

so I've changed the PKGBUILD to use python3 instead of python2 and I am getting the following runtime error on ArchLinux (BlackArch) with kernel 4.11.3 + python3.6 + all required dependencies:

$ opendoor Traceback (most recent call last): File "/usr/bin/opendoor", line 11, in <module> load_entry_point('opendoor==3.3.36rc0', 'console_scripts', 'opendoor')() File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 561, in load_entry_point return get_distribution(dist).load_entry_point(group, name) File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2649, in load_entry_point return ep.load() File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2303, in load return self.resolve() File "/usr/lib/python3.6/site-packages/pkg_resources/__init__.py", line 2309, in resolve module = __import__(self.module_name, fromlist=['__name__'], level=0) File "/usr/lib/python3.6/site-packages/src/__init__.py", line 21, in <module> from .controller import Controller File "/usr/lib/python3.6/site-packages/src/controller.py", line 19, in <module> from src.core.decorators import execution_time File "/usr/lib/python3.6/site-packages/src/core/__init__.py", line 43, in <module> from .logger import LoggerException as exception File "/usr/lib/python3.6/site-packages/src/core/logger/__init__.py", line 19, in <module> from .exception import LoggerException File "/usr/lib/python3.6/site-packages/src/core/logger/exception.py", line 24, in <module> from .config import Config File "/usr/lib/python3.6/site-packages/src/core/logger/config.py", line 34, in <module> class Config(object): File "/usr/lib/python3.6/site-packages/src/core/logger/config.py", line 38, in Config logdir = os.path.dirname(exception_log()) File "/usr/lib/python3.6/site-packages/src/core/logger/config.py", line 30, in exception_log config = filesystem.readcfg('setup.cfg') File "/usr/lib/python3.6/site-packages/src/core/filesystem/filesystem.py", line 259, in readcfg os.chdir(cwd.group()) AttributeError: 'NoneType' object has no attribute 'group'

The PKGBUILD file can be found here: https://github.com/BlackArch/blackarch/tree/36ebf72683990e5a4c36d7993cb28d79ffee4910/packages/opendoor

Can we solve this asap so i can release opendoor along with the new BlackArch ISOs soon?

I get the following error code:
error: ResponseError: Unknown response status : 409
and then the script stops.

Is there any way to stop the script from stopping on response errors?

Setting a HTTPS URL reverts to HTTP.

(venv) root@root:~/OpenDoor$ python3 opendoor.py --host https://***.***/
############################################################
#                                                          #
#   _____  ____  ____  _  _    ____   _____  _____  ____   #
#  (  _  )(  _ \( ___)( \( )  (  _ \ (  _  )(  _  )(  _ \  #
#   )(_)(  )___/ )__)  )  (    )(_) ) )(_)(  )(_)(  )   /  #
#  (_____)(__)  (____)(_)\_)  (____/ (_____)(_____)(_)\_)  #
#                                                          #
#  Directories: 36943                                      #
#  Subdomains: 181018                                      #
#  Browsers: 112                                           #
#  Proxies: 204                                            #
#  License: GNU General Public License                     #
############################################################
[16:56:29] info:    Use --report param to store your scan results                                                          
[16:56:29] info:    Wait, please, checking connect to -> ***.***:443 ...                                               
[16:56:30] info:    Server kurs.expert:443 (91.220.101.150) is online!                                                     
[16:56:30] info:    Scanning ***.*** ...                                                                               
[16:56:35] warning: skip. Max retries exceeded: /!.gitignore                                                               
^C^C[16:56:36] cancel:  Session canceled

it happened today

в общем то пользовался тулзой пару лет, тут сегодня вот такое при любом скане хоста, куда копать? (kali os latest)

Provide output report param to custom directory

redirect=False 时候，redirecct才会加入列表。。。。。不支持https，不支持http port。。。。。不支持http复用。不过程序架构不错，赞一个👍一个

With -i option, subdomain scanning terminates with error :

error: ResponseError: cannot use a string pattern on a bytes-like object
Terminated

on page
http://beta.drweb.ru

Without -i option - no problem.

Increase coverage to 80 ...percent

Hello,

After successfully install requirements.txt I am getting the following error.
[!] Several dependencies wasn't installed!
Please run sudo pip install -r requirements.txt
How can I fix it?

Issue By Creating Report With The Result After scanning The Target ;

THis app is ok, but it doesnt support non standard web port

so you are pretty much stuck on port 80. meaning its probably easier to stick with another app similar to this that does more.

Any possibility of future updates?

Is it possible to get it to ignore bad SSL certs as i am proxying via burp for a website but get errors about self signed.

[04:01:44] error: ResponseError: Unknown response status : 520

Do you know what is causing this error? It is causing script to stop. Thanks

Resume scan starting from line number x from wordlist.

Hey,

could you add an option to only show found items or anything with 3xx or 2xx responses?

i know it currently shows some denied requests but sometimes that's not useful and only the 2xx or 3xx are handy to see.

Request a feature to show the IP of founded subdomain, like

...
[00:26:55] info: 18.3% [018525/101000] - 111KB - OK https://copy.1tv.ru:443 - [ 81.177.156.116 , 81.177.156.117 ]
...
in stdout and report.
It's will cheap, but useful, i think.

Traceback (most recent call last):
File "./opendoor.py", line 32, in
from src import Controller, SrcError
File "/home/ghostgtr666/Documents/tools/OpenDoor/src/init.py", line 21, in
from .controller import Controller
File "/home/ghostgtr666/Documents/tools/OpenDoor/src/controller.py", line 19, in
from src.core.decorators import execution_time
File "/home/ghostgtr666/Documents/tools/OpenDoor/src/core/init.py", line 31, in
from .http import HttpRequest as request_http
File "/home/ghostgtr666/Documents/tools/OpenDoor/src/core/http/init.py", line 20, in
from .proxy import Proxy
File "/home/ghostgtr666/Documents/tools/OpenDoor/src/core/http/proxy.py", line 23, in
from urllib3.exceptions import DependencyWarning, MaxRetryError, ProxySchemeUnknown,
ImportError: cannot import name 'DependencyWarning'

how to fix just type this command
and simply upgrade the package on the pip

$ sudo pip install --upgrade requests

run opendoor

python opendoor.py

more or less please check the documentation from me

https://www.gagaltotal666.site/2018/09/mengatasi-importerror-dependencywarning.html

and apologize if the documentation is different language
please use translate if you don't know the language I use in the documentation
so and hopefully useful ^_^

Please i just finished scanning a website but don't know where to find the scan report.

Hi, I have faced with issue :

Exception in thread Thread-1 (most likely raised during interpreter shutdown):
Traceback (most recent call last):
File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
File "/usr/local/lib/python2.7/dist-packages/threadpool.py", line 150, in run
<type 'exceptions.AttributeError'>: 'NoneType' object has no attribute 'Empty'

root@123:~/OpenDoor# python --version
Python 2.7.9

python3 setup.py build && python3 setup.py install
running build
running build_py
running egg_info
error: Cannot update time stamp of directory 'opendoor.egg-info'

If define wordlist file with -w option, testing always starts in default - directories mode, although "-s subdomains" option define too:

$./opendoor.py -t5 --reports=txt -w sub.dat -s subdomains --host=https://1tv.ru
...
[00:02:06] info: Scanned host has been reported. Press ENTER to rescan or CTRL+C to exit:
[00:02:07] info: Wait, please, checking connect to -> 1tv.ru:443 ...
[00:02:08] info: Server 1tv.ru:443 (195.16.108.152) is online!
[00:02:08] info: Scanning 1tv.ru ...
[00:02:08] info: 50.0% [05/10] - 178B - R https://1tv.ru:443/copy -> https://www.1tv.ru/copy
[00:02:08] info: 60.0% [06/10] - 178B - R https://1tv.ru:443/002 -> https://www.1tv.ru/002
[00:02:08] info: 70.0% [07/10] - 178B - R https://1tv.ru:443/003 -> https://www.1tv.ru/003
...

If remove -w option - all right.

It ends in such a big Traceback:

Traceback (most recent call last):
  File "C:\Users\PC4-User\Downloads\OpenDoor\opendoor.py", line 35, in <module>
    bootstrap = Controller()
                ^^^^^^^^^^^^
  File "C:\Users\PC4-User\Downloads\OpenDoor\src\controller.py", line 54, in __init__
    self.ioargs = args().get_arguments()
                  ^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\Downloads\OpenDoor\src\lib\io\arguments.py", line 37, in get_arguments
    args = options().get_arg_values()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\Downloads\OpenDoor\src\core\options\options.py", line 387, in get_arg_values
    args = Filter.filter(args)
           ^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\Downloads\OpenDoor\src\core\options\filter.py", line 45, in filter
    filtered['host'] = Filter.host(value)
                       ^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\Downloads\OpenDoor\src\core\options\filter.py", line 95, in host
    regex = re.compile(r"" + Filter.URL_REGEX + "")
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\__init__.py", line 227, in compile
    return _compile(pattern, flags)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\__init__.py", line 294, in _compile
    p = _compiler.compile(pattern, flags)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_compiler.py", line 743, in compile
    p = _parser.parse(p, flags)
        ^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_parser.py", line 980, in parse
    p = _parse_sub(source, state, flags & SRE_FLAG_VERBOSE, 0)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_parser.py", line 455, in _parse_sub
    itemsappend(_parse(source, state, verbose, nested + 1,
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_parser.py", line 863, in _parse
    p = _parse_sub(source, state, sub_verbose, nested + 1)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_parser.py", line 455, in _parse_sub
    itemsappend(_parse(source, state, verbose, nested + 1,
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Users\PC4-User\AppData\Local\Programs\Python\Python311\Lib\re\_parser.py", line 841, in _parse
    raise source.error('global flags not at the start '
re.error: global flags not at the start of the expression at position 69

I kept getting the error that I was missing urllib3, colorama and termcolor, when I had each of them installed. Upon looking I saw that httplib2 was also needed. All thats needed is change to the error message to include httplib2 as potentially missing

v3.4.48

Custom subdomain list contains domain with dot - "m." , so opendoor generate incorrect url, eg:
http://m..1tv.ru

and terminate all scan process as:

[16:54:41] error: encoding with 'idna' codec failed (UnicodeError: label empty or too long)
Terminated

Add exception catch and URL/domain normalization need, i think.

zsh: terminated python3 opendoor.py --host

What is the mistake i have done ?

Hello Sir,
you stated that:
Testing of the software on the commercial systems and organizations is prohibited!
but can I use it in my research for vulnerabilities in bug bounty programs

thanks