Tested with "default.conf"

and using
http://localhost:8000/upload.html
http://localhost:8080/index.html
http://localhost:8010/cgi-bin/script-get-2.py?a=w

siege http://localhost:8000/animal.jpg --> no failed transactions

siege http://localhost:8000/index.html --> segmentation fault

siege http://localhost:8000/upload.html --> Aborted

For Mac "brew install siege"

For Linux "sudo apt-get install siege"

How to use siege?
Start the server, open a second terminal and type in "siege http://example.com"
Stresstest: "siege -c 10 -t 1M http://example.com" --> -c 10 means that 10 users sending their request at the same time
-t 1M means that the tests should run for one Minute

What is siege?
Siege is a command line tool for load testing web servers and web applications. It sends a large number of parallel requests to the server to test its response to load situations. Siege allows you to test the responsiveness and performance of a server under stress by simulating a large number of requests.

What is homebrew?
Homebrew is a package manager for macOS operating systems. It enables the easy installation of open source software and tools by automating their installation, updating and uninstallation.

Is it enough to see the status code f.e. in Postman, or shall we print it also in the terminal?

Tested: localhost:8000/diversion.html --> shouldn't this give status code 301? It showed status code 200. Max: the requested html was loaded, that is a 200. And then the browser sees in that html a redirection and loads the page http://localhost:8000/upload.html (the redirection is in the html, and does not come from the server)

localhost:8000/upload.html worked and showed 200
localhost:8000/diversion.ht worked and showed 404

Tested simple CGI with GET request and query variables. Tested with: http://localhost:8000/cgi-bin/script-get-2.py?a=b&c=d

Tested simple CGI with POST request. Tested with: http://localhost:8000/cgi-bin/script-post-2.py

solved
max: for me it gives error 508
at MaxIhme can you try it again? For me it works fine. Maybe there was still the retun 508 in, to test the error code.
Max: both adresses work fine via DockerLinux

Testresult after opening 3 times port 8000 in the default.config file:

./webserv default.conf

Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
Start Listening...
bind failed... : Address already in use

Tested with: http://localhost:8000/upload.html

Uploaded a jpg, png, gif, pdf, mp4 and prproj

Mp4 and prproj is returned as a download.

The PDF Subject gets printed on the screen, Terminal produces errors. Or is meant with error:0 that there is no error? Similar output with socket 11 for the mp4 data type. Max: I think it means that the error is 0, so nothing

@LukasKava
https://localhost:8000 results in a full terminal of
FILE WAS NOT BEEN OPEN!
because:
socket.setResponseFile(filename) is not set
because it does not go to
TestServer::_saveResponseToAFile

I did not identify a hanging connection while running siege.

at MaxIhme and @LukasKava does it also work for you? If yes, you can close the issue.

Max: no hanging connections for me
Lukas can close the issue when he also did not see any

http://localhost:8000/animal.jpg worked fine.

http://localhost:8000/static_website works

config:

location /static_website
{
	allow_methods GET;
	index static.html;
}

and 403 Forbidden when (works, because autoindex is forbidden)
config:

location /static_website
{
	allow_methods GET;
	#index static.html;
}

config:
server
{
host example.com;
...
}
server
{
host another_example.com;
...
}

server says:
Host: example.com ...succesfully created!...
Host: another_example.com ...succesfully created!...

our server is not doing anything more. It's only looking to the right ports -> the hostnames are irrelevant.

config:

server
{
...
max_body_size 1;
....
}
normally when we go to: http://localhost:8000/ and klick on "send" it should be a bigger body then 1Byte (say=Hi). But it does not say that the client body is too big. I tried it via docker and there it executed the script normally. I think Lukas is still on implementing that.

An HTTP server, short for Hypertext Transfer Protocol server, is a crucial component of the World Wide Web. It serves as the backbone for communication between clients (usually web browsers) and web servers. HTTP servers receive incoming requests from clients, process those requests, and deliver web content, such as HTML pages, images, or other resources, in response. They use the HTTP protocol to ensure the proper exchange of information between clients and servers.

siege -c 10 -t 1M http://localhost:8000/animal.jpg --> unsure if I should call this a good or a fail. Siege has no failed transactions. Webserver shows error

siege -c 10 -t 1M http://localhost:8000/upload.html --> successfull

siege -c 10 -t 1M http://localhost:8000/index.html --> successfull

siege -c 10 -t 1M http://localhost:8000/cgi-bin/script-post-2.py --> successfull

PUT request with postman to 127.0.0.1:8000/ -> browser hangs and terminal is full of:
FILE WAS NOT BEEN OPEN! (tmp folder exists)

restart try again, same.
restart try again, same.
restart try again, same. -> seems to be consistent
when I click on Cancel in postman, new printing of FILE WAS NOT BEEN OPEN! stops
and after some time comes: "ERROR: recv has failed!
CHECK RECV ERROR: : Connection reset by peer"

i tryed with PATCH request, same behaviour

UPDATE 31.10:
with docker I get 501
on mac I get 501 (not implemented) (correct)
could you both test it @RanniSch @LukasKava

Ranja: For me it throws 404 error in postman, but no hanging.
In Browser it redirects to the index.html, but no hanging.

@MaxIhme

select() is a system call that allows you to monitor multiple file descriptors, typically used for managing I/O operations on sockets. It works by creating sets of file descriptors you want to monitor using the fd_set data structure.

You set up three fd_set structures: one for the file descriptors you want to read from, one for those you want to write to, and one for exceptions. These sets are manipulated using functions like FD_SET(), FD_CLR(), and FD_ZERO() to add, remove, or clear file descriptors.

You pass these sets, along with a timeout value, to the select() function. select() will block until one or more file descriptors in the sets become ready, or until the timeout expires. Once select() returns, you can check which file descriptors are ready and perform the corresponding I/O operations without blocking the entire program.

Went through all our .html files in "www" folder (without the config file).

@MaxIhme

Tested with Web Developer mode in Mozilla Firefox for:
http://localhost:8000/animal.jpg
http://localhost:8000/upload.html
http://localhost:8000/index.html and sending "Hi" and "Hiii"

@MaxIhme

Tested with: valgrind --leak-check=full --show-leak-kinds=all ./webserv

simple Test with: http://localhost:8000/cgi-bin/script-get-2.py (same results with other tests)

LEAK SUMMARY:
==4819== definitely lost: 0 bytes in 0 blocks
==4819== indirectly lost: 0 bytes in 0 blocks
==4819== possibly lost: 0 bytes in 0 blocks
==4819== still reachable: 24,759 bytes in 377 blocks
==4819== suppressed: 0 bytes in 0 blocks
==4819==
==4819== For lists of detected and suppressed errors, rerun with: -s
==4819== ERROR SUMMARY: 3 errors from 2 contexts (suppressed: 0 from 0)

Problem: Terminal does not show the first error anymore. It looks like that the leaks (or some of them) are in the Config Class. Maybe in a vector there.

functionality works but when I change the config and restart, gives segfault.

tried with http://localhost:8000/cgi-bi.gh comes 404 - works as expected

change config to:
server
{
error404 error/error500.html;
}

and with the same url error 500 comes - works as expected

BUT SEGFAULT:
"READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

tried again, no segfault. And then server was still running, klick on reload. Now hangs forever but gets every second a new PID -> new process???

restarted webserve. error 500 comes as expected. I can reload the page 4 times and all works.

change config to:
server
{
#error404 error/error404.html;
}

default error page will be shown as expected. but again a segfault:
"mbp:simplified-serv maxrehberg$ make e
./webserv conf/webserve_.conf
Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
Start Listening...
Start Listening...
Finished creating the ports:
Listening Socket onject for Port: 8000fd: 3 succesfully created!
Listening Socket onject for Port: 8080fd: 4 succesfully created!
Listening Socket onject for Port: 8090fd: 5 succesfully created!
ERROR: poll() has timed out: : No such file or directory
ACCEPT CONNECTION => 3DONE

READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

restart webserve. everything works. can load the page several times, all good.

change the config again to:

server
{
error404 error/error500.html;
}
-> error page correct in the browser, and again segfault:

"mbp:simplified-serv maxrehberg$ make e
./webserv conf/webserve_.conf
Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
Start Listening...
Start Listening...
Finished creating the ports:
Listening Socket onject for Port: 8000fd: 3 succesfully created!
Listening Socket onject for Port: 8080fd: 4 succesfully created!
Listening Socket onject for Port: 8090fd: 5 succesfully created!
ERROR: poll() has timed out: : No such file or directory
ACCEPT CONNECTION => 3DONE

READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

@MaxIhme

tried with http://localhost:8000/cgi-bi.gh comes 404 - works as expected

change config to:
server
{
error404 error/error500.html;
}

and with the same url error 500 comes - works as expected

BUT SEGFAULT:
"READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

tried again, no segfault. And then server was still running, klick on reload. Now hangs forever but gets every second a new PID -> new process???

restarted webserve. error 500 comes as expected. I can reload the page 4 times and all works.

change config to:
server
{
#error404 error/error404.html;
}

default error page will be shown as expected. but again a segfault:
"mbp:simplified-serv maxrehberg$ make e
./webserv conf/webserve_.conf
Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
Start Listening...
Start Listening...
Finished creating the ports:
Listening Socket onject for Port: 8000fd: 3 succesfully created!
Listening Socket onject for Port: 8080fd: 4 succesfully created!
Listening Socket onject for Port: 8090fd: 5 succesfully created!
ERROR: poll() has timed out: : No such file or directory
ACCEPT CONNECTION => 3DONE

READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

restart webserve. everything works. can load the page several times, all good.

change the config again to:

server
{
error404 error/error500.html;
}
-> error page correct in the browser, and again segfault:

"mbp:simplified-serv maxrehberg$ make e
./webserv conf/webserve_.conf
Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
Start Listening...
Start Listening...
Finished creating the ports:
Listening Socket onject for Port: 8000fd: 3 succesfully created!
Listening Socket onject for Port: 8080fd: 4 succesfully created!
Listening Socket onject for Port: 8090fd: 5 succesfully created!
ERROR: poll() has timed out: : No such file or directory
ACCEPT CONNECTION => 3DONE

READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

We use Poll() function to monitor multiple file descriptors.

@MaxIhme

For me it worked fine.

Tested with: http://localhost:8000/diversion.html

Looks good to me:

Tested GET and POST successfully (with http://localhost:8000/upload.html; without and with config file), but not DELETE.

Tested with:
http://localhost:8000/cgi-bin/script-infinite-loop.py

Only tested with a script that contains an infinite loop, not an error.

I could open two different Scripts. Tested with: localhost:8000/cgi-bin/script-get-2.py and with localhost:8000/cgi-bin/script-post-2.py

Tested with:
http://localhost:8000/animo.jpg
http://localhost:8000/animo.html
http://localhost:8000/cgi-bin/script-get-3.py

Connected with:
http://localhost:8000/animal.jpg
http://localhost:8000/upload.html --> file saved in www
http://localhost:8000/index.html
localhost:8000/cgi-bin/script-get-2.py

There is recv and send

started webserve from 2 different terminals. The second one says: (looks good for me)

"mbp:simplified-serv maxrehberg$ make e
./webserv conf/webserve.conf
Information: cannot open your config file. Will take default Config.
TestServer constructor called!
Start Listening...
bind failed... : Address already in use
make: *** [e] Error 1"

The browser does not list the content of a directory.

Tested with: localhost:8000/www

Max:
our root directory is www/
config:
...
root /www;
...

thats why when you want: localhost:8000/www it want's you to give ...webserve/simplified-serv/www/www and not ...webserve/simplified-serv/www/

to list www/ you have to turn autoindex on; and no index argument for that location. location / means in browser localhost:8000/ and locally ...webserve/simplified-serv/www/
config:
location /
{
allowed_Methods GET POST;
#index index.html;
autoindex on;
}
then go to localhost:8000/ in browser

We use only one Poll we monitor the sockets that are made specifically for accepting the incoming connections and then we accept the connection.

Retested with: siege -b http://localhost:8000/email.html
What do they mean by "simple GET on an empty page"? Maybe we should make the html more simple?

siege -b http://localhost:8000/listing_Kopie.html --> Failed transactions shown by siege, but Server did not crash and availability over 99.5%

@MaxIhme

limit the downloadabe filesize to 500 MB. Update: is done returns 413, Payload to large
http://localhost:8000/debia.iso

it's some time at "preparing response"

and the memory of webserve goes up and down (up to 12 GB in Ram)

when the download is starting the server says 408 takes to long and in the browser the download is aborted

EDIT: No Problem anymore

config:
server
{
listen 8000 8080 8010;
...
}
server
{
listen 8090 ;
....
}

open http://localhost:8000/ -> works fine
open http://localhost:8090/ -> throws either bad alloc or segfault: (I tested several times, and it seems to work with different servers with different ports, the errors happen occasionally)

"HEADER: GET / HTTP/1.1
Host: localhost:8090
Connection: keep-alive
sec-ch-ua: "Google Chrome";v="119", "Chromium";v="119", "Not?A_Brand";v="24"
sec-ch-ua-mobile: ?0
sec-ch-ua-platform: "macOS"
Upgrade-Insecure-Requests: 1
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/119.0.0.0 Safari/537.36
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,image/apng,/;q=0.8,application/signed-exchange;v=b3;q=0.7
Sec-Fetch-Site: none
Sec-Fetch-Mode: navigate
Sec-Fetch-User: ?1
Sec-Fetch-Dest: document
Accept-Encoding: gzip, deflate, br
Accept-Language: de-DE,de;q=0.9,en-US;q=0.8,en;q=0.7
NOTHING 0
ACCEPT CONNECTION => 8DONE

WRITING back to the socket: 9 fd: 9 error:0
WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 9 was closed successfuly
File deleted successfully: tmp/tmp_file_9
make: *** [Makefile:85: e] Segmentation fault
➜ simplified-serv git:(main) ✗ "

and another time this message comes:

"WRITING back to the socket: 10 fd: 10 error:0
WRITING back to the socket: 10 fd: 10 error:0
WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 10 was closed successfuly
File deleted successfully: tmp/tmp_file_10
ACCEPT CONNECTION => 8DONE

ACCEPT CONNECTION => 6DONE

terminate called after throwing an instance of 'std::bad_alloc'
what(): std::bad_alloc
make: *** [Makefile:85: e] Aborted
➜ simplified-serv git:(test_dienstag) ✗ "

It monitors all the sockets no matter if they are POLLIN or POLLOUT

the function seems all good, but the server has problems.

config:
location /
{
index index.html;
allowed_Methods POST;
}

location /delete_dir
{
	allow_methods DELETE;
}

location /static_website
{
	allow_methods GET;
	index static.html;
}

http://localhost:8000/ -> error page 405 method not allowed -> correct

but Segfault:
"Listening Socket onject for Port: 8090fd: 5 succesfully created!
ERROR: poll() has timed out: : No such file or directory
ACCEPT CONNECTION => 3DONE

READING AND PARSING! [NOTHING]
TMP_METHOD: [GET]
CHOSEN METHOD: [GET]
PREPARING RESPONSE 1
PREPARING RESPONSE 2
CRAFTED GET RESPONSE STR
ACCEPT CONNECTION => 3DONE

WE HAVE FINISHED WRITING TO THE BROWSER
Client Socket: 6 was closed successfuly
File deleted successfully: tmp/tmp_file_6
make: *** [e] Segmentation fault: 11
mbp:simplified-serv maxrehberg$ "

restart try again, same segfault. restart try again, same segfault.

try: http://localhost:8000/static_website/
page loaded, pictures not, same segfault
restart try again, same segfault.

restart try again, all good, i can reload the page.
restart, browser hangs. debugging says it hangs at "int TestServer::checkPollAction(short revents, int fd)" second if (like in the screenshot).

Tested with:
http://localhost:8000/cgi-bin/script-get-2.py
and with
http://localhost:8000/index.html

Why is the script for "http://localhost:8000/cgi-bin/script-get-2.py" downloaded and not anymore on the browser screen? @MaxIhme @LukasKava

I ran the following without restarting the server:

siege -c 10 -t 1M http://localhost:8000/animal.jpg --> perfect

siege -c 10 -t 1M http://localhost:8000/upload.html --> perfect

siege -c 10 -t 1M http://localhost:8000/index.html --> perfect

siege -c 10 -t 1M http://localhost:8000/cgi-bin/script-post-2.py --> perfect

siege -b http://localhost:8000/listing_Kopie.html
when I run it short --> perfect
when I run it super long

With 27 transactions failed.