One Failing Integration Test about swift-nio HOT 6 CLOSED

@tiagomartinho the key here is maybe_nio_host='3(NXDOMAIN)' which means host was not able to correctly retrieve the host info which sometimes happens with VPN or proxies, i'll see if we can fail more clearly here

/cc @weissi

fwiw, all pull requests go through ci that runs these tests

from swift-nio.

@tomerd I'm not currently using a VPN or proxy, but maybe is a VPN configuration I have? Even if it's not currently active?

I also tried to run the integration test suite from Docker but I got:
FAILURE (oks: 3, failures: 14)
Is this expected?

Moreover I had 4 other questions:

• There is a particular reason not to use XCTest for the integration tests?
• Why the integration tests are not invoked with the command swift test?
• Why are the tests 12, 13, and 14 skipped?
• I didn't found the CI documented in the project, is it public or private?

from swift-nio.

I also tried to run the integration test suite from Docker but I got:

how did you try to run it? in any case the work i am doing towards #83 should help make this run in docker correctly

Moreover I had 4 other questions:

• There is a particular reason not to use XCTest for the integration tests?
• Why the integration tests are not invoked with the command swift test?
• Why are the tests 12, 13, and 14 skipped?
• I didn't found the CI documented in the project, is it public or private?

i'll let @weissi answer 1-3. our ci is private atm

from swift-nio.

@tiagomartinho Sorry for the late reply, I was on holiday the last week:

There is a particular reason not to use XCTest for the integration tests?

Yes: These tests are end-to-end tests so they make sure everything works in an actual binary without mocking anything. This can't be done using XCTest. That said, we obviously have XCTest tests too. Some of those tests also test assertions (ie. make sure the program crashes) or compile binaries in a special mode. Also they for example test that we're compatible with a 3rd party HTTP client like cURL.

Why the integration tests are not invoked with the command swift test?

Because they're slower (they're not unit tests) and I'd also argue it'd be odd to shell out to an external program through swift test

Why are the tests 12, 13, and 14 skipped?

• SKIP_test_13_http_pipelining.sh: fixed with #62
• SKIP_test_12_headers_too_large.sh & SKIP_test_14_strict_mode_assertion.sh: because I didn't get to them yet, apologies, I;ll file an issue against me to do that.

from swift-nio.

filed as #132

from swift-nio.

With #132 present I think we can close this.

from swift-nio.