alexandermoskovkin / qunit-harness Goto Github PK

If you set the attempts parameter QUnit will restart the test if it's failed

(see DevExpress/testcafe-hammerhead#128 (comment))

Sometimes wd raises an error when we try to eval some js-script in the browser:
https://github.com/AlexanderMoskovkin/qunit-harness/blob/master/src/saucelabs/job.js#L60

We can't get access to window.global_test_results in Firefox 47 while getting test results. Problem remains, if we try to replace window with document.

DevExpress/testcafe-hammerhead#639 (comment)
We need an ability for setting options like 'platformName', 'platformVersion' etc.

We have a tests what load content from remote sources.
Because of this any tests sometimes are failed.
To fix it we need to rerun fixture that contains failed tests.

Also we need a way to mark fixture which we will rerun.

see DevExpress/testcafe-hammerhead#132 (comment)

This leads to the problem with the Travis-ci service integration. If Travis don't get any messages in console for 10 minutes task failed as suspended.

https://github.com/AlexanderMoskovkin/qunit-harness/blob/master/src/saucelabs/job.js#L138

https://travis-ci.org/testcafe-build-bot/testcafe-hammerhead/jobs/107207753

Tasks can get stuck on 'queued' state, while free machines are available at that moment. This can continue untill the TravisCI will close a job on timeout
Example: https://travis-ci.org/testcafe-build-bot/testcafe/jobs/128272495#L1233

DevExpress/testcafe-hammerhead#137

Sometimes wd doesn't open the required page in the browser when we call the command

It needs for the following scenario:

asyncTest('valid resource type for iframe.contentWindow.location must be calculated', function () {
        var iframe = document.createElement('iframe');

        iframe.id = 'testT260697';

        var loadHandler = function () {
            iframe.removeEventListener('load', loadHandler);

            iframe.addEventListener('load', function () {
                strictEqual(urlUtils.parseProxyUrl(iframe.contentWindow.location).resourceType, 'iframe');
                iframe.parentNode.removeChild(iframe);
                start();
            });

            eval(processScript('iframe.contentWindow.location = "/test.html";'));
        };

        iframe.addEventListener('load', loadHandler);
        document.body.appendChild(iframe);
    });

https://travis-ci.org/testcafe-build-bot/testcafe-hammerhead/jobs/158674225#L1125

https://saucelabs.com/tests/91f7c38832c948d6ac24d4e1db33ea9c
https://saucelabs.com/tests/e11472021d8b4fdcbd4d2fcc2e837a7e

Reproduced here: https://travis-ci.org/testcafe-build-bot/testcafe/jobs/104082797

DevExpress/testcafe-hammerhead#136 (comment)

Saucelabs often can't open a required virtual machine from the first attempt (especially iOS and Android emulators). As a result test runs take a long time.
We've found the wd module contains internal stuff to improve this. For example it restarts mobile simulators without the virtual machine restarting. We've not found the way to implement this via saucelabs rest API so we've decided to use the wd module.

https://github.com/AlexanderMoskovkin/qunit-harness/blob/master/src/saucelabs/job.js#L121