Giter Club home page Giter Club logo

cypress-auto-stub-example's Introduction

cypress-auto-stub-example CI cypress version cypress-auto-stub-example

This is an example project to demonstrate how to automatically stub all API requests happened in your Cypress test and how to record/replay them.

We are available on Cypress Dashboard, go there to check the running results. (Registration required)

Problems to solve

1. E2E tests take a long time to run, they are too slow.

One concern of running E2E tests is that it takes long time to run, which makes sense because all your API calls are targeted to the real server. To resolve this issue, a single solution is to use mock API in your E2E tests. That's good, but here comes another question: you need to manually update your mocking data according to the API change regularly.

A better solution is:

  • Use real API response when you write E2E tests, and Record these responses and write them into files.
  • Use the recorded API response to run your tests in future.

This project demonstrates how to make this process more smoothly and automatically with Cypress.

2. E2E tests are too flaky, how many seconds do I need to wait?

Though Cypress already ships with a unique mechanism to automatically block your test and retry until your expectation meets, but sometimes you still need to explicitly wait for all network API calls to be finished. In this example we implement a new command called waitUntilAllAPIFinished to solve this problem. Thanks to Cypress's full network control ability, now it's easier to know how many network API calls are still pending, so that we can wait for them to be finished first before you do any assertion.

Try it

  • Clone this project.
  • Install all dependencies by running yarn install or npm install.
  • Build the website by running yarn build or npm run build.
  • Launch the website by running yarn serve or npm run serve.
  • Open Cypress byr running yarn cy:open, then run the test network.spec.ts: (the same mechanism as Jest snapshot testing)
    • If a snapshot file does not exist inside the fixture folder, tests will be running with the real API, and after all tests are passed, a snapshot file containing all API responses will be generated in the fixture folder.
    • If a snapshot file does exist inside the fixture folder, but fixture data for this test case does not exist (e.g. there is no key with the same name as the test case name existing inside that snapshot file), tests will be running with the real API, then the snapshot file will be updated with the recorded API responses.
    • If a snapshot file in the fixture folder already exists and has the mocking data for this test case, the test should run very fast, because all API responses are stubbed and use the snapshot file as responses.
  • If you want to update the snapshot file regardless of the existing fixture file existence, use yarn cy:open:record. When using this command, all tests will run against the real API, and all returned API responses will override the existing snapshot file if it exists.
  • You can also use yarn cy:run to run all Cypress tests in headless mode.

More details for demo Edit cypress-auto-stub-example

The website page we are testing in this project contains 3 examples for XHR and Fetch:

  • Example 1:
  • Example 2:
    • Click a button to call API (POST https://reqres.in/api/users) using Fetch. API response JSON will be displayed below after it returns.
    • To demonstrate Fetch can be supported here.
  • Example 3:
    • Click a button to call 30 sequential API (GET https://reqres.in/api/users/1 to https://reqres.in/api/users/10 for 3 times) using Fetch. API response JSON (userId: 10) will be displayed below after it returns. sequential here mean the 2nd API call will file only after the 1st API call returns.
    • To demonstrate the usage of a new custom command cy.waitUntilAllAPIFinished() which will make sure the testing is blocked until all API calls are finished.

It also includes 2 examples for GraphQL:

Currently when you use cy.route() to mock API response with fixtures, Cypress only match the URL and HTTP method you provided, for most of the cases, this is enough for mocking purpose. However, if you use libraries like GraphQL, all API requests are using the same URL with different request body, for this case, you need to mock different responses based on different request bodies, which is not possible before Cypress fixes #687. Note: Cypress's cy.intercept() introduced after v6 already has full support to monitor request body, but the follow solution is still handy and faster. A simple workaround is: use md5 or other hash library to hash your request body into a string, and put this string as a query parameter in your URL, like ?_md5=xxxx, now your URL contains the request body information: different request bodies result in different md5 hash string, thus you can rely on URL and HTTP method to do API mocking with request body in consideration.

  • Example 1:
    • Click a button to query all users (Query https://api.spacex.land/) using GraphQL query. API response JSON will be displayed below after it returns.
  • Example 2:
    • Click a button to insert a new user (Mutation https://api.spacex.land/) using GraphQL mutation. API response JSON will be displayed below after it returns.

More detail for implementation

Inspired by this article and Jest snapshot testing.

  • Check the main implementation in cypress/support/utils/auto-stub.ts

    1. use cy.intercept to monitor all API requests
    2. use cy.writeFile to write all recorded API responses in a fixture file
    3. while replaying, use cy.fixture to load API responses from the fixture file
  • Check the implementation for custom command cy.waitUntilAllAPIFinished in cypress/support/commands.ts

    1. maintain an internal counter for API calls: increase 1 when filing a new API request, decrease 1 when receiving a API response
    2. use Cypress's Automatic Retry Assertion to regularly check this counter, block the testing until it equals to 0
  • Check the custom URI configuration(adding ?md5=xxx) for GraphQL in src/App.js

There are 4 new configuration parameters introduced in this example:

All configuration parameters are defined under env as environment variables because:

  • It's easier for overriding by cypress open --env foo=bar
  • All existing configurations provided by Cypress are strongly typed, you can't add new configuration type when you use Typescript.
Parameter Type Description Required Default Value
forceAPIRecording boolean force enabling auto record (used to update api mocking data) false
apiHosts string (multiple host separated by ,) URL for API endpoint โœ…
stubAPIPatterns string (multiple pattern separated by ,, will be used in new RegExp(xxx)) API pattern needs to be stubbed โœ…
apiMaxWaitingTime number (in milliseconds) used by cy.waitUntilAllAPIFinished, the maximum time when we wait for all API requests to be finished 60000 (60s)

Note: apiHosts and stubAPIPatterns must be aligned with each others.

The generated recording file inside cypress/fixtures folder has the following format.

{
  "Test case name": {
    "timestamp": "2018-08-26T07:27:00.582Z",
    "records": [
      "url": "xxx",
      "method": "xxx",
      "request": {
        "body": {},
      },
      "response": {
        "body": {},
      },
      // this means which host/pattern this API matches
      "matchHostIndex": 0,
    ]
  }
}

cypress-auto-stub-example's People

Contributors

calvinballing avatar dependabot[bot] avatar jhays-nhaschools avatar pinkyjie avatar subtlegradient avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar

cypress-auto-stub-example's Issues

Adding license

Thank you for your example! Would you mind adding an open source license to this?

currentTest.fullTitle() always return same title

the full title it's always the same one. (save in file all under the first full title)
you can try to reproduce it by running more then one "it" statements in one spec

it's seems that you need to use for example:
const currentTestFullTitle = (Cypress as any).mocha.getRunner().suite.ctx.currentTest.fullTitle();
and not
(Cypress as any).mocha._mocha.suite.suites[0].tests[0].fullTitle();;
in test-info.ts file

Getting Errors While running cy.visit inside before

Hi,
Thank you for your example.

all my spec files run cy.visit("some url") inside before() hook.
but I notice that it's not record the api when i am using cy.visit() inside.

this is what i try to do:
ScreenShot354
the result:
ScreenShot355

how can i record the api that load inside before function?
do i need to remove all my cy.visit() from the before function?

Thanks,
[edit: added some images]

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.