Comments (4)
Hi,
Any PR is welcome, bit v 0.9.13 supports it. Please test it
from apifuzzer.
Hi Peter,
thank you for looking into this and adding the numbers so fast. Elapsed time is now fine and evaluating progress over time and overall time works great.
The other thing is still not working as I would expect it to behave: it does not count the number of tests correctly:
<?xml version="1.0" ?>
<testsuites disabled="0" errors="0" failures="34" tests="34" time="5.8366954401135445">
<testsuite disabled="0" errors="0" failures="34" name="API Fuzzer" skipped="0" tests="34" time="5.8366954401135445" timestamp="1646639974.3845608">
[...]
<testcase name="60" time="0.176842" timestamp="1646639968.669649" status="failed">
<failure type="failure" message="{"status": "failed", "name": [{"Authorization": "***redacted***"}], "sub_reports": [], "test_number": 60, "state": "COMPLETED", "request_url": "https://***redacted***/contacts/count?updated_after=' or '1'='1", "request_method": "GET", "request_headers": "{\"User-Agent\": \"APIFuzzer 0.9.13\", \"Accept-Encoding\": \"gzip, deflate\", \"Accept\": \"*/*\", \"Connection\": \"keep-alive\", \"Authorization\": \"***redacted***\"}", "request_body": {}, "response": "", "parsed_status_code": 505, "reason": "failed"}"/>
</testcase>
<testcase name="88" time="0.167752" timestamp="1646639973.8767242" status="failed">
<failure type="failure" message="{"status": "failed", "name": [{"Authorization": "***redacted***"}], "sub_reports": [], "test_number": 88, "state": "COMPLETED", "request_url": "https://***redacted***/contacts/count?updated_after=%u0000", "request_method": "GET", "request_headers": "{\"User-Agent\": \"APIFuzzer 0.9.13\", \"Accept-Encoding\": \"gzip, deflate\", \"Accept\": \"*/*\", \"Connection\": \"keep-alive\", \"Authorization\": \"***redacted***\"}", "request_body": {}, "response": "", "parsed_status_code": 500, "reason": "failed"}"/>
</testcase>
</testsuite>
</testsuites>
It still tells me: tests="34"
However, as not all tests failed (see last test case that failed has 88 as test ID) I would expect that the report looks more like: failures="34" name="API Fuzzer" skipped="0" tests="88"
(same in testsuites report)
from apifuzzer.
Hi,
Sorry I missed your message.
This would require adding a test even it passed. We had projects where we had millions of cases for a long and complicated API. I think it is better to have smaller amount of test cases listed which requires attention than having lot of them which doesn't require attention furthermore may cause issue in the system which consumes it.
An additional config parameter could be introduced for that, however the configuration is starting to be a bit complicated already
If you consider this, are you still on the side of generate test for passing cases?
from apifuzzer.
I understand your point and I am pretty fine with leaving out failed tests from the error report but my expectation was in fact to have a statistic there how many tests passed, how many failed, etc.
So maybe there is a possibility to remember the total amount without placing them in the data model as results?
from apifuzzer.
Related Issues (20)
- Invalid JSON-Data Value HOT 4
- Field with the name (v1+themes|post|inherited) already exists in this container HOT 5
- Missing response, parsed_status_code and request_body are in reports HOT 7
- field with the name (....) already exists in this container HOT 4
- Questions HOT 1
- Copy/paste error in compile_base_url()
- Unexpected exception happened during fuzz test preparation: 'schemes' HOT 2
- --version not valid HOT 2
- APIFuzzer does not parse $ref in /paths HOT 6
- Path items with no variables prevent the fuzzer from running HOT 1
- Parameters on "Path Item" level is not getting accepted HOT 4
- Unexpected exception happened during fuzz test preparation: sequence item 0: expected str instance, list found.
- Report filenames start with -1 HOT 3
- Unexpected exception happened during fuzz test preparation HOT 1
- Payload generation from response data HOT 2
- APIFuzzer is failing for the CI integration HOT 4
- Space char at the headers argument HOT 4
- Api HOT 1
- Exception for max_length(0) < 0 for boolean fuzzer HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from apifuzzer.