Giter Club home page Giter Club logo

Comments (4)

KissPeter avatar KissPeter commented on June 20, 2024

Hi,
Any PR is welcome, bit v 0.9.13 supports it. Please test it

from apifuzzer.

mbeckerle-xqueue avatar mbeckerle-xqueue commented on June 20, 2024

Hi Peter,

thank you for looking into this and adding the numbers so fast. Elapsed time is now fine and evaluating progress over time and overall time works great.

The other thing is still not working as I would expect it to behave: it does not count the number of tests correctly:

<?xml version="1.0" ?>
<testsuites disabled="0" errors="0" failures="34" tests="34" time="5.8366954401135445">
	<testsuite disabled="0" errors="0" failures="34" name="API Fuzzer" skipped="0" tests="34" time="5.8366954401135445" timestamp="1646639974.3845608">
		[...]
		<testcase name="60" time="0.176842" timestamp="1646639968.669649" status="failed">
			<failure type="failure" message="{&quot;status&quot;: &quot;failed&quot;, &quot;name&quot;: [{&quot;Authorization&quot;: &quot;***redacted***&quot;}], &quot;sub_reports&quot;: [], &quot;test_number&quot;: 60, &quot;state&quot;: &quot;COMPLETED&quot;, &quot;request_url&quot;: &quot;https://***redacted***/contacts/count?updated_after=' or '1'='1&quot;, &quot;request_method&quot;: &quot;GET&quot;, &quot;request_headers&quot;: &quot;{\&quot;User-Agent\&quot;: \&quot;APIFuzzer 0.9.13\&quot;, \&quot;Accept-Encoding\&quot;: \&quot;gzip, deflate\&quot;, \&quot;Accept\&quot;: \&quot;*/*\&quot;, \&quot;Connection\&quot;: \&quot;keep-alive\&quot;, \&quot;Authorization\&quot;: \&quot;***redacted***\&quot;}&quot;, &quot;request_body&quot;: {}, &quot;response&quot;: &quot;&quot;, &quot;parsed_status_code&quot;: 505, &quot;reason&quot;: &quot;failed&quot;}"/>
		</testcase>
		<testcase name="88" time="0.167752" timestamp="1646639973.8767242" status="failed">
			<failure type="failure" message="{&quot;status&quot;: &quot;failed&quot;, &quot;name&quot;: [{&quot;Authorization&quot;: &quot;***redacted***&quot;}], &quot;sub_reports&quot;: [], &quot;test_number&quot;: 88, &quot;state&quot;: &quot;COMPLETED&quot;, &quot;request_url&quot;: &quot;https://***redacted***/contacts/count?updated_after=%u0000&quot;, &quot;request_method&quot;: &quot;GET&quot;, &quot;request_headers&quot;: &quot;{\&quot;User-Agent\&quot;: \&quot;APIFuzzer 0.9.13\&quot;, \&quot;Accept-Encoding\&quot;: \&quot;gzip, deflate\&quot;, \&quot;Accept\&quot;: \&quot;*/*\&quot;, \&quot;Connection\&quot;: \&quot;keep-alive\&quot;, \&quot;Authorization\&quot;: \&quot;***redacted***\&quot;}&quot;, &quot;request_body&quot;: {}, &quot;response&quot;: &quot;&quot;, &quot;parsed_status_code&quot;: 500, &quot;reason&quot;: &quot;failed&quot;}"/>
		</testcase>
	</testsuite>
</testsuites>

It still tells me: tests="34"
However, as not all tests failed (see last test case that failed has 88 as test ID) I would expect that the report looks more like: failures="34" name="API Fuzzer" skipped="0" tests="88" (same in testsuites report)

from apifuzzer.

KissPeter avatar KissPeter commented on June 20, 2024

Hi,
Sorry I missed your message.
This would require adding a test even it passed. We had projects where we had millions of cases for a long and complicated API. I think it is better to have smaller amount of test cases listed which requires attention than having lot of them which doesn't require attention furthermore may cause issue in the system which consumes it.
An additional config parameter could be introduced for that, however the configuration is starting to be a bit complicated already
If you consider this, are you still on the side of generate test for passing cases?

from apifuzzer.

mbeckerle-xqueue avatar mbeckerle-xqueue commented on June 20, 2024

I understand your point and I am pretty fine with leaving out failed tests from the error report but my expectation was in fact to have a statistic there how many tests passed, how many failed, etc.

So maybe there is a possibility to remember the total amount without placing them in the data model as results?

from apifuzzer.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.