[DX] Massive deprecations when upgrading to 10.5.18 and 10.5.20 about phpunit HOT 4 CLOSED

As of #5812 and since PHPUnit 10.5.18, PHPUnit 10.5 warns about tests that "only work by happenstance". These tests, that may already work incorrectly when run with PHPUnit 10.5, no longer work with PHPUnit 11 due to #4964.

PHPUnit 10.5.20 did not introduce any new deprecations, but I guess you are referring to #5819. This, too, is a warning about tests that, if at all, "only work by happenstance".

is there an option that would allow PHPUnit to report a zero status code when there's no failure/errors but only deprecations

What you ask for is the default behaviour. You need to explictly configure that deprecations lead to a non-zero exit code, for instance using the failOnDeprecation attribute in the XML configuration file.

from phpunit.

failOnDeprecation fixes the status code indeed. Is there a way to not report the thousands of deprecations at the end of each run too ?

Your answer and closing the issue right afterwards doesn't give me a feeling that you really care about the effort fixing these deprecations will require of the developers using your library. Maybe I misunderstand "happenstance", but if it means "by a happy coincidence", I beg to disagree : it worked because there never was any constraint on how data providers keys were to be named, and suddenly you've added such a constraint to fit the plans for the future version.

I'd be curious to hear of other developers if they had such impacts on their test suites, but closing the issue means no one will ever see it...

from phpunit.

@gnutix We've seen this too. While it's annoying, as it happened between minor versions, we're not really that worried.

Either:

• stick with 10.5.18, as PHPUnit 11 is already available
• remove all array keys from data providers
• update array keys to match the argument name

We've decided on half/half: removing array keys from data providers that weren't providing additional information, and for those with more complex structures (true/false/true/true), we've updated the array keys to match the argument names.

As for the 'happenstance', I wouldn't much call it that if it weren't for PHPUnit introducing support for named arguments somewhere along the way. PHPUnit doing->{$method}(...array_values($dataProviderData)) worked perfectly fine for many years

from phpunit.