Comments (2)
Thinking forward to a world where we have a robust system for collecting AT responses, we might trust the data reported by that system as the one-and-only source of AT responses.
That will be lovely, although I imagine it will take some time and experience to get there. First, we need to have people verifying that the system-recorded response is accurate. I assume we will eventually get to a high level of trust as the automated systems mature.
Then, we would still likely want more than one person to assign verdicts.
Definitely
Even before we have an automated system, though, this capability may be desirable. Will we ever want different levels of corroboration for the two steps in running a test? For example, would we ever want to require two people to collect equivalent AT responses while requiring three people to assign equivalent verdicts?
This could be extremely useful! I can imagine taking advantage of app support for a scenario like:
- Assign two people to run a plan
- Responses are all good but there are concerns that we want a broader set of views on how to interpret some of the tests.
- Assign additional people to go through the plan and only assign verdicts to the previously collected responses.
It would be a lot easier to get the additional people for step 3 if those people didn't have to record responses.
We have manual ways of working around this now. In the near term, it is more important that we have a way to see the report from a draft plan without publishing it to the reports page or candidate review page. If we had that, a third reviewer could just review the report and raise issues where there are concerns. This use case comes up in the working mode scenario analysis.
from aria-at.
Thanks, @mcking65! There are two places in the Working Mode where Testers are assigned to Test Plans, so I'm wondering where that scenario applies. Do you envision it occurring before a "Draft" Test Plan advances to the "Candidate" phase? Is it something that might happen when reporting on "Recommended" Test Plans?
from aria-at.
Related Issues (20)
- Feedback: "Open a menu in reading mode" (Navigation Menu Button, Test 10) HOT 1
- Inconsistent announcement of W3C Quick Links Menu "Open a menu in interaction mode" (Navigation Menu Button, Test 11) HOT 1
- Feedback: "Open a menu in interaction mode" (Navigation Menu Button, Test 11) HOT 1
- Plan changing assertion verdicts to PASS/FAIL from GOOD/NO/INCORRECT output
- Feedback: "Navigate forwards to an expanded disclosure button in reading mode" (Disclosure Navigation Menu Example, Test 7)
- Feedback: "Navigate forwards to an expanded disclosure button in reading mode" (Disclosure Navigation Menu Example, Test 7)
- Initial Mode Switching Exploration HOT 2
- JAWS Feedback: "Check a radio button in interaction mode" (Radio Group Example Using aria-activedescendant, Test 26, 10-04-2023)
- Strategy for prioritising the next set of test cases HOT 3
- Feedback: "Navigate forwards to a slider in reading mode" (Color Viewer Slider, Test 1) HOT 1
- Change results collection form to support pass/fail assertion verdicts HOT 4
- Change assertion verdict strings rendered in test results tables HOT 1
- Support reporting that an AT did not respond to a command HOT 2
- Design V2 of test format to enable variable AT setting, command, and assertion mappings for a test HOT 24
- Design replacement for keys.mjs that replaces explicit definition of key commands to a more dynamic model HOT 6
- Update test builder to support V2 of test format HOT 4
- V2 format test plan example review HOT 2
- Feedback: "Read information about a menu item" (Action Menu Button Example Using aria-activedescendant, Test 16)
- Feedback: "Activate a menu item" (Action Menu Button Example Using aria-activedescendant, Test 24)
- Feedback: "Read information about a menu item" (Action Menu Button Example Using aria-activedescendant, Test 16)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from aria-at.