qutecoacoustics / interaction-experiments Goto Github PK

@Allcharles noticed the other day you can't click or drag seek within the first 30 minutes of the audio file.

We suspect it's a bug in MediaElement.js because we reproduced it cross-browser.

We also need to test if the problem happens in the native HTML5 audio element - I suspect it does not.

Update mediaelement player to 4.2.10.

This version has the official solution to issue #2. Link for download

Search task (3 screens) only

• if the user attempts to continue to the next screen without having first boxed three things they are stopped from progressing with a warning "Box three sounds before continuing"

keep as visual feedback but lose the ability to use it to skip pages

• fix experiment menu at experiments/
• cleanup experiment template (hide title, text, move dates to bottom)
• neaten ethics (left-align, semantics, etc)
• larger default font size
• help @KellieVella implement the survey
  • either as a series of timeline steps
  • or as another plugin that can load an HTML page (like the one already implemented), and store the result of the form in data. Example implementation:
    • https://github.com/jspsych/jsPsych/blob/40d50e89a20bd0b0677be4d64999fac9b429690a/plugins/jspsych-survey-html-form.js
    • a better option, this one lets us keep the form in markdown: https://github.com/jspsych/jsPsych/blob/40d50e89a20bd0b0677be4d64999fac9b429690a/plugins/jspsych-survey-html-form.js
• for the annotate-image-audio image plugin
  • remove the volume UI from the media player
  • remove the <table> layout from the annotate-image-audio plugin
  • fix other layout issues in annotate-image-audio plugin
  • in data add a section for removed annotations
  • remove annotorious Click and Drag to Annotate UI prompt
  • add "externalHtmlPerhamble" option to insert instructions above annotation area
  • annotorious canvas should scale with image resize
  • annotorious bug where sometimes the canvas width and height is 0
  • annotorious bug "cannot read property 'style' of null" - might be the same as above, prevents drawing
  • high priority: add axes around image (d3 axes plugin should work well)
  • high priority: plugin needs to unbind event handler after trial (or a closure is inappropriately captured). It seems annotations are added to the data from every previous use of the plugin.
• track extra metadata during the experiment
  1. time spent listening to audio
  2. media-interaction log (even type {play, pause, seek}, time index, timestamp)
  3. click map (element id, x, y, timestamp)
  4. Ensure interaction data is exported jsPsych.data.getInteractionData()
• setup submit lambda (talk to @atruskie)
  • generate unique id for data (jsPsych.randomization.randomID(length)
  • support multiple submit of data (minimum: after experimental task, and at end; optional: also after IMI survey)
• figure out why css isn't updating/being cached
• make magic happen i.e. draw all preamble text from one md file (Tutorial)
• annotate field slips behind the audio bar when low on the visualisation and blocks entering 'save' or 'cancel' button - possible fix: put the annotation field above the box
• need to validate form inputs (where appropriate)
• upload audio
• add "width-only" option that locks annotations vertical bounds to top and bottom
• disable continue button until tutorial instructions looked at
• make audio bar lock to image and align times (playing and dragging changes the starting point & resizing the screen smaller or larger changes the end point)
• check production submit
• add a vertical line that tracks with the audio button
• make compatible with range of browsers (after pilot)
• get likert scales that appear at end of experiment (randomSurveys) same width as the likert scales that appear earlier
• low priority: dropdown option instead of textual tagging
  Updated with new additional tasks