Comments (5)
There is a way to use Gradescope's debug via SSH (or otter grade
or otter run
) to do this. If you set "debug": true
in the otter_config.json
file in the autograder configuration zip file, this will tell otter to stop executing when it reaches an error and raise the error. To use this with Gradescope's debug via SSH feature (so you don't have to rebuild the grading image), you can just add this key to /autograder/source/otter_config.json
and then run the run_autograder
script. I don't think this is documented clearly anywhere, so I'll leave this issue open to track adding these steps to the documentation.
N.B. to do a similar thing with otter grade
, you can create a docker container using the grading image it created for you (the value of the -n
flag is the tag name, so otter-grade -n hw01
creates an image called otter-grade:hw01
) with docker run -it otter-grade:hw01 bash
. Then copy a submission into the container with docker cp subm.ipynb <container id>:/autograder/submission/subm.ipynb
. Then in the bash prompt opened by the first command you can recreate the steps above as if you were SSHed into the Gradescope container.
from otter-grader.
this section describes the assignment names but doesn't actually mention that this is the -n
flag, which is a pretty large oversight.
from otter-grader.
If you could kindly add to the documentation instructions for actually running the tests once you've logged in (you do "run_autograder" in that folder to run the autograder...) Seems stupid, but when you login there are multiple run files, that all kinda do the same thing, but it's confusing.
Is it true that if I set "show_stdout" to true, then this would have solved my problem (i.e., it would show the results of the JN calculation before the tests are run)?
from otter-grader.
If you could kindly add to the documentation instructions for actually running the tests once you've logged in (you do "run_autograder" in that folder to run the autograder...) Seems stupid, but when you login there are multiple run files, that all kinda do the same thing, but it's confusing.
will do
Is it true that if I set "show_stdout" to true, then this would have solved my problem (i.e., it would show the results of the JN calculation before the tests are run)?
No. show_stdout
controls whether students are shown the autograder stdout when grades are published; instructors can always seen the autograder stdout. To debug this without using debug via SSH, you would've needed to set debug
in the otter_config.json
in the autograder zip file, reupload it to Gradescope and rebuild the image, and then rerun the autograder on the submission. (You would've also had to upload the old zip file after debugging to ensure that other submissions didn't run with the debug
flag enabled.)
from otter-grader.
#759 adds a debugging guide to the docs
from otter-grader.
Related Issues (20)
- Add metadata to last solution cell to run hidden test cases if question has no public tests
- Add manually graded questions within the same gradescope assignment HOT 1
- Add Points Per Question and Total Points to final_grades.csv HOT 2
- Trying to implement a different container engine other than Docker, questions about image build HOT 1
- Otter-grader problems with juno app on ios HOT 4
- Cannot run grade HOT 4
- Incorrerct Grade HOT 11
- Plugins and submission_metadata HOT 4
- Otter Grade and Notebook Timeout
- Otter Grade: Write out Individual Results as well as final_grades.csv HOT 2
- Add support for Quarto assignments in R HOT 2
- Problem with variable name in test HOT 1
- Add option to get results pickle file to otter run
- R image build requires mamba gcc_linux-64 and gxx_linux-64 HOT 5
- module pkg_resources missing when you install otter-grader in a venv environment for Python 3.12+ HOT 1
- Getting two errors running otter assign HOT 1
- Otter Grade: Progress Queue HOT 2
- Otter Grade: AttributeError: 'GradingResults' object has no attribute '_catastrophic_error' HOT 5
- Make test functions get access to global variables HOT 4
- Can student manipulate the student version of the file to pass public test on student notebook? HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from otter-grader.