Comments (4)
Would that break the perception of a linear flow of a notebook run by papermill?
I guess this kind of leads towards a desire to stitch notebooks together in parts rather than always having the whole document. It's useful to have them together when authoring, when run as a job though you want a limited view I suppose?
from papermill.
What about supporting something like papermill step1.ipynb step2.ipynb outputs/
which then generates outputs/combined.ipynb
? I'd rather compose notebooks on the command line than have annotations on cells to run/not run them.
One thing that is a bit clunky is passing complex objects (like fitted sklearn
estimators) from notebook to notebook.
from papermill.
Has this feature been implemented? It'd be useful for debugging and/or Demo-ing a portion of the script at the end of the notebook, along with discussing design choices, sample data, analysis etc. When run on real data, the demo will be skipped. Right now I'm commenting the demo out and have to undo everytime I want to debug/show demo. Is it recommended that we keep 2 separate notebooks in this case? Keeping them up to date/coupled with each other can be a nuisance.
from papermill.
No, overall I think it's in the realm of potentially nice but complex. We've been leaning to keeping the repo simple over convenience features. One way you can control this today is to gate your demo cell with an if demo:
wrapper and then set that in papermill -p demo on
or at the top of the notebook when you want the demo activated.
I think I'm going to close this issue based on the trade-off discussions we've had in the past on related topics. If notebook format adopts a skip flag then we'll reopen this issue and address matching compatibility with other interfaces.
from papermill.
Related Issues (20)
- Metadata of parameters cell not copied (`{'slideshow': {'slide_type': 'skip'}`)
- Enhance the progress bar to display customizable message HOT 1
- AttributeError: kernelspec HOT 3
- Latest release not installable from sdist HOT 1
- Do an audit of requirements files, pyproject.toml, ci config, tox HOT 5
- Stale repo action HOT 3
- Kernel not found with venvs (jupyter_client.kernelspec.NoSuchKernel) HOT 2
- Does tqdm print properly with --log-output? HOT 1
- nbformat 5.1.2 and 5.1.3 cause AttributeError: 'NoneType' object has no attribute 'cells'
- Parameter parsing fails for strings containing `=` character HOT 2
- Pandas style has no effect HOT 3
- RuntimeError: Kernel didn't respond in 60 seconds HOT 2
- Make the parameters of progress_bar specifiable by a dictionary
- pip install --no-binary gives "No such file or directory" error
- Cell that starts with %%time does not report errors HOT 2
- PapermillNotebookClient deprecation warning: unrecognized argument input_path HOT 1
- Tuple in the config dictionary changed to string when run a python notebook with papermill HOT 1
- New Release HOT 7
- Missing Notebook linked in docs
- Add the output notebook object to PapermillExecutionError
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from papermill.