Comments (5)
In my opinion, it would be better if seperate logging is made for each model.
Something like,
from torch.utils.tensorboard import SummaryWriter
writer = SummaryWriter(filename)
Different writer
for different model. Each model will have its own logging directory and
we can do tensorboard --log-dir root
to see and compare all the models.
I think we can have another writer
for monitoring loss for all the models...
But as the number of models gets large, it will be soon very crowded.
But you can filter some of the models.
from auto-pytorch.
@shukon I might not understand the situation here but I do not see any problem
because if the each training of NN starts and ends one summaryWriter
, is there really any requirement to pass the writer?
I think we can set the root directory and every model trained can saved to subdirectory with appropriate name which convealing main architecture 'resnet-100-20-30' or 'shapedmlpnet-diamond-...-...' and as the optimization goes, it could change to resnet-100-20-30-i01' '-i02' '-i03' etc
from auto-pytorch.
I agree and am currently thinking about other ways of logging (also because tb logs are very memory inefficient). Do you have any suggestions? If you want I could also point you to where the logs are performed and you could write a PR
from auto-pytorch.
Mh - I'm not sure whether ditching tensorboard in general makes sense 🤔 I think with pytorch and tensorflow using it, that makes it kind of a standard? I found where the logging is done and I will look into it. Do you know why logging would be memory-inefficient? Running the tensorboard-server surely is, but on the logging-side of it, shouldn't the logs just be written to the file regularly? I'll have a look but for now I'll be installing tensorboard_logger
from source in the dev-version, they provide an unconfigure()
-call :)
from auto-pytorch.
@maxmarketit Yes! Separate writers for separate models / training processes would be a good idea. I'm just not sure where to create and where to pass the writer in this pipeline...
from auto-pytorch.
Related Issues (20)
- [Time series Forecasting] Continuous Ranked Probablity Score (CRPS) loss for probablity network ouput type HOT 2
- Improve `include_components` documentation HOT 1
- Cannot run time-series example on GPU HOT 1
- Score function error on example code HOT 2
- Prediction on one sample produces error HOT 1
- The predict method of the base task expects to build a logger from a temporary folder
- [Feature request] time series classification HOT 2
- Question about how to maximize the search space HOT 1
- AutoPytorch selects only Dummy model. HOT 4
- Generate a leaderboard for each model?
- ImportError: cannot import name 'AutoNetClassification' from 'autoPyTorch' HOT 1
- I ran autopytrch 0.2 on multiple datasets every time it picks the Dummy model HOT 1
- Error in using command "from autoPyTorch.api.time_series_forecasting import TimeSeriesForecastingTask" HOT 2
- TypeError occurs when import TabularRegressionTask
- Image Classification: API not finished
- Can't install on Google Colab HOT 4
- Errors on running example_tabular_classification.py HOT 1
- Errors installing autoPyTorch HOT 1
- [ERROR] [Client-AutoPyTorch:RefitLogger:1] Prediction for lgb failed with run state StatusType.TIMEOUT.
- Multi-GPU support
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from auto-pytorch.