rewonc / pastalog Goto Github PK
View Code? Open in Web Editor NEWSimple, realtime visualization of neural network training performance.
License: MIT License
Simple, realtime visualization of neural network training performance.
License: MIT License
Hi, I am installing the package locally (python 2.7) with
pip install --user pastalog
i directly execute the pastalog script at ~/.local/bin/pastalog --install
which works fine
when starting the server with pastalog --serve 8120
I get:
npm ERR! Error: ENOENT, open '/media/p***/.local/lib/python2.7/site-packages/pastalog/node_modules/--port/package.json'
npm ERR! If you need help, you may report this log at:
npm ERR! http://github.com/isaacs/npm/issues
npm ERR! or email it to:
npm ERR! [email protected]
npm ERR! System Linux 4.2.6-300.fc23.x86_64
npm ERR! command "node" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! cwd /media/p**/.local/lib/python2.7/site-packages/pastalog
npm ERR! node -v v0.10.36
npm ERR! npm -v 1.3.6
npm ERR! path /media/p**/.local/lib/python2.7/site-packages/pastalog/node_modules/--port/package.json
npm ERR! code ENOENT
npm ERR! errno 34
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /media/p***/.local/lib/python2.7/site-packages/pastalog/npm-debug.log
npm ERR! not ok code 0
I could fix this error by changing how subprocess is created, namely from:
subprocess.call(["npm", "start", "--", "--port", str(args.serve)])
to
subprocess.call(["npm", "start", "--port"+ str(args.serve)])
after this change the server starts up fine, however when I start logging I get
pastalog --serve 8120
[email protected] start /media/p****/.local/lib/python2.7/site-packages/pastalog
node build/server.js
pastalog server listening on port: 8120
/media/p****/.local/lib/python2.7/site-packages/pastalog/build/server.js:7207
throw renameError;
^
Error: ENOENT, rename 'database.json'
npm ERR! weird error 8
npm ERR! not ok code 0
Salam
In deep learning sometimes the loss diverges to infinity which results in loss becoming nan.
This results in an exception in the python code:
HTTPError: 400 Client Error: Bad Request for url: http://localhost:8100/data
Also the error in the node server:
SyntaxError: Unexpected token N
at Object.parse (native)
at parse (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/body-parser/lib/types/json.js:88:17)
at /home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/body-parser/lib/read.js:116:18
at invokeCallback (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:262:16)
at done (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:251:7)
at IncomingMessage.onEnd (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:308:7)
at emitNone (events.js:80:13)
at IncomingMessage.emit (events.js:179:7)
at endReadableNT (_stream_readable.js:913:12)
at _combinedTickCallback (internal/process/next_tick.js:74:11)
at process._tickCallback (internal/process/next_tick.js:98:9)
I'm trying to build the latest version of the code (pypi package works fine) and getting the following error:
$ npm run build
> [email protected] build /Volumes/data/projects/pastalog
> webpack
[BABEL] Note: The code generator has deoptimised the styling of "/Volumes/data/projects/pastalog/node_modules/immutable/dist/immutable.js" as it exceeds the max of "100KB".
Hash: a50dc1dbe900ea6bcb4d244164e0fcd2efaf88086482cdaa7e742230415b
Version: webpack 2.1.0-beta.13
Child
Hash: a50dc1dbe900ea6bcb4d
Version: webpack 2.1.0-beta.13
Time: 17305ms
Asset Size Chunks Chunk Names
./build/assets/app.js 1.23 MB 0 [emitted] main
+ 373 hidden modules
ERROR in ./~/css-loader!./~/sass-loader!./src/styles.scss
Module build failed:
@extend .h3;
^
".gridMark" failed to @extend ".h3".
The selector ".h3" was not found.
Use "@extend .h3 !optional" if the extend should be able to fail.
in /Volumes/data/projects/pastalog/src/styles.scss (line 131, column 5)
@ ./src/styles.scss 4:14-117
Child
Hash: 244164e0fcd2efaf8808
Version: webpack 2.1.0-beta.13
Time: 17296ms
Asset Size Chunks Chunk Names
./build/server.js 864 kB 0 [emitted] main
+ 313 hidden modules
Child
Hash: 6482cdaa7e742230415b
Version: webpack 2.1.0-beta.13
Time: 17357ms
Asset Size Chunks Chunk Names
./test/build/index.js 135 kB 0 [emitted] main
+ 121 hidden modules
npm ERR! Darwin 15.2.0
npm ERR! argv "/usr/local/Cellar/node/6.2.0/bin/node" "/usr/local/bin/npm" "run" "build"
npm ERR! node v6.2.0
npm ERR! npm v3.8.9
npm ERR! code ELIFECYCLE
npm ERR! [email protected] build: `webpack`
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the [email protected] build script 'webpack'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! webpack
npm ERR! You can get information on how to open an issue for this project with:
npm ERR! npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR! npm owner ls pastalog
npm ERR! There is likely additional logging output above.
npm ERR! Please include the following file with any support request:
npm ERR! /Volumes/data/projects/pastalog/npm-debug.log
After some time investigating, I discovered that this line causes the problem, the build runs fine if I delete it. What does this line do? What is the proper fix for this problem?
Also, I can't delete the old series anymore, so I can't stop it anyhow ๐
When I try pastalog --serve 8120
or even with sudo
, I get this error:
npm ERR! Error: ENOENT, open '/usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json'
npm ERR! If you need help, you may report this *entire* log,
npm ERR! including the npm and node versions, at:
npm ERR! <http://github.com/npm/npm/issues>
npm ERR! System Linux 3.13.0-58-generic
npm ERR! command "/usr/bin/node" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! cwd /usr/local/lib/python2.7/dist-packages/pastalog
npm ERR! node -v v0.10.37
npm ERR! npm -v 1.4.28
npm ERR! path /usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json
npm ERR! code ENOENT
npm ERR! errno 34
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /usr/local/lib/python2.7/dist-packages/pastalog/npm-debug.log
npm ERR! not ok code 0
Here is the output of less /usr/local/lib/python2.7/dist-packages/pastalog/npm-debug.log
:
0 info it worked if it ends with ok
1 verbose cli [ '/usr/bin/node', '/usr/bin/npm', 'start', '--', '--port', '8120' ]
2 info using [email protected]
3 info using [email protected]
4 verbose node symlink /usr/bin/node
5 error Error: ENOENT, open '/usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json'
6 error If you need help, you may report this *entire* log,
6 error including the npm and node versions, at:
6 error <http://github.com/npm/npm/issues>
7 error System Linux 3.13.0-58-generic
8 error command "/usr/bin/node" "/usr/bin/npm" "start" "--" "--port" "8120"
9 error cwd /usr/local/lib/python2.7/dist-packages/pastalog
10 error node -v v0.10.37
11 error npm -v 1.4.28
12 error path /usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json
13 error code ENOENT
14 error errno 34
15 verbose exit [ 34, true ]
Please?
Hi, thank you for a cool project! It looks very promising!
Do you plan to add functionality to add new tabs or windows? It would be nice to place different kinds of experiments to different places (from the web interface or from API).
Another feature request is to add several graphs on the same screen. For example, I'd like to monitor the cost the the gradient norm at the same time, but they have very different scale.
running
git clone https://github.com/rewonc/pastalog
cd pastalog
npm install
yields this on GNU/Linux
testing binary.
Binary is fine; exiting.
npm http GET https://registry.npmjs.org/core-js
npm http 304 https://registry.npmjs.org/core-js
npm ERR! peerinvalid The package webpack does not satisfy its siblings' peerDependencies requirements!
npm ERR! peerinvalid Peer [email protected] wants webpack@1 || ^2.1.0-beta
npm ERR! peerinvalid Peer [email protected] wants webpack@^1.12.6
npm ERR! System Linux 4.2.6-300.fc23.x86_64
npm ERR! command "node" "/usr/bin/npm" "install"
npm ERR! cwd /media/p******/pastalog
npm ERR! node -v v0.10.36
npm ERR! npm -v 1.3.6
npm ERR! code EPEERINVALID
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /media/p******/pastalog/npm-debug.log
npm ERR! not ok code 0
I am running pastalog server as:
pastalog --serve 8120
Running several models leaves traces but would like to be able to clear the previous results and start anew.
How to do that?
The server always crashes on Windows if there is no "database.json" file. The error message is this:
D:\Software\pastalog\build\server.js:7357
throw renameError;
^Error: ENOENT: no such file or directory, rename 'D:\Software\pastalog\database.json' -> 'D:\Software\pastalog\database.json.~BACKUP'
at Error (native)
Apparently it's trying to rename the file, but this fails if there is no file to rename. After I manually added an empty file "database.json" everything works fine.
Currently the database is where the python package is installed. This is a pretty bad idea for several reasons: security, mixing code with data... and in my case the home directory is an nfs drive which is very slow. A better default would be at least /tmp/...
.
I tried to change the database path I found here, but it doesn't seem to be working. Can you point me how to properly set the db path?
After start the server, the server seems to work fine until I try to access localhost:8120 via web brower. It seems that the issue is because there were too much data loaded before. I have tried reboot the system. It doesn't help.
Any suggestion will be very appreciated.
(DL) chih-yao@chihyao-ubuntu:~/DL$ pastalog --serve 8120
[email protected] start /home/chih-yao/DL/lib/python2.7/site-packages/pastalog
node build/server.js "--port" "8120"
pastalog server listening on port: 8120
<--- Last few GCs --->
13396 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 433.6 / 0 ms [allocation failure] [GC in old space requested].
13831 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 434.9 / 0 ms [allocation failure] [GC in old space requested].
14266 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 434.7 / 0 ms [last resort gc].
14703 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 437.1 / 0 ms [last resort gc].
<--- JS stacktrace --->
==== JS stack trace =========================================
Security context: 0x36629b1c9e31
2: encode(aka utf8encode) [/home/chih-yao/DL/lib/python2.7/site-packages/pastalog/node_modules/socket.io/node_modules/engine.io/node_modules/engine.io-parser/node_modules/utf8/utf8.js:~103] [pc=0x66f6db90c9f](this=0xec9e8310179 <an Object with map 0x275a26662199>,string=0x36629b104189 <undefined)
3: encodePacket [/home/chih-yao/DL/lib/python2.7/site-packages/pastalog/node_modules/sock...
FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory
1: node::Abort() [node]
2: 0xfc3f6c [node]
3: v8::Utils::ReportApiFailure(char const_, char const_) [node]
4: v8::internal::V8::FatalProcessOutOfMemory(char const_, bool) [node]
5: v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationSpace) [node]
6: v8::internal::Runtime_AllocateInTargetSpace(int, v8::internal::Object__, v8::internal::Isolate_) [node]
7: 0x66f6da06338
Aborted (core dumped)
npm ERR! Linux 4.4.0-34-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! node v6.4.0
npm ERR! npm v3.10.3
npm ERR! code ELIFECYCLE
npm ERR! [email protected] start: node build/server.js "--port" "8120"
npm ERR! Exit status 134
npm ERR!
npm ERR! Failed at the [email protected] start script 'node build/server.js "--port" "8120"'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! node build/server.js "--port" "8120"
npm ERR! You can get information on how to open an issue for this project with:
npm ERR! npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR! npm owner ls pastalog
npm ERR! There is likely additional logging output above.
npm ERR! Please include the following file with any support request:
npm ERR! /home/chih-yao/DL/lib/python2.7/site-packages/pastalog/npm-debug.log
It would be very helpful to be able to delete an entire model with one click.
I am using NPM version v7.9.0.
I am facing the following error while running npm run build
for pastalog.
could you please let me know how to resolve this?
-> % npm run build
> [email protected] build /media/data/arul/miscellanous/pastalog
> webpack
(node:22322) DeprecationWarning: loaderUtils.parseQuery() received a non-string value which can be problematic, see https://github.com/webpack/loader-utils/issues/56
parseQuery() will be replaced with getOptions() in the next major version of loader-utils.
Hash: 7f2522d0b30b7d93f2acefee6480ee97bc23e1e6dcc1ef502acc1bbb5073
Version: webpack 2.4.1
Child
Hash: 7f2522d0b30b7d93f2ac
Time: 2380ms
Asset Size Chunks Chunk Names
./build/assets/app.js 4.17 kB 0 [emitted] main
[0] ./src/client.js 1.53 kB {0} [built] [failed] [1 error]
ERROR in ./src/client.js
Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/src"
at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
at Array.map (native)
at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)
Child
Hash: efee6480ee97bc23e1e6
Time: 2360ms
Asset Size Chunks Chunk Names
./build/server.js 4.17 kB 0 [emitted] main
[0] ./src/server.js 1.53 kB {0} [built] [failed] [1 error]
ERROR in ./src/server.js
Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/src"
at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
at Array.map (native)
at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)
Child
Hash: dcc1ef502acc1bbb5073
Time: 2357ms
Asset Size Chunks Chunk Names
./test/build/index.js 4.17 kB 0 [emitted] main
[0] ./test/index.js 1.54 kB {0} [built] [failed] [1 error]
ERROR in ./test/index.js
Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/test"
at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
at Array.map (native)
at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)
npm ERR! Linux 3.13.0-32-generic
npm ERR! argv "/home/arul/.nvm/v7.9.0/bin/node" "/home/arul/.nvm/v7.9.0/bin/npm" "run" "build"
npm ERR! node v7.9.0
npm ERR! npm v4.2.0
npm ERR! code ELIFECYCLE
npm ERR! errno 2
npm ERR! [email protected] build: `webpack`
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the [email protected] build script 'webpack'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! webpack
npm ERR! You can get information on how to open an issue for this project with:
npm ERR! npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR! npm owner ls pastalog
npm ERR! There is likely additional logging output above.
npm ERR! Please include the following file with any support request:
npm ERR! /home/arul/.npm/_logs/2017-04-23T19_07_24_649Z-debug.log
I made a simple Torch interface here - should simplify the process for people who want to use pastalog with Torch. You may want to add in your readme somewhere?
It would be great to be able to plot a list of points instead of one single point at the time.
E.g.
from pastalog import Log
log_a = Log('http://localhost:8120', 'modelA')
log_a.post('trainLoss', value=[2.7, 3.1, 1.2, 2.8, 3.7], step=range(5))
This would allow to significantly reduce the number of POST requests, moving the iteration over the data from the user's code to javascript.
I am using pastalog to plot some historical data: I have around 100+ parameters of ~200 points each. With the current code I have to cycle through all the points and plot them one at the time. This is extremely slow, at the point that the plots are rendered several minutes after my plotting script ended.
The client (Log class) does not work under Windows because it assembles the URL using os.path.join()
, which is intended for filesystem paths and not URLs:
self.url = os.path.join(url, 'data')
Under Windows, the path fragments are concatenated with a backslash, so that the URL turns out as "http://localhost:8120\data".
When installing, it doesn't seem to recognize that I have node and npm? I have restarted and tried again and the same results below. Sorry if this isn't really a pastalog problem, but rather on my end, I'm just not sure what to do.
$ pastalog --install
Please install npm and node.
Li@Talon ~/pastalog (master)
$ npm -v
3.10.5
Li@Talon ~/pastalog (master)
$ node -v
v6.3.1
If I install Pastalog directly from pip, I get the missing parenthesis error of Python 2. After looking at the code, this is not the case and the code is Python 3 compatible.
Would really appreciate it if the pip package was updated so we can enjoy pastalog in all its glory.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.