rewonc / pastalog Goto Github PK

View Code? Open in Web Editor NEW

417.0 417.0 46.0 11.28 MB

Simple, realtime visualization of neural network training performance.

License: MIT License

JavaScript 96.26% CSS 2.32% Shell 0.13% Python 1.29%

pastalog's People

Contributors

Stargazers

Watchers

pastalog's Issues

Installing locally

Hi, I am installing the package locally (python 2.7) with
pip install --user pastalog
i directly execute the pastalog script at ~/.local/bin/pastalog --install
which works fine
when starting the server with pastalog --serve 8120
I get:
npm ERR! Error: ENOENT, open '/media/p***/.local/lib/python2.7/site-packages/pastalog/node_modules/--port/package.json'
npm ERR! If you need help, you may report this log at:
npm ERR! http://github.com/isaacs/npm/issues
npm ERR! or email it to:
npm ERR! [email protected]

npm ERR! System Linux 4.2.6-300.fc23.x86_64
npm ERR! command "node" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! cwd /media/p**/.local/lib/python2.7/site-packages/pastalog
npm ERR! node -v v0.10.36
npm ERR! npm -v 1.3.6
npm ERR! path /media/p**/.local/lib/python2.7/site-packages/pastalog/node_modules/--port/package.json
npm ERR! code ENOENT
npm ERR! errno 34
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /media/p***/.local/lib/python2.7/site-packages/pastalog/npm-debug.log
npm ERR! not ok code 0

I could fix this error by changing how subprocess is created, namely from:
subprocess.call(["npm", "start", "--", "--port", str(args.serve)])

subprocess.call(["npm", "start", "--port"+ str(args.serve)])

after this change the server starts up fine, however when I start logging I get

pastalog --serve 8120

[email protected] start /media/p****/.local/lib/python2.7/site-packages/pastalog
node build/server.js

pastalog server listening on port: 8120

/media/p****/.local/lib/python2.7/site-packages/pastalog/build/server.js:7207
throw renameError;
^
Error: ENOENT, rename 'database.json'
npm ERR! weird error 8
npm ERR! not ok code 0

Background and foreground colors are too dark sometimes

Current dark background does not always work well with the randomly selected foreground color for the training curve. Is there a way I could change the color of the curve quickly?

It is really too dark and when you have several models it becomes worse.

value=nan error

Salam

In deep learning sometimes the loss diverges to infinity which results in loss becoming nan.

This results in an exception in the python code:
HTTPError: 400 Client Error: Bad Request for url: http://localhost:8100/data

Also the error in the node server:

SyntaxError: Unexpected token N
    at Object.parse (native)
    at parse (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/body-parser/lib/types/json.js:88:17)
    at /home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/body-parser/lib/read.js:116:18
    at invokeCallback (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:262:16)
    at done (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:251:7)
    at IncomingMessage.onEnd (/home/yasser/.virtualenvs/sci/lib/python2.7/site-packages/pastalog/node_modules/raw-body/index.js:308:7)
    at emitNone (events.js:80:13)
    at IncomingMessage.emit (events.js:179:7)
    at endReadableNT (_stream_readable.js:913:12)
    at _combinedTickCallback (internal/process/next_tick.js:74:11)
    at process._tickCallback (internal/process/next_tick.js:98:9)

Building error with latest version from github

I'm trying to build the latest version of the code (pypi package works fine) and getting the following error:

$ npm run build

> [email protected] build /Volumes/data/projects/pastalog
> webpack

[BABEL] Note: The code generator has deoptimised the styling of "/Volumes/data/projects/pastalog/node_modules/immutable/dist/immutable.js" as it exceeds the max of "100KB".
Hash: a50dc1dbe900ea6bcb4d244164e0fcd2efaf88086482cdaa7e742230415b
Version: webpack 2.1.0-beta.13
Child
    Hash: a50dc1dbe900ea6bcb4d
    Version: webpack 2.1.0-beta.13
    Time: 17305ms
                    Asset     Size  Chunks             Chunk Names
    ./build/assets/app.js  1.23 MB       0  [emitted]  main
        + 373 hidden modules

    ERROR in ./~/css-loader!./~/sass-loader!./src/styles.scss
    Module build failed:
        @extend .h3;
       ^
          ".gridMark" failed to @extend ".h3".
    The selector ".h3" was not found.
    Use "@extend .h3 !optional" if the extend should be able to fail.
          in /Volumes/data/projects/pastalog/src/styles.scss (line 131, column 5)
     @ ./src/styles.scss 4:14-117
Child
    Hash: 244164e0fcd2efaf8808
    Version: webpack 2.1.0-beta.13
    Time: 17296ms
                Asset    Size  Chunks             Chunk Names
    ./build/server.js  864 kB       0  [emitted]  main
        + 313 hidden modules
Child
    Hash: 6482cdaa7e742230415b
    Version: webpack 2.1.0-beta.13
    Time: 17357ms
                    Asset    Size  Chunks             Chunk Names
    ./test/build/index.js  135 kB       0  [emitted]  main
        + 121 hidden modules

npm ERR! Darwin 15.2.0
npm ERR! argv "/usr/local/Cellar/node/6.2.0/bin/node" "/usr/local/bin/npm" "run" "build"
npm ERR! node v6.2.0
npm ERR! npm  v3.8.9
npm ERR! code ELIFECYCLE
npm ERR! [email protected] build: `webpack`
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the [email protected] build script 'webpack'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     webpack
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!     npm owner ls pastalog
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /Volumes/data/projects/pastalog/npm-debug.log

After some time investigating, I discovered that this line causes the problem, the build runs fine if I delete it. What does this line do? What is the proper fix for this problem?

Browser UI keeps downloading the whole data in a loop

When you accumulate some training data, it becomes unusable. My connection with a remote server is completely clogged with repeated data transfers. It downloads **everything every time**, but since pastalog already uses web sockets, it could only push out diffs.

Also, I can't delete the old series anymore, so I can't stop it anyhow 😕

Trying to run serve causes error

When I try pastalog --serve 8120 or even with sudo, I get this error:

npm ERR! Error: ENOENT, open '/usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json'
npm ERR! If you need help, you may report this *entire* log,
npm ERR! including the npm and node versions, at:
npm ERR!     <http://github.com/npm/npm/issues>

npm ERR! System Linux 3.13.0-58-generic
npm ERR! command "/usr/bin/node" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! cwd /usr/local/lib/python2.7/dist-packages/pastalog
npm ERR! node -v v0.10.37
npm ERR! npm -v 1.4.28
npm ERR! path /usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json
npm ERR! code ENOENT
npm ERR! errno 34
npm ERR! 
npm ERR! Additional logging details can be found in:
npm ERR!     /usr/local/lib/python2.7/dist-packages/pastalog/npm-debug.log
npm ERR! not ok code 0

Here is the output of less /usr/local/lib/python2.7/dist-packages/pastalog/npm-debug.log:

0 info it worked if it ends with ok
1 verbose cli [ '/usr/bin/node', '/usr/bin/npm', 'start', '--', '--port', '8120' ]
2 info using [email protected]
3 info using [email protected]
4 verbose node symlink /usr/bin/node
5 error Error: ENOENT, open '/usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json'
6 error If you need help, you may report this *entire* log,
6 error including the npm and node versions, at:
6 error     <http://github.com/npm/npm/issues>
7 error System Linux 3.13.0-58-generic
8 error command "/usr/bin/node" "/usr/bin/npm" "start" "--" "--port" "8120"
9 error cwd /usr/local/lib/python2.7/dist-packages/pastalog
10 error node -v v0.10.37
11 error npm -v 1.4.28
12 error path /usr/local/lib/python2.7/dist-packages/pastalog/node_modules/--port/package.json
13 error code ENOENT
14 error errno 34
15 verbose exit [ 34, true ]

Python 3

Please?

Several tabs/windows

Hi, thank you for a cool project! It looks very promising!

Do you plan to add functionality to add new tabs or windows? It would be nice to place different kinds of experiments to different places (from the web interface or from API).

Another feature request is to add several graphs on the same screen. For example, I'd like to monitor the cost the the gradient norm at the same time, but they have very different scale.

NPM install error

running
git clone https://github.com/rewonc/pastalog
cd pastalog
npm install
yields this on GNU/Linux

testing binary.
Binary is fine; exiting.
npm http GET https://registry.npmjs.org/core-js
npm http 304 https://registry.npmjs.org/core-js
npm ERR! peerinvalid The package webpack does not satisfy its siblings' peerDependencies requirements!
npm ERR! peerinvalid Peer [email protected] wants webpack@1 || ^2.1.0-beta
npm ERR! peerinvalid Peer [email protected] wants webpack@^1.12.6

npm ERR! System Linux 4.2.6-300.fc23.x86_64
npm ERR! command "node" "/usr/bin/npm" "install"
npm ERR! cwd /media/p******/pastalog
npm ERR! node -v v0.10.36
npm ERR! npm -v 1.3.6
npm ERR! code EPEERINVALID
npm ERR!
npm ERR! Additional logging details can be found in:
npm ERR! /media/p******/pastalog/npm-debug.log
npm ERR! not ok code 0

How to clear the previous results?

I am running pastalog server as:

pastalog --serve 8120

Running several models leaves traces but would like to be able to clear the previous results and start anew.
How to do that?

Server crashes when trying to rename not-existing database.json

The server always crashes on Windows if there is no "database.json" file. The error message is this:

D:\Software\pastalog\build\server.js:7357
throw renameError;
^

Error: ENOENT: no such file or directory, rename 'D:\Software\pastalog\database.json' -> 'D:\Software\pastalog\database.json.~BACKUP'
at Error (native)

Apparently it's trying to rename the file, but this fails if there is no file to rename. After I manually added an empty file "database.json" everything works fine.

Change the database location

Currently the database is where the python package is installed. This is a pretty bad idea for several reasons: security, mixing code with data... and in my case the home directory is an nfs drive which is very slow. A better default would be at least /tmp/....

I tried to change the database path I found here, but it doesn't seem to be working. Can you point me how to properly set the db path?

FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory

After start the server, the server seems to work fine until I try to access localhost:8120 via web brower. It seems that the issue is because there were too much data loaded before. I have tried reboot the system. It doesn't help.

Any suggestion will be very appreciated.

(DL) chih-yao@chihyao-ubuntu:~/DL$ pastalog --serve 8120

[email protected] start /home/chih-yao/DL/lib/python2.7/site-packages/pastalog
node build/server.js "--port" "8120"

pastalog server listening on port: 8120

<--- Last few GCs --->

13396 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 433.6 / 0 ms [allocation failure] [GC in old space requested].
13831 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 434.9 / 0 ms [allocation failure] [GC in old space requested].
14266 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 434.7 / 0 ms [last resort gc].
14703 ms: Mark-sweep 1378.7 (1434.6) -> 1378.7 (1434.6) MB, 437.1 / 0 ms [last resort gc].

<--- JS stacktrace --->

==== JS stack trace =========================================

Security context: 0x36629b1c9e31
2: encode(aka utf8encode) [/home/chih-yao/DL/lib/python2.7/site-packages/pastalog/node_modules/socket.io/node_modules/engine.io/node_modules/engine.io-parser/node_modules/utf8/utf8.js:~103] [pc=0x66f6db90c9f](this=0xec9e8310179 <an Object with map 0x275a26662199>,string=0x36629b104189 <undefined)
3: encodePacket [/home/chih-yao/DL/lib/python2.7/site-packages/pastalog/node_modules/sock...

FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - JavaScript heap out of memory
1: node::Abort() [node]
2: 0xfc3f6c [node]
3: v8::Utils::ReportApiFailure(char const_, char const_) [node]
4: v8::internal::V8::FatalProcessOutOfMemory(char const_, bool) [node]
5: v8::internal::Factory::NewFillerObject(int, bool, v8::internal::AllocationSpace) [node]
6: v8::internal::Runtime_AllocateInTargetSpace(int, v8::internal::Object__, v8::internal::Isolate_) [node]
7: 0x66f6da06338
Aborted (core dumped)

npm ERR! Linux 4.4.0-34-generic
npm ERR! argv "/usr/bin/nodejs" "/usr/bin/npm" "start" "--" "--port" "8120"
npm ERR! node v6.4.0
npm ERR! npm v3.10.3
npm ERR! code ELIFECYCLE
npm ERR! [email protected] start: node build/server.js "--port" "8120"
npm ERR! Exit status 134
npm ERR!
npm ERR! Failed at the [email protected] start script 'node build/server.js "--port" "8120"'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! node build/server.js "--port" "8120"
npm ERR! You can get information on how to open an issue for this project with:
npm ERR! npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR! npm owner ls pastalog
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR! /home/chih-yao/DL/lib/python2.7/site-packages/pastalog/npm-debug.log

Delete all series of a model at once

It would be very helpful to be able to delete an entire model with one click.

npm run build error

I am using NPM version v7.9.0.
I am facing the following error while running npm run build for pastalog.
could you please let me know how to resolve this?

-> % npm run build    

> [email protected] build /media/data/arul/miscellanous/pastalog
> webpack

(node:22322) DeprecationWarning: loaderUtils.parseQuery() received a non-string value which can be problematic, see https://github.com/webpack/loader-utils/issues/56
parseQuery() will be replaced with getOptions() in the next major version of loader-utils.
Hash: 7f2522d0b30b7d93f2acefee6480ee97bc23e1e6dcc1ef502acc1bbb5073
Version: webpack 2.4.1
Child
    Hash: 7f2522d0b30b7d93f2ac
    Time: 2380ms
                    Asset     Size  Chunks             Chunk Names
    ./build/assets/app.js  4.17 kB       0  [emitted]  main
       [0] ./src/client.js 1.53 kB {0} [built] [failed] [1 error]
    
    ERROR in ./src/client.js
    Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/src"
        at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
        at Array.map (native)
        at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
        at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
        at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
        at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
        at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
        at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
        at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
        at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
        at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)
Child
    Hash: efee6480ee97bc23e1e6
    Time: 2360ms
                Asset     Size  Chunks             Chunk Names
    ./build/server.js  4.17 kB       0  [emitted]  main
       [0] ./src/server.js 1.53 kB {0} [built] [failed] [1 error]
    
    ERROR in ./src/server.js
    Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/src"
        at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
        at Array.map (native)
        at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
        at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
        at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
        at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
        at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
        at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
        at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
        at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
        at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)
Child
    Hash: dcc1ef502acc1bbb5073
    Time: 2357ms
                    Asset     Size  Chunks             Chunk Names
    ./test/build/index.js  4.17 kB       0  [emitted]  main
       [0] ./test/index.js 1.54 kB {0} [built] [failed] [1 error]
    
    ERROR in ./test/index.js
    Module build failed: Error: Couldn't find preset "es2015-webpack" relative to directory "/media/data/arul/miscellanous/pastalog/test"
        at /media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:293:19
        at Array.map (native)
        at OptionManager.resolvePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:275:20)
        at OptionManager.mergePresets (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:264:10)
        at OptionManager.mergeOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:249:14)
        at OptionManager.init (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/options/option-manager.js:368:12)
        at File.initOptions (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:212:65)
        at new File (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/file/index.js:135:24)
        at Pipeline.transform (/media/data/arul/miscellanous/pastalog/node_modules/babel-core/lib/transformation/pipeline.js:46:16)
        at transpile (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:46:20)
        at Object.module.exports (/media/data/arul/miscellanous/pastalog/node_modules/babel-loader/lib/index.js:163:20)

npm ERR! Linux 3.13.0-32-generic
npm ERR! argv "/home/arul/.nvm/v7.9.0/bin/node" "/home/arul/.nvm/v7.9.0/bin/npm" "run" "build"
npm ERR! node v7.9.0
npm ERR! npm  v4.2.0
npm ERR! code ELIFECYCLE
npm ERR! errno 2
npm ERR! [email protected] build: `webpack`
npm ERR! Exit status 2
npm ERR! 
npm ERR! Failed at the [email protected] build script 'webpack'.
npm ERR! Make sure you have the latest version of node.js and npm installed.
npm ERR! If you do, this is most likely a problem with the pastalog package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR!     webpack
npm ERR! You can get information on how to open an issue for this project with:
npm ERR!     npm bugs pastalog
npm ERR! Or if that isn't available, you can get their info via:
npm ERR!     npm owner ls pastalog
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR!     /home/arul/.npm/_logs/2017-04-23T19_07_24_649Z-debug.log

Torch interface

I made a simple Torch interface here - should simplify the process for people who want to use pastalog with Torch. You may want to add in your readme somewhere?

Plot a list of points

It would be great to be able to plot a list of points instead of one single point at the time.
E.g.

from pastalog import Log
log_a = Log('http://localhost:8120', 'modelA')

log_a.post('trainLoss', value=[2.7, 3.1, 1.2, 2.8, 3.7], step=range(5))

This would allow to significantly reduce the number of POST requests, moving the iteration over the data from the user's code to javascript.

I am using pastalog to plot some historical data: I have around 100+ parameters of ~200 points each. With the current code I have to cycle through all the points and plot them one at the time. This is extremely slow, at the point that the plots are rendered several minutes after my plotting script ended.

Client assembles URL incorrectly under Windows

The client (Log class) does not work under Windows because it assembles the URL using os.path.join(), which is intended for filesystem paths and not URLs:

self.url = os.path.join(url, 'data')

Under Windows, the path fragments are concatenated with a backslash, so that the URL turns out as "http://localhost:8120\data".

Install not recognizing npm and node

When installing, it doesn't seem to recognize that I have node and npm? I have restarted and tried again and the same results below. Sorry if this isn't really a pastalog problem, but rather on my end, I'm just not sure what to do.

$ pastalog --install
Please install npm and node.

Li@Talon ~/pastalog (master)
$ npm -v
3.10.5

Li@Talon ~/pastalog (master)
$ node -v
v6.3.1

Update pip package

If I install Pastalog directly from pip, I get the missing parenthesis error of Python 2. After looking at the code, this is not the case and the code is Python 3 compatible.

Would really appreciate it if the pip package was updated so we can enjoy pastalog in all its glory.

rewonc / pastalog Goto Github PK

pastalog's People

Contributors

Stargazers

Watchers

Forkers

pastalog's Issues

Recommend Projects

Recommend Topics

Recommend Org