Giter Club home page Giter Club logo

Comments (8)

jiakai0419 avatar jiakai0419 commented on May 18, 2024 2

Your efficient response touched me.

from pytorch-a3c.

ikostrikov avatar ikostrikov commented on May 18, 2024

Fixed in e898f75

Also there are some warnings that do not affect performance of the algorithm.

I will fix them closer to the 0.5.0 release.

from pytorch-a3c.

jiakai0419 avatar jiakai0419 commented on May 18, 2024

@ikostrikov I think the performance is affected in version 0.4.0

python3 main.py --env-name "PongDeterministic-v4" --num-processes 16
Time 00h 00m 09s, num steps 5031, FPS 519, episode reward -21.0, episode length 812
Time 00h 01m 10s, num steps 35482, FPS 501, episode reward -2.0, episode length 100
Time 00h 02m 11s, num steps 66664, FPS 505, episode reward -2.0, episode length 100
Time 00h 03m 13s, num steps 97058, FPS 503, episode reward -2.0, episode length 100
Time 00h 04m 14s, num steps 128517, FPS 504, episode reward -2.0, episode length 108
Time 00h 05m 24s, num steps 163141, FPS 502, episode reward -21.0, episode length 764
Time 00h 06m 34s, num steps 200426, FPS 508, episode reward -21.0, episode length 764
Time 00h 07m 57s, num steps 245725, FPS 514, episode reward -21.0, episode length 1942
Time 00h 09m 16s, num steps 284730, FPS 511, episode reward -21.0, episode length 1324
Time 00h 10m 41s, num steps 325153, FPS 507, episode reward -21.0, episode length 1324
Time 00h 12m 01s, num steps 361563, FPS 501, episode reward -21.0, episode length 1324
Time 00h 13m 28s, num steps 406910, FPS 503, episode reward -21.0, episode length 1964
Time 00h 14m 53s, num steps 450836, FPS 505, episode reward -21.0, episode length 1964
Time 00h 16m 22s, num steps 493876, FPS 503, episode reward -21.0, episode length 1964

from pytorch-a3c.

ikostrikov avatar ikostrikov commented on May 18, 2024

How many cores do you have on your machine?

Is seems to start learning something since the length of the episodes goes up.

from pytorch-a3c.

jiakai0419 avatar jiakai0419 commented on May 18, 2024
  Number of Processors:	1
  Total Number of Cores:	2

I will test that on 64 cores machine.

from pytorch-a3c.

ikostrikov avatar ikostrikov commented on May 18, 2024

On 2 core machine it will just take a lot of time. I would expect a decent reward after 1h of training on Pong.

from pytorch-a3c.

ph-dev-2016 avatar ph-dev-2016 commented on May 18, 2024

I'm using pytorch-cpu 0.4.1 and Python3.7 in Windows7.

Still see this error "TypeError: multinomial() missing 1 required positional arguments: "num_samples""

from pytorch-a3c.

ikostrikov avatar ikostrikov commented on May 18, 2024

@ph-dev-2016 Try with the most recent version of this repository.

from pytorch-a3c.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.