Giter Club home page Giter Club logo

amar-iastate / l2rpn-using-a3c Goto Github PK

View Code? Open in Web Editor NEW
32.0 2.0 11.0 31.97 MB

Reinforcement Learning using the Actor-Critic framework for the L2RPN challenge (https://l2rpn.chalearn.org/ & https://competitions.codalab.org/competitions/22845#learn_the_details-overview). The agent trained using this code was one of the winners of the challenge. The code runs on the pypownet environment (https://github.com/MarvinLer/pypownet). It is released under a license of LGPLv3

License: GNU Lesser General Public License v3.0

MATLAB 20.23% Python 79.77%
keras reinforcement-learning a3c l2rpn power-grids codalab lgplv3

l2rpn-using-a3c's Issues

About the training

Hi,after several days‘ training,the scores I got are always negative. Could you tell me the possible reasons for this results?I set the training mode is easy and the datasets is sub_datasets_4. Thank you very much.

Error about tensorflow

when i train model, i'm running into some problems, the tensorflow version is 1.13 and the keras version is 2.3.1

Exception in thread Thread-1:
Traceback (most recent call last):
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/threading.py", line 917, in _bootstrap_inner
self.run()
File "pypow_14_a3c_final.py", line 195, in run
action = self.get_action(env,state)
File "pypow_14_a3c_final.py", line 281, in get_action
policy_nn = self.actor.predict(np.reshape(state, [1, self.state_size]))[0]
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/keras/engine/training.py", line 1462, in predict
callbacks=callbacks)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/keras/engine/training_arrays.py", line 324, in predict_loop
batch_outs = f(ins_batch)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/keras/backend.py", line 3073, in call
self._make_callable(feed_arrays, feed_symbols, symbol_vals, session)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/keras/backend.py", line 3019, in _make_callable
callable_fn = session._make_callable_from_options(callable_opts)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1471, in _make_callable_from_options
return BaseSession._Callable(self, callable_options)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1425, in init
session._session, options_ptr, status)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/framework/errors_impl.py", line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.InvalidArgumentError: Tensor input_1:0, specified in either feed_devices or fetch_devices was not found in the Graph

Exception ignored in: <function BaseSession._Callable.del at 0x7f4d05194a60>
Traceback (most recent call last):
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/client/session.py", line 1455, in del
self._session._session, self._handle, status)
File "/home/nesa517/anaconda3/envs/L2RPN-using-A3C-master/lib/python3.7/site-packages/tensorflow/python/framework/errors_impl.py", line 528, in exit
c_api.TF_GetCode(self.status.status))
tensorflow.python.framework.errors_impl.InvalidArgumentError: No such callable handle: 139963925418400

code is not working because "AttributeError: can't set attribute. "

my python is 3.8, tf2.0, I ran this code on my conda spyder called "pypow_14_a3c_final.py" and I got a problem: Using custom reward signal CustomRewardSignal of file F:L2RPN-using-A3C-master\public_data\reward_signal.py Traceback (most recent call last): File "F\L2RPN-using-A3C-master\pypow_14_a3c_final.py", line 310, in env = set_environement() File "F:...\L2RPN-using-A3C-master\pypow_14_a3c_final.py", line 43, in set_environement game_over_mode=game_over_mode) File "...\lib\site-packages\pypownet\environment.py", line 812, in init self.reset() File "C...\lib\site-packages\pypownet\environment.py", line 831, in reset self.game.n_timesteps_horizon_maintenance) File "...\lib\site-packages\pypownet\environment.py", line 374, in init self.shape = seek_shapes(self, ()) AttributeError: can't set attribute. I want to seek the reason , can you help me please?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.