Comments (8)
Jeffrey28
commented on May 13, 2024
E1030 23:33:13.840035920 3405685 chttp2_transport.cc:1103] Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings"
from mixed_autonomy_intersections.
ZhongxiaYan
commented on May 13, 2024
I haven't seen this issue before
from mixed_autonomy_intersections.
Jeffrey28
commented on May 13, 2024
The program gets stuck or breaks during training. The memory is with 128G. However it has taking more than 48 hours to train it but still in the step 137. The total time used in your training is almost 24 hours. Maybe a better GPU is needed.
from mixed_autonomy_intersections.
ZhongxiaYan
commented on May 13, 2024
What GPU is yours? I'm using a NVIDIA V100. You mean your CPU memory is
128G right (not GPU memory)?
…On Tue, Nov 1, 2022 at 9:34 AM Jeffrey X.L. Chan ***@***.***> wrote:
The program gets stuck or breaks during training. The memory is with 128G.
However it has taking more than 48 hours to train it but still in the step
137. The total time used in your training is almost 24 hours. Maybe a
better GPU is needed.
—
Reply to this email directly, view it on GitHub
<#9 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ACCTY7KUBPXAWA5CQXMY6XTWGEL47ANCNFSM6AAAAAART7MCOQ>
.
You are receiving this because you commented.Message ID:
***@***.***>
from mixed_autonomy_intersections.
Jeffrey28
commented on May 13, 2024
Yes, these two are older versions of the GPU (Titan X pascal) with 12G, which cannot be used to train the agents. The V100 has large memory with 32G.
from mixed_autonomy_intersections.
Jeffrey28
commented on May 13, 2024
why can not it use multiple GPUs?
from mixed_autonomy_intersections.
ZhongxiaYan
commented on May 13, 2024
I didn't set the infrastructure up for multiple. You'd have to implement
that yourself
…On Wed, Nov 2, 2022 at 12:21 AM Jeffrey X.L. Chan ***@***.***> wrote:
[image: image]
<https://user-images.githubusercontent.com/26816785/199394027-b39fe586-448f-4588-a8f9-0e498521ef8f.png>
why can not it use multiple GPUs?
—
Reply to this email directly, view it on GitHub
<#9 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ACCTY7NREWHAJ2BCW32A6H3WGHT3BANCNFSM6AAAAAART7MCOQ>
.
You are receiving this because you commented.Message ID:
***@***.***>
from mixed_autonomy_intersections.
Jeffrey28
commented on May 13, 2024
Thank you, I will try that.
from mixed_autonomy_intersections.
Related Issues (10)
- Request the code HOT 4
- Checkpoint and example config.yaml HOT 1
- 'GridExp' object has no attribute 'wb' HOT 3
- traci.exceptions.TraCIException: TraCI server already finished
- KeyError: ''
- Errors when trainning models HOT 17
- It seems that it does not use tensorboard to show data. HOT 9
- the training crashes because of the raytask HOT 4
- The memory is increasing with steps... HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from mixed_autonomy_intersections.