Comments (7)
this functionality is affected as well (it is not able to list repositories)
from incubator-devlake.
Hi there,
Thanks for reaching out! Let's address the two issues you mentioned:
- Expired Token:
Unfortunately, due to GitHub's design, tokens cannot be refreshed. The best course of action is to regenerate a new token with the appropriate permissions for your needs.
- OOM (Out-of-Memory) Error:
To help diagnose the OOM error, could you please provide some additional information:
Crash Logs: Were there any logs indicating the crash, such as "panic" messages, around the time of the error?
Container Resources: How much memory and CPU have you allocated to the container running the process?
Pipeline Context: Did the OOM occur while running a pipeline? If so, were there any specific workflows or tasks in progress during the breakdown?
from incubator-devlake.
Hi @klesh, thanks for reaching back :D
I think we can focus solely on problem 1 on this issue if that's okay!
Unfortunately, due to GitHub's design, tokens cannot be refreshed. The best course of action is to regenerate a new token with the appropriate permissions for your needs.
We are using a github app, so I think the tokens should be re-generated with the app's secret key, which does not expire, right? These tokens only live for 1 hour if I am not mistaken.. so we just wanted to make sure they are being refreshed.. from what it looks, we might have caught a situation where it's not 😥
thanks!
from incubator-devlake.
@pimguilherme
I apologize for the misunderstanding. I wasn't aware of the GitHub App authorization process and initially thought you were referring to a Personal Access Token (PAT).
I've reviewed the code, and it appears the access token is regenerated at the start of each collection. This logic hasn't changed since version 0.17.
You mentioned the token expiring after an hour, which could be the issue. It's possible that previously collections completed within that timeframe. However, with growing data volumes, that might no longer be the case.
from incubator-devlake.
Hi @klesh, thanks for the feedback! I apologize for the delay
We do have issues with large repositories that fail because they need to access github after the token has already expired :(
And I am not sure this is the same mechanics, but we also have problems loading data from the Github connection proxy (ie https://devlake/api/plugins/github/connections/3/proxy/rest/repos/my-org/my-repo), how does that token get refreshed?
Thanks again!!
from incubator-devlake.
@pimguilherme Yup, you are correct, the token for Github App should be refreshed when expires automatically.
The proxy endpoint is the perfect proof of the problem because the token is requested once when ApiClient gets instantiated and the proxy helper caches it so the token expires one hour later.
It might take a while to fix.
from incubator-devlake.
Do you have the status code
of the Bad credentials
response?
from incubator-devlake.
Related Issues (20)
- [Bug][PagerDuty] not enough info for Pagerduty execution (400) HOT 3
- [Bug][Module Name] AxiosError: Request failed with status code 500 HOT 2
- [Bug][CircleCI] CircleCI regex is not working to collect data HOT 3
- [Feature][StarRocks] support starrocks replication num
- [Feature][CustomizePlugin] Data extraction 'rawDataParams' does not support wild cards
- [Bug][GitLab] account ID is not normalized HOT 1
- [Bug][SonarQube] subtask convertIssueCodeBlocks ended unexpectedly HOT 1
- [Bug][Sonarqube] data too long HOT 5
- [Bug][opsgenie] Testing API Key not working HOT 2
- [Bug][API] GET /projects exposes GitLab token in the gitextractor plugin HOT 1
- [Bug][Jenkins] MavenModuleSet should be treated as a scope HOT 3
- [Bug][Jenkins] ValidateTaskOptions not working as expected HOT 2
- [Bug][Bitbucket Server] Activities collector fails when PR is corrupt HOT 7
- [Question][REST API] I can't find a way to attach Connection to DevLake Project. HOT 14
- [Bug][gitextractor] Unable to disable CollectDeployment HOT 1
- [Bug][Pager Duty] Not able to delete the Pager Duty connection HOT 1
- [Feature][Kanbanize] Add kanbanize support HOT 1
- [Feature][Sentry]New Data Sources HOT 1
- [Bug][SonarQube] Plugin not work with a bearer token HOT 5
- [Bug][Framework] Devlake tasks table began_at field not correct HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from incubator-devlake.