Comments (4)
I have a different but similar issue, using:
powerpipe v0.4.0
aws plugin v0.139.0
steampipe v0.23.2
I create a config file and then run steampipe service start and then run powerpipe benchmark (aws compliance mod:latest), all in a docker container
Sometimes it works, sometimes I get a slew of errors like:
rpc error: code = Unavailable desc = error reading from server: read unix @->/tmp/plugin2367597389: read: connection reset by peer (SQLSTATE HV000
and
"scanIteratorBase cannot iterate: connection..."
from steampipe.
@jeffreymp17 I will try to reproduce this.
@idesofoctober is this something that you are seeing intermittently?
from steampipe.
This is happening every time
from steampipe.
@pskrbasu I'm looking at some reporting I created around this and across 419 accounts, it definitely DOES NOT happen with all accounts, but it happens consistently on the account it does occur with. Some additional context:
We run this on EKS and each account benchmark run is run in one EKS instance with it's own spc and credentials file (all of them created using the same underlying code). Happy to work with you re: what is the same/different about each account. I saw the issue posted here and thought it might be similar re: the overall database / connection load time/configuration, and my dockerfile does a steampipe service start, aws plugin install, and steampipe service stop. My code is doing a steampipe service start, wait 2 minutes, and then run benchmarks which (I think, my data and troubleshooting hasn't been super diligent) reduced the total number of accounts with this error.
One hypothesis I have (based on nothing tangible, but thought I'd share in case it raises an idea) is that the aws.spc for all of these is using * for region. Could the number or location of regions that are in play causing some difference in the load time (if the load time is in fact the issue?)?
I'm going on vacation soon, for next week, but if there is something I can look at re: differences between the accounts where this occurs and where this doesn't occur, i'll get back to you as soon as I can.
from steampipe.
Related Issues (20)
- Ollama Steampipe Plugin
- `Hydrates` count in timing verbose mode should use integer formatting(e.g. `119,138`) HOT 1
- Bad build of Linux Arm FDW version 1.11.0
- Raspberry PI: initializing database failed HOT 3
- Steampipe returns 0 exit code even if `failed to export snapshot`(query)
- Tables from Azure and AWS returns this invalid memory address or nil pointer dereference HOT 4
- Query command should support legacy 'true' and 'false' for `--timing` flag
- Ability to get ALL inventory (exported to csv/whatever), so I can diff it between runs HOT 1
- Unusual query timing results with aggregator connection with caching enabled when some connections have errors
- Query time decreasing on subsequent queries with caching disabled HOT 1
- Docker Image for latest steampipe HOT 4
- setting autocomplete in workspaces files has no effect HOT 1
- JSON metadata output should not contain scan info when `--timing=on`
- `sps` output not working
- fatal error: concurrent map read and map write HOT 1
- AWS authentication fails on a large number of accounts when using credential_process HOT 1
- Update JSON output to be consistent across pipelings - also handle duplicate column names
- A segmentation violation occurs when using the `||`(concat) operator in the `on` clause of a `join`.
- Make plugin startup timeout configurable HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from steampipe.