Comments (5)
As far as connections go with got
, there is no connection pool since it uses the node.js globalAgent
which is defaults to Infinity
number of sockets. It is possible to create a connection pool and use keep-alive but this may have other downsides.
Ref: sindresorhus/got#815
from elasticsearch-assets.
For the client timeout, it does look like our default is being set to 30 seconds which should definitely be set to 2 minutes
elasticsearch-assets/asset/src/spaces_reader_api/schema.ts
Lines 27 to 31 in 85cb2ce
from elasticsearch-assets.
interesting, let me give it a try with the timeout changes...that would be an easy fix!
from elasticsearch-assets.
setting the timeout:120000
works, was able to run a job with 20 workers and 20 slicers.
I feel silly for not checking for this, but good work @peterdemartini!
Issue is resolved.
from elasticsearch-assets.
I am unresolving this because we need to set the default timeout to 2 minutes
from elasticsearch-assets.
Related Issues (20)
- Convert CI from Travis to Github Actions HOT 3
- Job-components dep update causes a type mismatch in elasticsearch_bulk.
- Updating mocker-data-generator to v3 requires teraslice-test-harness fix.
- List of out-of-date dependencies HOT 5
- remove elasticsearch_data_generator operation HOT 2
- Remove NODE_TLS_REJECT_UNAUTHORIZED setting from SpacesReaderClient HOT 1
- Delete needless Opensearch v2 code
- spaces_reader must be able to use user supplied CA certificate HOT 3
- Using <=2.3.x version of elasticsearch bundle breaks teraslice CI HOT 1
- Test and Yarn errors HOT 3
- job errors get lost or ignored in v2.4.0, v2.2.1 HOT 1
- spaces_reader appears to be reading duplicate records unless using 1 worker or interval set to 1s HOT 3
- ID slicer not working correctly with many slicers HOT 1
- Large windowSize can trip ES circuit breaker, fail slices, crash ES nodes. HOT 9
- Slice error when writing to rolling opensearch cluster HOT 11
- docker tests with elasticsearch-asset-apis
- test helpers usage from elasticsearch-store
- Bulk Sender `chunkRequests` Bug HOT 1
- Node 18 asset build HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from elasticsearch-assets.