Comments (3)
By spreading your ES master nodes and data nodes into three availability zones it should minimize the chance of ES being down and therefore unreachable by your ddbToEs
lambda. Link here
However, it is important that we implement mechanisms to ensure that all records from DDB are written to ES in case of a network error or other issues in which ddbToEs
fail to write to ES in the first try.
Possible solutions include writing failed requests to a dead letter queue to be processed at a later time. Or to implement exponential back off time for writing the failed requests to ES.
I'll add a ticket to our back log for this story (FHIR-385).
from fhir-works-on-aws-search-es.
This issue is the same as the persistence layer issue: awslabs/fhir-works-on-aws-persistence-ddb#18
Leaving both open as it affects persistence and search components
from fhir-works-on-aws-search-es.
We are now logging failures into a DLQ and improved logging to identify the problematic resources
from fhir-works-on-aws-search-es.
Related Issues (20)
- [Feature Request] Support chained parameters in search HOT 4
- [Feature Request] support both [type]/[id] and [id] when searching by reference HOT 8
- [Feature Request] Contains search support HOT 1
- [Misc] Search sorting and score HOT 1
- [Bug] Paged results not returning the same result set HOT 1
- Support SearchParameter with ".extension()" in expression HOT 3
- [Bug] chained parameters search returns all Resources HOT 4
- [Bug] revInclude on a resource only returns a max of 10 records HOT 3
- Chained search parameters should resolve to exactly one resource type HOT 2
- include/revinclude parameters are not strictly validated HOT 4
- [Feature Request]Support for "prefer" header HOT 3
- [Feature Request] Allow Binary Search to place a "presignedGetUrl" or return object within "data" section HOT 1
- [Misc] token search parameter use of multi_match HOT 2
- [Feature Request] Allow the max chained param result size to be configurable HOT 3
- [Misc] Construction of Wildcard Query on String with ":contains" modifier. HOT 3
- [Bug] QuestionnaireResponse search: Questionnaire query parameter results in empty searchset HOT 1
- [Feature Request] generate schema mapping from implementation guides HOT 2
- Specify operator for multi-filter match queries HOT 1
- [Bug] Issue using _include with location HOT 2
- Issue Searching Resource by multiple identifiers HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from fhir-works-on-aws-search-es.