Comments (2)
I'm trying some solutions to managing a -- Response Code -- 500 from MMW.
My upload algorithm looks for a '201', and if it doesn't receive it, it queues it on the Mayfly for retry.
On processing the queued entries, on retry whenever it doesn't receive a '201' it stops processing. Typically this is a '504'
However for some records/POSTs I always get a '500' and the response is fast ~ 625mS.
So a server failure 500 blocks all further uploads
The first issue is what is causing the 500?
One of the challenges is I don't have a view for how the MMW/server accepts and stores new records.
It could be that it is stored as a key based on the "timestamp", and possibly the '500' is from a key already existing.
I've tried re submitting for the following with only the sequence number changed from 438 to 4380 - and its still accepted
{"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2022-10-22T07:06:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4380,
-- Response Code -- 201 waited 627 mS Timeout 15000
Or it could be a that it is a time filter -
when I try and it does seem to reject an older date.
[2022-10-22 10:50:04.841] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2019-12-30T12:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4381,
[2022-10-22 10:50:07.198] -- Response Code -- 500 waited 555 mS Timeout 15000
Trying 2021-01-02T00:00:00-08:00 still gives 500 continuously
[2022-10-22 13:17:19.098] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2021-01-02T00:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4381,
[2022-10-22 13:17:21.425] -- Response Code -- 500 waited 530 mS Timeout 15000
Trying 2022-01-02T00:00:00-08:00 success 201
[2022-10-22 13:21:00.546] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2022-01-02T00:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4382,
[2022-10-22 13:21:02.497] -- Response Code -- 201 waited 698 mS Timeout 15000
Possible this is a fix for something, rejecting unreasonably early dates - is it a fixed date or a rolling date.?
from odm2datasharingportal.
I guess this is one of those too hard to figure out with all the "Frankstein scripts" that hold the system together.
Its could be related to this #665
So I'm closing it due to lack of any insighs
from odm2datasharingportal.
Related Issues (20)
- Batch upload protocol extension HOT 7
- Performance enhancement of CSV download endpoint. HOT 1
- Unable to delete leaf pack experiment from details page HOT 1
- POST to monitormywatershed.org broken HOT 6
- Create obvious path for users to change their own password
- Create path for users to transfer station ownership
- Characterization POSTs against MMW server 2023 May HOT 4
- MMW site down for viewing graphs HOT 1
- create new site Server Error 500 hurrah still created HOT 7
- Inconsistent display of multiple datapoints at one timestamp
- potential db compression settings? HOT 1
- Fix Browse Maps red-green icons for color-blind HOT 1
- Characterization POSTs from 2023 July wrt to MMW
- Users unable to create new or update site notifications HOT 1
- Revisions to Home Page HOT 1
- StreamWatch Schools Updates to Browse Sites HOT 3
- Updates to StreamWatch Assessment Forms HOT 2
- StreamWatch Schools Marcoinvertebrate Forms
- Characterization POSTs from 2023 Aug wrt to MMW HOT 8
- MMW Notification not operating HOT 3
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from odm2datasharingportal.