Giter Club home page Giter Club logo

Comments (2)

neilh10 avatar neilh10 commented on June 19, 2024

I'm trying some solutions to managing a -- Response Code -- 500 from MMW.
My upload algorithm looks for a '201', and if it doesn't receive it, it queues it on the Mayfly for retry.
On processing the queued entries, on retry whenever it doesn't receive a '201' it stops processing. Typically this is a '504'
However for some records/POSTs I always get a '500' and the response is fast ~ 625mS.
So a server failure 500 blocks all further uploads

The first issue is what is causing the 500?

One of the challenges is I don't have a view for how the MMW/server accepts and stores new records.
It could be that it is stored as a key based on the "timestamp", and possibly the '500' is from a key already existing.
I've tried re submitting for the following with only the sequence number changed from 438 to 4380 - and its still accepted
{"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2022-10-22T07:06:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4380,
-- Response Code -- 201 waited 627 mS Timeout 15000

Or it could be a that it is a time filter -
when I try and it does seem to reject an older date.
[2022-10-22 10:50:04.841] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2019-12-30T12:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4381,
[2022-10-22 10:50:07.198] -- Response Code -- 500 waited 555 mS Timeout 15000

Trying 2021-01-02T00:00:00-08:00 still gives 500 continuously
[2022-10-22 13:17:19.098] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2021-01-02T00:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4381,
[2022-10-22 13:17:21.425] -- Response Code -- 500 waited 530 mS Timeout 15000

Trying 2022-01-02T00:00:00-08:00 success 201
[2022-10-22 13:21:00.546] {"sampling_feature":"236c674b-69b9-43af-b0d6-33d67b870ecc","timestamp":"2022-01-02T00:00:00-08:00","8c57835f-a32f-4d62-82dc-0ba09f04cf52":4382,
[2022-10-22 13:21:02.497] -- Response Code -- 201 waited 698 mS Timeout 15000

Possible this is a fix for something, rejecting unreasonably early dates - is it a fixed date or a rolling date.?

from odm2datasharingportal.

neilh10 avatar neilh10 commented on June 19, 2024

I guess this is one of those too hard to figure out with all the "Frankstein scripts" that hold the system together.
Its could be related to this #665
So I'm closing it due to lack of any insighs

from odm2datasharingportal.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.