Import large files fails about qnabot-on-aws HOT 4 CLOSED

might have to use kinesis firehose to for importing into elasticsearch

from qnabot-on-aws.

here is the error response
{ "message": "Template evaluation timed out" }

seems like apigateway is choking on parsing the large files.
alternative for large files would be send s3 bucket/key and the lambda loads and parses from there

from qnabot-on-aws.

another alternative)
create a _bluk endpoint in the api that proxies a PUT to s3 that pass throughs the body (no template)
and have a lambda listening to that bucket that will upload the file to ElasticSearch.
this would make bulk upload an async operation so needs to have some way to monitor and track an upload job
limits)
apigateway body is max 10 megs,

from qnabot-on-aws.

fixed in v2

from qnabot-on-aws.