Giter Club home page Giter Club logo

dss-plugin-amazon-comprehend-nlp's Introduction

dss-plugin-amazon-comprehend-nlp's People

Contributors

alexcombessie avatar dependabot-preview[bot] avatar joachimz avatar tristanleclercq avatar

Stargazers

 avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

dss-plugin-amazon-comprehend-nlp's Issues

Empty dataset throws an error

Describe the bug
I have been working with text data and using Amazon comprehend NLP plugin for various purposes in daily work at client environment. As a prerequisite step, I often deal with Language detection plugin recipe to understand which language the text data falls in, followed by language translation piece. One of our workflows seeks incremental records every week and passes on to subsequent workflows. It is imperative that there is a concrete dependency among workflows which runs one after another with no error at prior steps.

However, it has transpired that we hardly get any incremental nowadays in text data whereas other workflows are significant to run every week. Thus, it is expected to have no records in the text dataset and to let other workflows run. Being input dataset empty to language detection plugin recipe, the recipe throws an error (precisely Python error).

My request is to add an empty dataset as output with columns that come up when the input dataset has records. Instead of Python error, it is better to have an empty one, I think. In this way, we can prevent our entire data pipeline from failing. Kindly look into this when you have a moment.

To Reproduce
Steps to reproduce the behavior:

  1. Please use Amazon Comprehend NLP's language detection recipe with an empty dataset.
  2. Kindly check error.

Expected behavior
An empty dataset with input dataset's schema plus columns returned by API.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

  • DSS version 10

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.