Giter Club home page Giter Club logo

iscc-cli's People

Contributors

pombredanne avatar titusz avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

iscc-cli's Issues

linux ubuntu cli issue

hey @titusz (and @vingle)

We just ran our first tests of Mova app on Ubuntu today, and we ran into this one.
We might be blocked on deploying to that platform till we can get it sorted. I am not sure how high priority that is for Nic, but would like to find out.

generating iscc for path /home/wesley/1_Projects/lighthouse-obsession.mp4 with title: lighthouse
stderr: Traceback (most recent call last):
File "iscc_cli/cli.py", line 97, in
File "click/core.py", line 829, in call

Error occurred in handler for 'iscc-request': Error: error during iscc generation
at Socket. (/tmp/.mount_mova-0CebFug/resources/app.asar/dist/iscc.js:94:24)
at Socket.emit (events.js:315:20)
at addChunk (internal/streams/readable.js:309:12)
at readableAddChunk (internal/streams/readable.js:284:9)
at Socket.Readable.push (internal/streams/readable.js:223:10)
at Pipe.onStreamRead (internal/stream_base_commons.js:188:23)
stderr: File "click/core.py", line 760, in main
File "click/_unicodefun.py", line 126, in _verify_python3_env
RuntimeError: Click will abort further execution because Python 3 was configured to use ASCII as encoding for the environment. Consult https://click.palletsprojects.com/python3/ for mitigation steps.

This system supports the C.UTF-8 locale which is recommended. You might be able to resolve your issue by exporting the following environment variables:

export LC_ALL=C.UTF-8
export LANG=C.UTF-8

[62677] Failed to execute script 'cli' due to unhandled exception!

iscc gen process exited with code 1

Large video files (over 2.14gb) fail with error "Unsupported media type"

I've been running some video tests and hitting the same 'unsupported media type' error for a variety of files - and eventually concluded:

  • the media type (QuickTime/MPEG4) is supported, other than ProRes
  • file sizes larger than somewhere between 2.14 GB and 2.43 GB fail with the same error message

The traceback is below the table.

File Format File size Processing time Outcome
134 min video H264 low bitrate 3.21 GB   Unsupported media type
134 min video H264 mid bitrate 4.96 GB   Unsupported media type
134 min video H264 high bitrate 10.39 GB   Unsupported media type
134 min video MPEG4/3GP 321.9mb 1m 58s 758ms passed
39 min video H264 720p 2.43 GB   Unsupported media type
34 min video H264 mid bitrate 2.6 GB   Unsupported media type
34 min video H264 low bitrate 1.26 GB   passed
34 min video H264 720p 2.14 GB 9m 7s 623ms passed
15 min video H264 low bitrate 359.4mb 2m 22s 226ms passed
15 min video H264 mid bitrate 554.6mb 3m 0s 107ms passed
15 min video H264 high bitrate 1.16gb 5m 0s 478ms passed
15 min video MPEG4/3GP 36mb 12s 211ms passed
15 min video ProRes 9.13 GB   Unsupported media type
15 min video QuickTime DV Pal 3.41 GB   Unsupported media type
15 min video QuickTime DV NTSC 3.41 GB   Unsupported media type
7 min video QuickTime DV Pal 1.68 GB 5m 2s 226ms passed
7 min video QuickTime DV NTSC 1.68 GB 5m 9s 243ms passed
7 min video H264 high bitrate 571.8 mb 2m 31s 938ms passed
7 min video ProRes 4.39 GB   Unsupported media type
1 min video ProRes 596 MB   Unsupported media type

Traceback

  File "/Users/me/.pyenv/versions/3.8.10/bin/iscc", line 8, in <module>
    sys.exit(cli())
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/click/core.py", line 829, in __call__
    return self.main(*args, **kwargs)
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/click/core.py", line 782, in main
    rv = self.invoke(ctx)
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/click/core.py", line 1259, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/click/core.py", line 1066, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/click/core.py", line 610, in invoke
    return callback(*args, **kwargs)
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/iscc_cli/commands/gen.py", line 49, in gen
    title = get_title(tika_result, guess=guess, uri=file.name)
  File "/Users/me/.pyenv/versions/3.8.10/lib/python3.8/site-packages/iscc_cli/utils.py", line 92, in get_title
    mime_type = clean_mime(meta.get("Content-Type"))
AttributeError: 'NoneType' object has no attribute 'get'

Do not re-download tika server after reboots.

Tika server download and launch is managed by the 'tika' python package. Currently it re-downloads tika server jar after every system reboot. We should skip re-download if tika jar is already available.

Add compare command

Command that takes 2 files as input and returns an ISCC based similarity result.

Feature suggestion: Export entries to .csv

Feature suggestion to include a command that would generate a .csv file from a ISCC generation batch transaction across content in a folder and export detailed entries to .csv.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.