Giter Club home page Giter Club logo

Comments (14)

SamuelDudley avatar SamuelDudley commented on June 15, 2024

advckpt01
My plan is to have an optional section that can be overlaid with FPV video. See the top middle screen in the attached image as an example. Is that sort of what you were thinking?

from mavcesium.

fnoop avatar fnoop commented on June 15, 2024

Yes that's a nice idea. It would also be good to be able to replace the map display entirely with fpv, or at least a significant overlay. I'm thinking of mavcesium being served by a companion computer on a drone in the field, where it will rarely have internet access to download the tiles, and the realtime video would be more preferable to the rendered tiles.

from mavcesium.

SamuelDudley avatar SamuelDudley commented on June 15, 2024

I can put together​ a WIP to test this functionality. Do you think supporting live video from a gstreamer stream would be okay?

from mavcesium.

fnoop avatar fnoop commented on June 15, 2024

Absolutely :)

from mavcesium.

see3peoh avatar see3peoh commented on June 15, 2024

This i have to try! That's an incredible idea. When the wip is avail I'm on board! Everything you've shown lately has been awesome!

from mavcesium.

awdrone avatar awdrone commented on June 15, 2024

That would be great! I've modified mine a bit to have Nexrad Overlays, GPS Ground units (SAR) and 911 data even! Video integration would be great!

from mavcesium.

SamuelDudley avatar SamuelDudley commented on June 15, 2024

Sorry, I have been struggling with getting any free time to work on this recently... Hopefully this will change soon and let me take on a coupe of these features! This one is high on the TODO list.

from mavcesium.

SamuelDudley avatar SamuelDudley commented on June 15, 2024

Any thoughts on a low latency gstreamer to html5 pipeline? I have tried the following:

gst-launch-1.0 v4l2src device=/dev/video0 ! videoconvert ! videoscale ! video/x-raw,width=320,height=240 ! theoraenc ! oggmux ! tcpserversink host=127.0.0.1 port=8080

and

<!DOCTYPE html>
<html>
        <head>
                <meta http-equiv="content-type" content="text/html; charset=utf-8">
                <title>gst-stream</title>
        </head>
        <body>
                <video width=320 height=240 autoplay>
                        <source src="http://127.0.0.1:8080">
                </video>
        </body>
</html>

In my testing the above gives about 2 seconds of delay between my webcam and the rendered video. Any thoughts on reducing that delay would be greatly appreciated!
Cheers,
Sam

from mavcesium.

awdrone avatar awdrone commented on June 15, 2024

I looked into trying to sync the position and video maybe mjpg (supposedly it has timestamps embedded from the short research I quick looked into). ez-wifibroadcast has about 150ms range might see how they are tweaking some of the RPI camera settings.

from mavcesium.

poliant avatar poliant commented on June 15, 2024

why not overlaying directly on the video using picamera python library?

from mavcesium.

awdrone avatar awdrone commented on June 15, 2024

http://www.linux-projects.org/2017/04/29/uv4l-webrtc-for-pizero/

from mavcesium.

awdrone avatar awdrone commented on June 15, 2024

https://github.com/131/h264-live-player

from mavcesium.

SamuelDudley avatar SamuelDudley commented on June 15, 2024

Thanks for the links! :) I really need to spend some time and work out how these solutions might be able to be integrated into the existing python server setup. I guess first cut would be to try the supplied server and client to see how it really performs.

Syncing the video and the data is another issue but if I could embed a timestamp in with the h264 data frames it might should be able to keep it in sync...

from mavcesium.

SamuelDudley avatar SamuelDudley commented on June 15, 2024

related goodrobots/maverick#693

from mavcesium.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.