seangottarun / gpxoverlay Goto Github PK

Python project that takes GPS data and overlays it onto a video with custom user-defined HTML widgets

Python 90.09% CSS 3.68% HTML 6.23%

gps-data gps-overlay gpx video python video-processing

gpxoverlay's Introduction

Hello there! My name is Sean Wu

I'm a computer engineering student at the University of Toronto (EngSci ECE 2T2). Currently, I work on autonomous driving algorithms at aUToronto. Previously I worked on reprogrammable computer hardware (FPGAs) at Intel and computer vision at the University of Toronto.

I'm also passionate about 2D/3D human pose estimation (HPE), signal processing, biomechanics, and software architecture.

I like learning outside of school by working on side projects and going through MOOC classes. Check out some of my side projects and MOOC LaTeX study notes!

💼 Previous Research Internships

I was a summer research intern at Prof. Genov's Intelligent Sensory Microsystems Laboratory at the University of Toronto. I worked on developing new 3D computational imaging applications with Structured Light and Coded Exposure Cameras.

Before that, I researched and developed a mathematical model for MATLAB simulations of energy efficient air conditioners at the National University of Singapore.

🛠 Tech Stack

I mainly work with Python for computer vision and Kotlin for Android app development.

💻
➕
📷
🌐
🔧
🎨

📈 GitHub Stats

gpxoverlay's People

Contributors

Stargazers

Watchers

Forkers

exadeci ceddy4395

gpxoverlay's Issues

Overlay_elevation example is broken

(video) C:\Users\antip\Documents\GPXOverlay\examples>python overlay_elevation.py
Traceback (most recent call last):
File "overlay_elevation.py", line 14, in
main()
File "overlay_elevation.py", line 9, in main
elevation_overlay = overlay.Overlay('sample-data-short.gpx', 'video.mp4')
AttributeError: module 'GPXOverlay.overlay' has no attribute 'Overlay'

Win10, python 3.8. Other examples work.

Random noise pixels in transparent pngs when using imgkit (wkhtmltopdf)

System info

Windows 10 Pro (1903)
Python 3.6.1-amd64 (64-bit)
ffmpeg 4.3.1
wkhtmltopdf 0.12.6
Python packages:

beautifulsoup4==4.9.1
ffmpeg-python==0.2.0
imgkit==1.0.2
Jinja2==2.11.2
matplotlib==3.3.1
numpy==1.19.1
Pillow==7.2.0

Issue

When each overlay frame is created, the top of the png image has some random noise. It seems to be an existing unresolved upstream issue with wkhtmltopdf (see issue wkhtmltopdf/wkhtmltopdf#2629). The affected lines in GPXOverlay/frame.py should be

# Use imgkit to generate png from temporary HTML file
options = {'quiet': '', 'transparent': '', 'width': 500, "crop-w":500, 'disable-smart-width': ''} 
imgkit.from_file('temp/updated_speed.html', f'temp/speed{id}.png', options=options, css=SPEED_CSS_PATH)

ffmpeg._run.Error: ffmpeg error (see stderr output for detail)

On my mac, after installation I have the following error.

python3 overlay_speed.py

ffmpeg version 4.4 Copyright (c) 2000-2021 the FFmpeg developers
  built with Apple clang version 12.0.0 (clang-1200.0.32.29)
  configuration: --prefix=/usr/local/Cellar/ffmpeg/4.4_1 --enable-shared --enable-pthreads --enable-version3 --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox
  libavutil      56. 70.100 / 56. 70.100
  libavcodec     58.134.100 / 58.134.100
  libavformat    58. 76.100 / 58. 76.100
  libavdevice    58. 13.100 / 58. 13.100
  libavfilter     7.110.100 /  7.110.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  9.100 /  5.  9.100
  libswresample   3.  9.100 /  3.  9.100
  libpostproc    55.  9.100 / 55.  9.100
[image2 @ 0x7fbf18008a00] Could find no file with path 'temp/speed%d.png' and index in the range 0-4
temp/speed%d.png: No such file or directory
Traceback (most recent call last):
  File "/Users/bonaime/git/GPXOverlay/examples/overlay_speed.py", line 77, in <module>
    convert_overlay_to_video(frame_name_format, output_overlay_path, fps)
  File "/Users/bonaime/git/GPXOverlay/GPXOverlay/overlay.py", line 23, in convert_overlay_to_video
    ffmpeg
  File "/usr/local/lib/python3.9/site-packages/ffmpeg/_run.py", line 325, in run
    raise Error('ffmpeg', out, err)
ffmpeg._run.Error: ffmpeg error (see stderr output for detail)

Missing audio on output video after FFmpeg overlay

Issue

As mentioned in #5 (review), when the GPS data video is overlayed on the original input video, the audio stream is dropped. According to ffmpeg-python documentation,

Some ffmpeg filters drop audio streams, and care must be taken to preserve the audio in the final output. The .audio and .video operators can be used to reference the audio/video portions of a stream so that they can be processed separately and then re-combined later in the pipeline. This dilemma is intrinsic to ffmpeg, and ffmpeg-python tries to stay out of the way while users may refer to the official ffmpeg documentation as to why certain filters drop audio.

TODO

Find proper way to keep audio stream without distortion or any modification
Test on Windows and macOS

seangottarun / gpxoverlay Goto Github PK

gpxoverlay's Introduction

Hello there! My name is Sean Wu

💼 Previous Research Internships

🛠 Tech Stack

📈 GitHub Stats

gpxoverlay's People

Contributors

Stargazers

Watchers

Forkers

gpxoverlay's Issues

System info

Issue

Issue

TODO

Recommend Projects

Recommend Topics

Recommend Org