Hello. I am SO HAPPY that there is a way to do a synthesia style recording. I have a problem, though. When I render I get 5,000 images and have to figure out how to convert them to a video without loosing the quality. I don't know if it is possible, but could you allow a 'render as video' feature? Thank you!

Probably due to my ignorance but i can't get it to compile on my RPI 3. Im new to RPI and tried to follow this https://www.youtube.com/watch?v=IZgYViHcXdM.
I personally have the feeling that i'm missing some library, i installed GLFW3 and NFDL.

When trying to compile with " make midiviz" i get a lot of compiler errors. Is is even compatible?

CODE:

`

1. pi@raspberrypi:~/Downloads/MIDIVisualizer-master/MIDIVisualizer-master $ make midiviz
2. Linking midiviz...
3. g++: error: OpenGL: No such file or directory
4. g++: error: Cocoa: No such file or directory
5. g++: error: IOKit: No such file or directory
6. g++: error: CoreVideo: No such file or directory
7. g++: error: AppKit: No such file or directory
8. g++: error: unrecognized command line option ‘-framework’
9. g++: error: unrecognized command line option ‘-framework’
10. g++: error: unrecognized command line option ‘-framework’
11. g++: error: unrecognized command line option ‘-framework’
12. g++: error: unrecognized command line option ‘-framework’
13. make: *** [Makefile:45: midiviz] Error 1

`

Hello, it's me again! I thought of more additions for this visualizer, such as the ability to change the color of the horizontal/vertical lines. This can help increase contrast against backgrounds (like bright red) or darken lines for a more subtle effect. Another feature that I thought of was the ability to change the color of the sharp and flat notes. The ability to choose a different color for these notes should give the visualizer more color variety. The last feature that I would want is the ability to replace the flashes with other images (like the particles) for more aesthetic. The ability to change the size and color of the flashes would be great too. Thank you for this awesome visualizer, keep up the great work!

If whole music is the same tempo,it will no problem.
But when you change the speed like Ritenente and Accelearando , the performance is wrong.

i don't know how to explain to you becuase my english skill so bad

please help me

Hi, thanks for amazing app. I really like it.
I found some issue on v3.4

With v3.4, I got this error. Particles are messed up.
In v3.3, I don't have issue like this.

this version not work for me
hang up the program when i want load a midi file
But previous versions work fine

Hello,
I am trying to find the function that controls the velocity for the particles+blur.
(I'm new to c++/openGL so I apologize if this question is trivial)
Many thanks!

It will be great if MIDIVisualizer can display pedal actions and improve keyboard looking.

For reference, here is a piano tutorial I created by combining MIDIVisualizer and other software, the pedal at the bottom right corner and the keyboard are from other software.

Thanks for MIDIVisualizer, it really help creating piano tutorial.

Hi! I just stumbled upon your visualizer and I love it!

If I may ask about anything more, could it be possible to have a way to decide either or not the visualizer plays the midi sounds or not? Also, would it be possible to have a feature that makes the two hands played different colors? If these were a thing, you program would, in my opinion, be just about perfect!

Hey! When i download and double click the exe file, it doesn't start instead, a command prompt window flashes for a second and disappears. I am using Windows 7 ultimate 32 bit version. And i have tried the 32 bit version of midi visualizer. Please help me. I took a video of the screen and paused it to know what the command prompt says. It says "ERROR Could not open window with GLFW3"
I don't know coding. I am a pianist and i opened a github account just to get this fixed. So kindly help me out. 🙂 I dont know coding. How can i make the exe file work? Anyone please help

Would be a verreh noice feature.

People,

I know a bit about C but less about C++ but can someone comment on the possibility of forking this code and changing it so it would work with the attached KB layout?

Thanks,

Phil.

I have a suggestion for this program!
I think particle layer should be above the notes layer. It's more natural.

This shows that particle layer is at the bottom(in v3.3). Notes are hiding particles.

.
.
.

I changed order of layers with photoshop. Now particle layer is above the notes layer.
Notes are broken into particles. So particles should be above the notes, I think.
And it's more pleasing to see.

I would like to create visualizations with animated backgrounds.

The end result is something like this:

https://www.youtube.com/watch?v=WIqP2BWB628

For a general introduction to the problem, see #51. As I have stated there, the easiest way to achieve the desired result would be the save the alpha channel into the generated PNG files. This issue describes an alternate approach.

In theory, when doing the off-line rendering to PNG files, MIDIVisualizer could take a different bg image for each frame.

I could extract the frames from the animated background video into files in a directory, and give that directory to MIDIVisualizer. Then for each frame, MIDIVisualizer could read input000n.png, do the magic, and save it to output000n.png.

When compiling those saved images to a video again, I could get my video, with MIDIVisualizer's visualization plus the animated bg.

What do you think?

Thank you.

Hello! I'm looking forward to using this software but I've run into a bit of an issue. I was hoping to get this working on my laptop but unfortunately I'm getting that open GL error some other users have had. I ran a GPU viewer to make sure I had Open GL 3, and turns out I've got Open GL 3.1 on my card.

OpenGL 3.1 (129 ext) - Intel(R) HD Graphics 3000

Is 3.3 required to run this software? Let me know as soon as possible! Thanks!

Thanks for this great visualisation.

I come from a logicProX with midi and have to visualize what has to be played to some band members.
It would be cool if there is a possiblity to display the note name (A1, D1) on the note or the chords on the keybord.

Just an review - i'm not able to extend that c++ otherwise i would make a PR ;)

The particles seem to be abruptly disappearing when the same note is struck in succession. Any guidance on how to correct this?

thanks!

I would like to integrate MIDIVisualizer into my automatic workflow for creating educational videos based on MIDI files. Basically, I would like to use it is a filter within a scripted workflow: the MIDI file comes in, and the rendered images come out.

Currently, I have to manually open the MIDI file, then manually load the settings, set the image size (via setting window size), set the FPS, then start the button for offline rendering, select the directory, etc.

Ideally, I would like to specify all of these either as command like arguments, or as part of the settings file to load. (And then the name of the setting file should be added as a command line argument.)

When running the app in this mode, the GUI shouldn't even be shown; just execute the task at hand, and then exit.

What do you think about this? Would you accept a PR that enables this?

I asked a really dumb question that I figured soon after.

[INFO]: 0 notes extracted and sorted.
[INFO]: 1204 notes extracted and sorted.
[INFO]: 917 notes extracted and sorted.
[INFO]: 359 notes extracted and sorted.
[INFO]: 2035 notes extracted and sorted.
[INFO]: 20315 notes extracted and sorted.
[INFO]: 2174 notes extracted and sorted.
[INFO]: 3740 notes extracted and sorted.
[INFO]: 4398 notes extracted and sorted.
[INFO]: 4002 notes extracted and sorted.
[INFO]: 2219 notes extracted and sorted.
[INFO]: 2208 notes extracted and sorted.
[INFO]: 3690 notes extracted and sorted.
[INFO]: Final track duration 93.8927 sec.

*--- Fragment shader failed to compile ---*
0:10(24): error: sampler arrays indexed with non-constant expressions are forbidden in GLSL 1.30 and later
*---------------------------------*

Failed loading program: error: linking with uncompiled/unspecialized shader
glError in src/helpers/ProgramUtilities.cpp (115) : GL_INVALID_VALUE


*clicks export button*

[EXPORT]: Will export 6234 frames to "/home/kitteh/Downloads".
[EXPORT]: Processing frame 1/6234.midiviz: malloc.c:2392: sysmalloc: Assertion `(old_top == initial_top (av) && old_size == 0) || ((unsigned long) (old_size) >= MINSIZE && prev_inuse (old_top) && ((unsigned long) old_end & (pagesize - 1)) == 0)' failed.
Aborted (core dumped)

Running on arch linux with latest commit.
No idea what's causing this shrug
If you want to chat about it my contact details are on https://namedkitten.pw

Sadly I can currently not get to build your project as the linker cannot find "lnfd" and I cannot find where to get it from.

Please add some installation instructions and required dependencies.

Current steps taken:

Clone project
cd projectfolder
make

(The requirement to install glfw3 is also only obtainable from reading the comments in the makefile)

Is support planned to listen on a midi port/ports and process the visuals there as opposed to loading a midi file?

Hi,
Many thanks for your excellent work on this project.
I am using the windows 32bit version under WINE on Linux (I can't figure out how to compile a Linux version from source). However, since version 3.3, it no longer works under WINE (v3.2 is the last working version).

The error details are as follows:
Unhandled exception: page fault on execute access to 0x00000000 in 32-bit code (0x00000000).
Register dump:
CS:0023 SS:002b DS:002b ES:002b FS:006b GS:0063
EIP:00000000 ESP:0033f408 EBP:0033f468 EFLAGS:00010202( R- -- I - - - )
EAX:00000001 EBX:7f4edf38 ECX:404237fd EDX:00000000
ESI:00000000 EDI:00000000
Stack dump:
0x0033f408: 00473bc0 00010060 00000000 00010060
0x0033f418: 00000000 00010060 0000001b 00000000
0x0033f428: 0033f82c 7f4edf38 7f5d9540 00000300
0x0033f438: 00000000 06c00000 00010060 7dd72c80
0x0033f448: 06c00000 00000014 0033f6bc 0000000f
0x0033f458: 0033f480 00000020 7f4edf38 4071c395
Backtrace:
=>0 0x00000000 (0x0033f468)
1 0x7f4a7b2c in user32 (+0x97b2b) (0x0033f498)
2 0x7f4a8239 in user32 (+0x98238) (0x0033f4e8)
3 0x7f4aa553 in user32 (+0x9a552) (0x0033f538)
4 0x7f46854e in user32 (+0x5854d) (0x0033f5a8)
5 0x7f46f2c9 in user32 (+0x5f2c8) (0x0033f608)
6 0x7f46f537 in user32 (+0x5f536) (0x0033f658)
7 0x7f49d89c in user32 (+0x8d89b) (0x0033f7e8)
8 0x7f496f39 in user32 (+0x86f38) (0x0033f878)
9 0x004795ee EntryPoint+0xffffffff() in midivisualizer (0x0033fa60)
10 0x00474e33 EntryPoint+0xffffffff() in midivisualizer (0x0033fe88)
11 0x0047c1e3 EntryPoint+0xffffffff() in midivisualizer (0x0033fed0)
12 0x7b464a82 in kernel32 (+0x44a81) (0x0033fee8)
13 0x7b466d5d in kernel32 (+0x46d5c) (0x0033ffd8)
14 0x7b464a8e in kernel32 (+0x44a8d) (0x0033ffec)
0x00000000: -- no code accessible --
Modules:
Module Address Debug info Name (37 modules)
PE 400000- 52a000 Export midivisualizer
PE 7a820000-7a824000 Deferred opengl32
PE 7b420000-7b5d1000 Export kernel32
PE 7bc10000-7bc14000 Deferred ntdll
PE 7da60000-7da64000 Deferred dwmapi
PE 7da80000-7da84000 Deferred uxtheme
PE 7dcd0000-7dcd4000 Deferred xinput1_4
PE 7dcf0000-7dcf4000 Deferred winex11
PE 7dd80000-7dd83000 Deferred usp10
PE 7ddd0000-7de4d000 Deferred comctl32
PE 7df40000-7df4b000 Deferred dinput8
PE 7df80000-7df89000 Deferred msacm32
PE 7dfb0000-7e028000 Deferred winmm
PE 7e080000-7e083000 Deferred msvcr120
PE 7e160000-7e163000 Deferred concrt140
PE 7e480000-7e483000 Deferred api-ms-win-crt-locale-l1-1-0
PE 7e490000-7e493000 Deferred api-ms-win-crt-filesystem-l1-1-0
PE 7e4a0000-7e4a3000 Deferred api-ms-win-crt-runtime-l1-1-0
PE 7e4c0000-7e4c3000 Deferred api-ms-win-crt-convert-l1-1-0
PE 7e4d0000-7e4d3000 Deferred api-ms-win-crt-math-l1-1-0
PE 7e4f0000-7e4f3000 Deferred api-ms-win-crt-utility-l1-1-0
PE 7e500000-7e503000 Deferred api-ms-win-crt-heap-l1-1-0
PE 7e520000-7e523000 Deferred api-ms-win-crt-stdio-l1-1-0
PE 7e530000-7e533000 Deferred api-ms-win-crt-string-l1-1-0
PE 7e550000-7e553000 Deferred vcruntime140
PE 7e580000-7e584000 Deferred ucrtbase
PE 7e6a0000-7e6a3000 Deferred msvcp140
PE 7e790000-7e794000 Deferred imm32
PE 7e7c0000-7e7c4000 Deferred rpcrt4
PE 7e850000-7e878000 Deferred ole32
PE 7e9a0000-7e9a3000 Deferred shcore
PE 7e9d0000-7e9d8000 Deferred shlwapi
PE 7ea40000-7f313000 Deferred shell32
PE 7f410000-7f4f8000 Export user32
PE 7f610000-7f614000 Deferred advapi32
PE 7f690000-7f697000 Deferred gdi32
PE 7ffd0000-7ffd4000 Deferred version
Threads:
process tid prio (all id:s are in hex)
00000008 (D) Z:\home\MyHomeDir\Downloads\MIDIVisualizer-windows-32bits\MIDIVisualizer.exe
00000009 0 <==
0000000e services.exe
00000032 0
0000002f 0
0000002a 0
00000023 0
00000010 0
0000000f 0
00000013 explorer.exe
00000026 0
00000022 0
0000001e 0
00000014 0
0000001c winedevice.exe
00000027 0
00000025 0
00000024 0
0000001d 0
0000001f GoogleUpdate.exe
00000039 0
00000038 0
00000036 0
00000034 0
00000020 0
00000028 plugplay.exe
0000002c 0
0000002b 0
00000029 0
0000002d winedevice.exe
0000003a 0
00000031 0
00000030 0
0000002e 0
System information:
Wine build: wine-4.0.2 (Ubuntu 4.0.2-1)
Platform: i386 (WOW64)
Version: Windows 10
Host system: Linux
Host version: 5.3.0-23-generic

Thanks again for this great software.

Hi! I really love this program and used it too, but I couldn't set separated colors for notes and the particles.
I wanna do this because if the blackground is black and I want a darker note color, the particles will be dark too and it's hard to see.

Hey ! I think it would be very nice to have the ability to choose a custom size for black & white notes ! (fe. in pixels)

Hi! I really want try your program. But when I open .mid file, it's freeze and don't work. Help!! It's work on 3.4 version. But in 4.1 not working!

Hi,
When building on Manjaro (5.4.2-1), I needed to add a CMake link to GLEW. I fail when building normally with the error:

/usr/bin/ld: CMakeFiles/MIDIVisualizer.dir/src/libs/imgui/imgui_impl_opengl3.cpp.o: in function `ImGui_ImplOpenGL3_SetupRenderState(ImDrawData*, int, int, unsigned int)':
imgui_impl_opengl3.cpp:(.text+0x36): undefined reference to `__glewBlendEquation'

This is followed by a bunch of undefined glew references. I do have glew 2.1.0-1 installed, locally.
I added the following to CMakeLists.txt in order to link glew, which does let me successfully build:

find_package(GLEW REQUIRED)
if (GLEW_FOUND)
    include_directories(${GLEW_INCLUDE_DIRS})
    link_libraries(${GLEW_LIBRARIES})
endif()

However, once built, when launching MIDIVisualizer, the program shuts down after loading the midi file.
If using sandboxing (Firejail), I get a segfault after loading the MIDI file. Though, even running un-sandboxed, it still shuts down after loading the midi file, though no error is thrown to output.

[INFO]: 3 tracks (Use tempo (1)).
[INFO]: 1024 units per quarter note .
[INFO]: Reading track 0.
[INFO]: Track  (length: 149, instrument: , tempo: 545544, major, measure duration: 2.18218).
[INFO]: Reading track 1.
[INFO]: Track Acoustic Grand Piano (length: 24323, instrument: , tempo: 500000, major, measure duration: 2).
[INFO]: Reading track 2.
[INFO]: Track Acoustic Grand Piano (length: 24190, instrument: , tempo: 500000, major, measure duration: 2).
[INFO]: 0 notes extracted and sorted.
[INFO]: 2707 notes extracted and sorted.
[INFO]: 2726 notes extracted and sorted.
[INFO]: Final track duration 942.95 sec.
Segmentation fault (core dumped)

(that's sandboxed output above. If un-sandboxed it's the same, minus the segfault).

I tested multiple midi files, and it seems unrelated to any specific file, though I am happy to upload/link one if needed for reproducing.

Judging by the location of the crash in code, I'd guess I still probably have some issue with opengl versioning/glew (it seems to crash right before creating the opengl buffers, shaders, etc in MIDIScene, but I haven't debugged from source to pinpoint it.)

Anyhow, if it seems like a platform/distro issue, don't feel obliged to dig too deep on my behalf, just figured I'd forward my edge-case. If there's log somewhere, or a debug/verbose flag I can set to get more output let me know and I'll update my findings. Thanks!

It could be great to specify the number of seconds before the start of midi visualization. At this moment we need to add this gap to the midi file to avoid beginnings like that: (notes that start at 0:00)

It might be useful for video creators etc.

See more explanation here: michaelsjackson/reaper_forums#1

Thanks for sharing your code here. Will check it from time to time again, as a Synthesia lover and user. It is always good having multiple options, in this case even with source for learning purposes.

I've tried loading 4 different midi files on a Macbook Air with Mojave. The visualization works great up to a point, but then notes become "stuck" or simply stop appearing.

I verified this same behavior on the pre-compiled version all the way to 2.1, and I've also compiled it myself to come across the same behavior.

The midi for the above screen shot is at https://drive.google.com/open?id=1Er6lBhaKwV_liCMiDdjTvKAvIxUEAB06

It also doesn't get past the first two notes of this midi https://drive.google.com/open?id=1lAexUmJ2J93oEyaUIvO-FujWqKsS3N9o

I verified that these two midis could be visualized with http://qiao.github.io/euphony/#20 just fine.

Any idea what might be going on? I love this tool!

I don´t know why but when I load a midi file, it plays but it is not heard.

Hi, I have an another wish to this awesome program!

It would be cool if there is a function to show pressed keys with color option while notes are coming and flashes are flashing.
.
.

Something like this

Audio not playing however everything else works fine

This isn't an issue but i am having issues running this on windows and was hoping for a detailed explanation on how to download and run this?

Offering a non-realtime export mode could be helpful for people who want to do video/music editing but don't necessarily have a powerful computer to render and record the graphics at the same time.

I've already started working on this, by providing a frame-by-frame output, which is the easiest way to achieve this without handling video generation/compression by myself. See 9b06026 and following.

I would like to create visualizations with animated backgrounds.

The end result is something like this:

https://www.youtube.com/watch?v=WIqP2BWB628

Since there is no support for this in the current version, this is how I work around this:

• I generate the PNG files with MIDIVisualizer, with a solid background
• I use ffmpeg to compile the video out of it. (Adding all the other effects, the sound, etc.)

There is currently no alpha channel in the generated PNG files, so I use ffmpeg's colorkey filter to remove the solid background from the visualization, so that I can overlay it on the animated background.

The problem with this approach is that some parts of the animation are semi-transparent (ie. the blur effect, the regions around the flashes, etc.) In these cases, removing the solid background using colorkey doesn't work well. So, for now, I had to disable the blur effect, and I also used a solid bg that is similar to the color of the animated bg in the region of the flashes, so that the flashes don't look weird.

With these workarounds, the process kind of works, but it would be must easier if the alpha channel value could be saved into the generated PNG files.

Then I could simply use them as an overlay, without any further tricks.

Now I am not sure whether the OpenGL renderer is able to export this information. It definitely has it, because when drawing the flashes and the blur effect over an existing bg image, it applies alpha correctly... but maybe the end result is flattened? If that's the case, then there is no way to save the alpha channel into the generated PNG files... we would have to check and see.

What do you think about this?

Hey, congrats on this project.

I've noticed that the particles are not created in the same place where the notes end.
This results in particles popping up out of sync with the track, specially noticeable for me since I was meaning to use 0.300 expansion.

This is especially noticeable if you remove the sparks:

Is this something that could be fixed? Or, if for some reason this is exactly how you want it, it wold be nice to have the option to dislocate it in the settings :)

Another feature that you could consider as a next enhancement is extended configuration of background. The possibility of selecting an image as a background could be great. At this moment I'm thinking about:

• background image
• opacity

For instance:

~source: https://www.youtube.com/watch?v=beHDN-2uXLk

I recently upgraded to Mojave from High Sierra. When I run the make process the new executable is very laggy. It was using 5% CPU before, now it is at 40% cpu usage and it brings my CPU to 80 degrees temperature. Do you know if there is any way to fix this? Thanks.

Trying to visualize a pair of trombones for a cover (midi attached as zip because github doesn't allow mids). The playback appears to get stuck continuously playing the first note for a very long time. This is on the 64-bit windows release 4.1. Thanks for this project!

Gerudo_Valley-Trombones.zip

The midi was exported from Musescore 3.2.3.7635 if it makes a difference.

Hi there,

I'm trying to make changes to the contents in this folder: https://github.com/kosua20/MIDIVisualizer/tree/master/ressources

However nothing happens when I run make.
Is there another command to compile this folder?

Thanks!

Hello! I think it would be great if the particles and notes had their own individual blur like this:
https://imgur.com/gallery/pBKu3rE
At the moment, the particles in the visualizer (when blur is turned on) leaves behind a glow, that can get messy when a lot of notes are on screen. Is there any way to remove this glow from being "left behind" like in the image?

There is an option to turn off the particles, but not the notes. I would like an option for this when you have the time to get around to it.

All the resource directories are called ressources. I know it means the same in French, but it may look strange for other ppl in repository entirely in English.

Hi there, I really love the look of your visualizer!

I don't have a visualizer for my LabMidi project, which is under a 2 clause BSD license. https://github.com/meshula/LabMidi

Since you haven't listed a license, I was wondering if it would be okay with you if I forked your code to form the basis of a demo for my project?