Midi to image visualization

Have questions? Just saying hello? This is the place.
No explicit, hateful, or hurtful language. Nothing illegal.
Post Reply
Lemo
Posts: 313

Post by Lemo » 05-24-11 10:03 pm

Image

Clavilux 2000

Another visualization system, this one is interesting because instead of displaying the music in a constant flow,
the time just collapses, leaving in the end an overall view of a piece in a single image.
Neat concept and a whole array of artistic possibilities!

I wonder if I can find a tool like that, to create a picture from a midi.
That would make nice artwork to print, or be used as cover art for a midi player.
Or how about a program that assigns an icon to each midi file in your OS explorer, showing directly its content in a visual way.
Stuff & experiments for Synthesia: Gramp v0.2SkinboxFireSynthVideoWebradio

User avatar
DC64
Posts: 830
Location: Earth, U.S.

Post by DC64 » 05-25-11 10:09 am

Seems good, I see posibilities.
"And now for something completely different."

TonE
Synthesia Donor
Posts: 1180

Post by TonE » 07-01-11 3:59 pm

Lemo wrote:I wonder if I can find a tool like that, to create a picture from a midi.
That would make nice artwork to print, or be used as cover art for a midi player.
Or how about a program that assigns an icon to each midi file in your OS explorer, showing directly its content in a visual way.
If the icons can be also a little bigger, e.g. 150 x 150 pixels, then this would look interesting. If not, even just having additional images in the same directory as the .mid might be a good solution. For example for song.mid you would generate also song.jpg which contains some form of visualization of the whole composition. Especially when sorted later with ImageSorterV4 and you would have nice similarity based sorting of all your midi files.

I experimented also in various ways in the past about global midi file image representation. What I am waiting mainly is the new paper of Craig Stuart Sapp, which should hopefully extend mkeyscape.exe with algorithmic midi file segmenation based on key analysis and putting at the segment borders a midi marker into the midi file. Those are already greatly recognized by Synthesia, as we all know.

What information I use so far is:

- Rhythm information, drawn on which I call "1 Bar Circle" or "1 Beat Circle"
- Key information, generated using mkeyscape.exe of Craig Stuart Sapp
- Note density per 2 beats information
- Simple piano roll view

Based on various combinations of information we can add additional midi markers into the midi file.

Here are some example visualizations:
Old MacDonald.mid.jpg
Old MacDonald.mid.jpg (91.18 KiB) Viewed 5135 times
Ode to Joy.mid.jpg
Ode to Joy.mid.jpg (86.25 KiB) Viewed 5135 times
Dragon Warrior - Town Theme.mid.jpg
Dragon Warrior - Town Theme.mid.jpg (86.01 KiB) Viewed 5135 times
If you look carefully, file names were shifted in some cases, so the file names and the images might not be correct in these examples, I made those images almost one year ago. Here we see the rhythm as 1 Bar Circle I think, now I prefer instead the 1 Beat Circle, to get a higher resolution and you can see easily jumpstyle or triplet melodies immediately, e.g. for similarity analysis via ImageSorter above.

What would be interesting, what I did not do yet, splitting a midi file first into four basic components:
1. Drums
2. Bass
3. Harmonies/Chords
4. Melodies
then for each of those creating those images, then combining those four images somehow into a bigger image. Then you could even make comparisons like, ok those two songs have similar basslines and rhythm but not harmonies and melody, or something. :)

Apart from this I like MusicGraph (static OpenGL of midi) from Paul Nelson and MAMPlayer (moving OpenGL of midi, like Synthesia) from Stephen Malinowski. I hope Synthesia can combine MAMPlayer visualizations one day into Synthesia, as a background or "topground" maybe?

Lemo
Posts: 313

Post by Lemo » 07-30-11 10:04 pm

That's not exactly MIDI, but here is another cool film to image viz
http://vimeo.com/26584083
Stuff & experiments for Synthesia: Gramp v0.2SkinboxFireSynthVideoWebradio

TonE
Synthesia Donor
Posts: 1180

Post by TonE » 07-31-11 12:11 am

Indeed very interesting project, thanks for the link.

Nicholas
Posts: 12031

Post by Nicholas » 07-31-11 12:25 am

Yeah, that's very cool.

(And Lemo: look at that PM I sent you! It just did it again. ;) )

Lemo
Posts: 313

Post by Lemo » 07-31-11 4:13 pm

Hmm apparently that PM got lost in the way (0 new messages)
Stuff & experiments for Synthesia: Gramp v0.2SkinboxFireSynthVideoWebradio

Nicholas
Posts: 12031

Post by Nicholas » 07-31-11 4:18 pm

Weird. Well, it was about your mail server returning a message each time one of your watched topics sends out a notification. Something about "550 Requested action not taken: mailbox has been blocked" Never seen that one before.

Lemo
Posts: 313

Post by Lemo » 07-31-11 4:37 pm

Haha yes indeed
My account was hacked, and blocked two days ago because it was sending spam for lottery stuff ^^
Hopefully I'll get it back when the support dude gets back from its weekend with a new password for me...

Weird thing that it blocks private message indeed, and not only its notification
Stuff & experiments for Synthesia: Gramp v0.2SkinboxFireSynthVideoWebradio

Post Reply