I would like to feature request an additional feature where in Free Play Mode, the player is able to see what notes on the Sheet Music Display is being played while the keys are pressed and the notes are going up. The GIF is done for the purpose of demonstrating a feature I would like to request. When a key is pressed, not only the piano roll is showing what notes are being played, but it goes along with what notes are played in the sheet music display. So, you have all three viewing modes where the player can learn how to read the sheet music through experimenting with piano key presses.
And programming all the notes to line up with the staff is pretty hard to do in my opinion. You have to take considerations with floating point errors and the scale of the staffs in relation to the notes' positions.
At the moment, I'm having some trouble with the current Unity codes at the moment. Therefore, I can't show you what I have pictured in mind.
When the player plays a key, knowing that there will be a note shooting upwards in the piano roll, it would make sense to also have the music note symbol in the sheet music display to also move along, from right to left, as if you are reading the sheet music.
That might be a little trickier. I was thinking a static display like the one in your animated GIF where only your currently-pressed notes appear along the same vertical line.
To do scrolling, you need lots of other context like the time signature, tempo, and a running clock with a beat. Otherwise you wouldn't be able to pick the correct note heads or placement along the horizontal. Even the major sheet music editing apps out there have a lot of trouble with live music entry. That's not a problem I was planning on tackling anytime soon.
Why not give the option to switch between piano fall mode and full screen music notation? This would not only be useful for beginners that want to learn to sight read, it would also be great for performers and extend the usefulness of your product. I have attempted to use sytheshia in a performance environment combined with Cantabile Performer, but the current notation setup is not very useful in that situation. the fact that it shows both the notation and the falling notes is a bit distracting.
I can't imagine that full screen notation would be that complicated to implement
You can press F5 to hide the falling notes while the song is playing.
Full screen notation is going to be very complicated to implement, but it's coming in the next major Synthesia release. The next one (Synthesia 11) is all about improving the sheet music display.
