Pianow-Piano self-learning assistant in Mixed reality on HoloLens
Teammate: Ethan Tung
Work delivered: Piano recognition methods, Designing UI/UX layout
Abstract:
Synthesia is a popular application for learning to play the piano. Its idea of using falling notes and colored keys has proven to be useful for many learners and has been adapted by many other applications. In this project, we aim to bring the great features of this application to Mixed Reality, a combination that will tremendously improve the learning experience, as the learner can now follow the tutorials without looking away from their own physical piano keyboard. This proposal provides details of the project’s motivations, scope and objectives, the methodology to be used as well as how the project will be organized.
Work delivered: Piano recognition methods, Designing UI/UX layout
Abstract:
Synthesia is a popular application for learning to play the piano. Its idea of using falling notes and colored keys has proven to be useful for many learners and has been adapted by many other applications. In this project, we aim to bring the great features of this application to Mixed Reality, a combination that will tremendously improve the learning experience, as the learner can now follow the tutorials without looking away from their own physical piano keyboard. This proposal provides details of the project’s motivations, scope and objectives, the methodology to be used as well as how the project will be organized.
Project plan :

project-plan.pdf |
Interim report:

interim_report_fyp.pdf |
Final poster: