MIR FOR CLASSICAL MUSIC Dasaem Jeong PhD Student PhD student in - PowerPoint PPT Presentation

MIR FOR CLASSICAL MUSIC Dasaem Jeong PhD Student

정다샘 PhD student in MAC Lab Bachelor in Mechanical Engineering Master in Culture Technology ... in KAIST

What do I research?

Classical Music Delivering to listeners

Genre-specific Research Each genre has its own characteristics It helps to make more assumption

Characteristics of classical music How can we put these two music in one category?

The Score

Even 4’ 33’’ has score

There is no authentic performance or original recording of the piece

Score (sheet) Variety in performance

Audio-score alignment

Audio-to-Score Alignment Score Score Audio Target Audio

Audio-to-Score Alignment Score Score Audio Target Audio

Audio-to-Score Alignment Calculate similarity by comparing every frame-by-frame Dynamic Time Warping

Automatic Accompaniment

Performance Analysis

What is the secret of 
 great pianists? Whitestone Photo

Vladimir Horowitz

Tempo Intensity

Limitation of previous research Intensity is calculated in beat-level Assumption: Simultaneously played notes have same intensity

Spectrum Basis: Spectrum of each piano key Estimating intensity of individual note Basis Activation: Activation of each piano key over time V ≈ WH ≈ X Spectrum Basis Basis Activation

Result Melody shows more intensity than accompaniment part.

Application

PerformScore

MIDI XML

Future Project