improving music classification using harmonic complexity
play

Improving Music Classification Using Harmonic Complexity Ladislav - PowerPoint PPT Presentation

Nov 02, 2022 •268 likes •564 views

Improving Music Classification Using Harmonic Complexity Ladislav Mark 1 , Jaroslav Pokorn 1 , Martin Ilk 2 1 Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic 2 Vienna University of Technology, Vienna,

  1. Improving Music Classification Using Harmonic Complexity Ladislav Maršík 1 , Jaroslav Pokorný 1 , Martin Ilčík 2 1 Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic 2 Vienna University of Technology, Vienna, Austria

  2. Categorization Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  3. Outline  Motivation  Music harmony  Our music harmony model  Example analysis  Experiments: Music classification using our new feature Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  4. User preferences recommends Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  5. User preferences recommends Using what?  Tempo, Volume, Mood, Genre, Harmony, Melody, Author, Interpret, Music period, Instruments, ... Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  6. Music classification  Determining genre / author / mood (or other category) Using what?  Tempo, Volume, Harmony, Melody, Instruments, ... Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  7. What we are working on?  Finding a standard set of descriptors for music harmony  Motivation: there is no such descriptors yet Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  8. Harmonic complexity – useful harmony descriptor  1st step: Gathering low­level features using DFT, choosing tones with highest activation to obtain chords (harmonies)  2nd step: Using our model , based on formal grammars, calculating „transition complexity“ between the successive chords (analogy to computational complexity)  Example transitions:  Graph: 2 12 vertices, average degree ≈ 8 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  9. Music harmony comparison Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  10. Harmonic complexity – useful harmony descriptor  Counting the mean transition complexity Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  11. Harmonic complexity – useful harmony descriptor F A C Eb Chord: Complexity: ∑: 0 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  12. Harmonic complexity – useful harmony descriptor Bb Db F Chord: 3 Complexity: ∑: 3 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  13. Harmonic complexity – useful harmony descriptor Eb F G A Chord: 4 Complexity: ∑: 7 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  14. Harmonic complexity – useful harmony descriptor Bb Db F Chord: 4 Complexity: ∑: 11 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  15. Harmonic complexity – useful harmony descriptor Eb F G A Chord: 4 Complexity: ∑: 15 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  16. Harmonic complexity – useful harmony descriptor 60 ∑: 19 # Transitions: Average Transition Complexity: 3.16 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  17. Harmonic complexity – useful harmony descriptor  Counting the mean transition complexity Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  18. Harmonic complexity – useful harmony descriptor Previous: G7 (G B D F) Now: Next: C7 (C E G Bb) Transition: ∑: 0 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  19. Harmonic complexity – useful harmony descriptor Previous: G7 (G B D F) C7 (C E G Bb) Now: Next: F7 (F A C E) 3 Transition: ∑: 3 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  20. Harmonic complexity – useful harmony descriptor Previous: C7 (C E G Bb) F7 (F A C E) Now: Bb (Bb D F) Next: 2 Transition: ∑: 5 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  21. Harmonic complexity – useful harmony descriptor Previous: F7 (F A C E) Bb (Bb D F) Now: G7 (G B D F) Next: 1 Transition: ∑: 6 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  22. Harmonic complexity – useful harmony descriptor Previous: Bb (Bb D F) G7 (G B D F) Now: C7 (C E G Bb) Next: 2 Transition: ∑: 8 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  23. Harmonic complexity – useful harmony descriptor 25 ∑: 12 # Transitions: Average Transition Complexity: 2.08 Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  24. Supporting experiments  Neural Network method  Parameters:  150­dimensional feature vector MFCC, RMS Amplitude, Tempo, Transition probability matrix, Number of keys, Number of modulations, Number of similarity segments, Number of distinct chord roots with added mean Harmonic complexity  20 hidden neurons  5 output classes Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  25. Results: Without Harmonic complexity Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  26. Results: With Harmonic complexity Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  27. Conclusion  Proposed a new descriptor for music analysis  Underlying grammar based model  Proved its usefulness for music classification problem Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

  28. Thank you for your attention Maršík, Pokorný, Ilčík: Improving Music Classification Using Harmonic Complexity ITAT­DMUPW 2014, 28.9.

Recommend

Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark

Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark

Introduction Harmonic Analysis Harmonic CCG Statistical Parsing Conclusion Handout Pre-Viva Talk: Parsing Jazz: Harmonic Analysis of Music Using Combinatory Categorial Grammar Mark Granroth-Wilding Supervisors: Mark Steedman Sharon

775 views • 48 slides
Harmonic Map Let f : T 2 S 3 = SU (2) be a harmonic map. A harmonic map is a critical

Harmonic Map Let f : T 2 S 3 = SU (2) be a harmonic map. A harmonic map is a critical

Moduli Space of Harmonic Tori in S 3 Ross Ogilvie School of Mathematics and Statistics University of Sydney June 2017 1 / 23 Harmonic Map Let f : T 2 S 3 = SU (2) be a harmonic map. A harmonic map is a critical point of the energy

600 views • 23 slides
Week 14 Music Understanding and Classification Roger B. Dannenberg Professor of Computer

Week 14 Music Understanding and Classification Roger B. Dannenberg Professor of Computer

Week 14 Music Understanding and Classification Roger B. Dannenberg Professor of Computer Science, Music & Art Carnegie Mellon University Overview n Music Style Classification n What s a classifier? n Nave Bayesian Classifiers n

322 views • 29 slides
Music Classification Overview and Audio Features Graduate School of Culture Technology, KAIST

Music Classification Overview and Audio Features Graduate School of Culture Technology, KAIST

GCT634: Musical Applications of Machine Learning Music Classification Overview and Audio Features Graduate School of Culture Technology, KAIST Juhan Nam Outlines Definition of Music Classification Tasks Overview of Music Classification

392 views • 37 slides
Practise: MUSIC teleseismic Back-Projection Multiple Signal Classification (MUSIC) q MUSICBP is a

Practise: MUSIC teleseismic Back-Projection Multiple Signal Classification (MUSIC) q MUSICBP is a

Practise: MUSIC teleseismic Back-Projection Multiple Signal Classification (MUSIC) q MUSICBP is a MATLAB implementation of the teleseismic MUSIC back-projections. q Open wrapper General_BP.m q Initialization (creating project folder, etc) q Read

589 views • 14 slides
Pixelwise classification for music document analysis Jorge Calvo-Zaragoza Center for

Pixelwise classification for music document analysis Jorge Calvo-Zaragoza Center for

Pixelwise classification for music document analysis Jorge Calvo-Zaragoza Center for Interdisciplinary Research in Music Media and Technology Schulich School of Music McGill University, Montr eal (Canada) SIMSSA Workshop XII (Aug 2017) 1 /

468 views • 42 slides
How Music Alters Decision Making: Impact of Music Stimuli on Emotional Classification Elad

How Music Alters Decision Making: Impact of Music Stimuli on Emotional Classification Elad

How Music Alters Decision Making: Impact of Music Stimuli on Emotional Classification Elad Liebman, Peter Stone, Corey N. White Computer Science Department Department of Psychology The University of Texas at Austin Syracuse

376 views • 25 slides
Abstract: Computational Complexity theory deals with the classification of problems into classes

Abstract: Computational Complexity theory deals with the classification of problems into classes

Hierarchies of complexity classes 1 Abstract: Computational Complexity theory deals with the classification of problems into classes of hardness called complexity classes. In Abstract Complexity (in contrast to Concrete Complexity) we define

247 views • 12 slides
An introduction to the theory of Borel complexity of classification problems J. Melleray

An introduction to the theory of Borel complexity of classification problems J. Melleray

An introduction to the theory of Borel complexity of classification problems J. Melleray Institut Camille Jordan (Universit e Lyon 1) Lausanne, May 29 2017 J. Melleray Borel complexity of classification problems I. Some context. J.

948 views • 78 slides
Towards a Harmonic Complexity of Musical Pieces Ladislav Mark 1 , Jaroslav Pokorn 1 , Martin

Towards a Harmonic Complexity of Musical Pieces Ladislav Mark 1 , Jaroslav Pokorn 1 , Martin

Towards a Harmonic Complexity of Musical Pieces Ladislav Mark 1 , Jaroslav Pokorn 1 , Martin Ilk 2 1 Faculty of Mathematics and Physics, Charles University, Prague, Czech Republic 2 Vienna University of Technology, Vienna, Austria

257 views • 23 slides
A Deeper Look into Web-based Classification of Music Artists Peter Knees, Markus Schedl, Tim

A Deeper Look into Web-based Classification of Music Artists Peter Knees, Markus Schedl, Tim

A Deeper Look into Web-based Classification of Music Artists Peter Knees, Markus Schedl, Tim Pohle Department of Computational Perception Johannes Kepler University Linz, Austria Overview Artist Classification with Web-based Data

721 views • 18 slides
Music Classification Using Constant-Q Based Features a library for mobile devices Lena Brder

Music Classification Using Constant-Q Based Features a library for mobile devices Lena Brder

Music Classification Using Constant-Q Based Features a library for mobile devices Lena Brder January 5, 2013 Outline 1 Introduction 2 Music Signal Processing The Constant Q transform Feature Extraction Gaussian Mixture Models 3

1.58k views • 129 slides
TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the

TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the

TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the Melodic-Harmonic Divorce, and Meta-Schemas Trevor de Clercq June 25, 2018 Association for Popular Music Education Conference Middle Tennessee State

653 views • 46 slides
MUSIC THERAPY MUSIC THERAPY What is music therapy? Music therapy is simply the process of using

MUSIC THERAPY MUSIC THERAPY What is music therapy? Music therapy is simply the process of using

MUSIC THERAPY MUSIC THERAPY What is music therapy? Music therapy is simply the process of using music to change a persons behaviour or provide memories to improve clarity. What is music therapy? Music can alter moods to manage

996 views • 30 slides
A Deep Representation for Invariance and Music Classification Chiyuan Zhang, Georgios

A Deep Representation for Invariance and Music Classification Chiyuan Zhang, Georgios

A Deep Representation for Invariance and Music Classification Chiyuan Zhang, Georgios Evangelopoulos, Stephen Voinea, Lorenzo Rosasco, Tomaso Poggio. Center for Brains, Minds and Machines (CBMM) Computer Science and Artificial Intelligence

440 views • 19 slides
Crowdsourced Classification with XOR Queries: An Algorithm with Optimal Sample Complexity

Crowdsourced Classification with XOR Queries: An Algorithm with Optimal Sample Complexity

Crowdsourced Classification with XOR Queries: An Algorithm with Optimal Sample Complexity Daesung Kim and Hye Won Chung School of Electrical Engineering, KAIST ISIT, 2020 Introduction Crowdsourcing A method to label data with very small

502 views • 21 slides
ray tracing 2 1 improving raytracing speed 2 raytracing computational complexity ray-scene

ray tracing 2 1 improving raytracing speed 2 raytracing computational complexity ray-scene

ray tracing 2 1 improving raytracing speed 2 raytracing computational complexity ray-scene intersection is expensive improve by low-level optimizations important but does not provide scalability improve by reducing computational complexity

689 views • 27 slides
Harmonic Structure Transform for Speaker Recognition Kornel Laskowski & Qin Jin Carnegie

Harmonic Structure Transform for Speaker Recognition Kornel Laskowski & Qin Jin Carnegie

Prolegomena Baseline Filterbank Design Score-Level Fusion Generalization Conclusions Harmonic Structure Transform for Speaker Recognition Kornel Laskowski & Qin Jin Carnegie Mellon University, Pittsburgh PA, USA KTH Speech Music &

582 views • 46 slides
Classification Complexity Measures and Their Relationship to Feature Selection J. L. Solka and

Classification Complexity Measures and Their Relationship to Feature Selection J. L. Solka and

Classification Complexity Measures and Their Relationship to Feature Selection J. L. Solka and D. A. Johannsen solkajl@nswc.navy.mil;johannsen@nswc.navy.mil NSWCDD Interface04 p.1/40 Agenda Minimal spanning tree complexity measures. An

439 views • 40 slides
Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and

Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and

Features for Audio and Music Classification Martin F. McKinney and Jeroen Breebaart Auditory and Multisensory Perception, Digital Signal Processing Group Philips Research Laboratories Eindhoven, The Netherlands Introduction Wanted:

740 views • 16 slides
On Improving Data Complexity of Attacks on RC5 A. Biryukov V. Velichkov Laboratory of

On Improving Data Complexity of Attacks on RC5 A. Biryukov V. Velichkov Laboratory of

Motivation Previous Work Improved Filter Conclusion On Improving Data Complexity of Attacks on RC5 A. Biryukov V. Velichkov Laboratory of Algorithmics, Cryptology and Security (LACS) University of Luxembourg Early Symmetric Crypto 2015

533 views • 37 slides
AUTOMATIC MIXING Dissonance suppression during harmonic mixing A journey through the DJ world by

AUTOMATIC MIXING Dissonance suppression during harmonic mixing A journey through the DJ world by

AUTOMATIC MIXING Dissonance suppression during harmonic mixing A journey through the DJ world by Stefan Hamburger July 2017 Seminar Topics in Computer Music Prof. Paolo Bientinesi, RWTH Aachen 1 WHAT IS AUTOMATIC MIXING? Generating a

898 views • 35 slides
Music genre classification using traditional and relational approaches Jorge Valverde-Rebaza,

Music genre classification using traditional and relational approaches Jorge Valverde-Rebaza,

Music genre classification using traditional and relational approaches Jorge Valverde-Rebaza, Aurea Soriano, Lilian Berton, Maria Cristina F. Oliveira and Alneu de Andrade Lopes Laboratory of Computational Intelligence (LABIC) Laboratory of

585 views • 45 slides
The complexity of classical music networks Vitor Guerra Rolla Postdoctoral Fellow at Visgraf

The complexity of classical music networks Vitor Guerra Rolla Postdoctoral Fellow at Visgraf

The complexity of classical music networks Vitor Guerra Rolla Postdoctoral Fellow at Visgraf Juliano Kestenberg PhD candidate at UFRJ Luiz Velho Principal Investigator at Visgraf Summary Introduction Related Work Musical Networks

513 views • 36 slides

More recommend