melodic segmentation across cultural traditions
play

Melodic Segmentation Across Cultural Traditions M ARCELO E. R - PowerPoint PPT Presentation

May 18, 2023 •581 likes •966 views

Melodic Segmentation Across Cultural Traditions M ARCELO E. R ODRGUEZ -L PEZ & A NJA V OLK Department of Information and Computing Sciences Utrecht University, Interaction Technology Group

  1. Melodic Segmentation Across Cultural Traditions M ARCELO E. R ODRÍGUEZ -L ÓPEZ & A NJA V OLK Department of Information and Computing Sciences Utrecht University, Interaction Technology Group ▼✳❊✳❘♦❞r✐❣✉❡③▲♦♣❡③❅✉✉✳♥❧ June 13, 2014

  2. What is Segmentation 2/38

  3. What is Segmentation Segmenting = Chunking = Grouping psychology : process of grouping individual units of information into larger units. computing : process of dividing data into smaller meaningful units. 3/38

  4. What is Segmentation Segmenting = Chunking = Grouping Psychology : process of grouping individual units of information into larger units. computing : process of dividing data into smaller meaningful units. 4/38

  5. What is Segmentation Segmenting = Chunking = Grouping Psychology : process of grouping individual units of information into larger units. Computing : process of dividing data into smaller meaningful units. 5/38

  6. Music Segmentation: DM Task Definition In Digital Musicology (DM) , segmentation is the task of dividing a musical piece/melody/section into ‘smaller’ structural units . 6/38

  7. Music Segmentation: Scope ◮ Type of Music and Segment Granularity - input : monophonic music (most generally melodies) - encoding : symbolic - music-theoretic segment parallel : phrases 7/38

  8. Melody Segmentation: an Example Aihu renmin zidibing & # 4 ## Q Q 2 Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q 8/38

  9. Melody Segmentation: Task ◮ Task - identify segment boundary locations - pair boundaries (begin, end) - label boundaries 9/38

  10. Melody Segmentation: Task & # 4 ## Q Q 2 Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q phrase boundary 10/38

  11. Models of Melody Segmentation - development : +30 years - # of models : ≈ 27 - comparative studies : 4, 3-6 models evaluated - most successful : Gestalt-based 11/38

  12. Gestalt Models: Basic Overview - attempt to quantify (visual) Gestalt principles - use system of preference rules - Gestalt proximity is modeled as ‘discontinuity’ detection (breaks in the melodic flow) 12/38

  13. Local Discontinuities Detection: an Example 13/38

  14. Local Discontinuities Detection: an Example Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q 14/38

  15. Local Discontinuities Detection: an Example Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q 15/38

  16. Local Discontinuities Detection: Input Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q . . . . . . . . . . . . e 1 e i e N . . . . . . onset: 24 48 72 84 96 120 2322 pitch: 69 69 68 66 66 69 64 16/38

  17. Local Discontinuities Detection: Input Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q ioi : .5 .5 .5 .25 .25 .5 .5 1 .5 .5 .5 .5 2 .75 .25 .5 .5 .5 1 .5 .5 .5 .5 .5 .5 p-inv : 0 1 2 0 3 5 0 5 1 2 3 2 5 2 2 3 3 5 2 3 7 1 2 3 5 17/38

  18. Local Discontinuity Detection: Profiles Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q ioi : p-inv : 18/38

  19. Local Discontinuity Detection: Profiles Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q ioi : p-inv : 19/38

  20. Local Discontinuity Detection: Output Q Q Q EQ E Q H Q q . q q q q q q q q q q q q e Q q q Output : 0 0 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 20/38

  21. Gestalt Models: Assumptions - discontinuity as a distance in some perceptual space - discontinuity can be treated as a local phenomenon - discontinuity is universal/idiom-independent 21/38

  22. Statistical Study: Research Questions - relevance of discontinuity as a boundary cue? - relevance of discontinuity parametric representation? - appropriateness of locality for modeling? - appropriateness of universality assumption? 22/38

  23. Statistical Study: Data E SSEN F OLK S ONG C OLLECTION (EFSC) - 20,000 annotated vocal folk melodies - Representative subsets of German and Chinese songs E XPERIMENTAL S UBSETS - ≈ 5 k German songs, ≈ 30 k phrases, 1 . . . 29 notes - ≈ 2 k Chinese songs, ≈ 12 k phrases, 1 . . . 169 notes F ILTERED - ≈ 1 . 2 k German songs, ≈ 5 . 5 k phr-pairs, 13 . . . 21 notes - ≈ 1 . 4 k Chinese songs, ≈ 4 . 6 k phr-pairs, 2 . . . 28 notes 23/38

  24. Statistical Study: Processing ph a ph b ## Q Q 2 Q EQ E Q & # H Q q . 4 q q q q q q q q q q q q e Q q q c(ph a) j(ph ab) c(ph b) Nioi : .35 .5 .15 p-inv : 2 5 2 24/38

  25. Results 1: pitch duration Germany China d - 32.41 % 43.73 % - d 49.57 % 72.56 % d - 04.51 % 22.53 % - d 24.13 % 57.70 % nd - 31.49 % 28.53 % - nd 23.26 % 09.04 % 25/38

  26. Results 1: pitch duration Germany China d - 32.41 % 43.73 % - d 49.57 % 72.56 % d - 04.51 % 22.53 % - d 24.13 % 57.70 % nd - 31.49 % 28.53 % - nd 23.26 % 09.04 % 26/38

  27. Results 1: pitch duration Germany China d - 32.41 % 43.73 % - d 49.57 % 72.56 % d - 04.51 % 22.53 % - d 24.13 % 57.70 % nd - 31.49 % 28.53 % - nd 23.26 % 09.04 % 27/38

  28. Results 1: pitch duration Germany China d - 32.41 % 43.73 % - d 49.57 % 72.56 % d - 04.51 % 22.53 % - d 24.13 % 57.70 % nd - 31.49 % 28.53 % - nd 23.26 % 09.04 % 28/38

  29. Results 2: Corpus: Germ any Corpus: China | case: All ph | case: All ph ab | Pitch Analysis ab | Pitch Analysis 20 20 PI (Semitones) 15 PI (Semitones) 15 10 10 5 5 0 0 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals 29/38

  30. Results 2: Corpus: Germ any Corpus: China | case: All ph | case: All ph ab | Pitch Analysis ab | Pitch Analysis 20 20 PI (Semitones) 15 PI (Semitones) 15 10 10 5 5 0 0 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals Corpus: Germ any Corpus: China | case: All ph ab | Duration Analysis | case: All ph ab | Duration Analysis 0.7 0.8 0.6 0.6 0.5 N IOI N IOI 0.4 0.4 0.3 0.2 0.2 0.1 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals 30/38

  31. Results 2: Corpus: Germ any Corpus: China | case: All ph | case: All ph ab | Pitch Analysis ab | Pitch Analysis 20 20 PI (Semitones) 15 PI (Semitones) 15 10 10 5 5 0 0 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals Corpus: Germ any Corpus: China | case: All ph ab | Duration Analysis | case: All ph ab | Duration Analysis 0.7 0.8 0.6 0.6 0.5 N IOI N IOI 0.4 0.4 0.3 0.2 0.2 0.1 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals 31/38

  32. Results 2: Corpus: Germ any Corpus: China | case: All ph | case: All ph ab | Pitch Analysis ab | Pitch Analysis 20 20 PI (Semitones) 15 PI (Semitones) 15 10 10 5 5 0 0 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals Corpus: Germ any Corpus: China | case: All ph ab | Duration Analysis | case: All ph ab | Duration Analysis 0.7 0.8 0.6 0.6 0.5 N IOI N IOI 0.4 0.4 0.3 0.2 0.2 0.1 J(pab) C(pa) C(pb) J(pab) C(pa) C(pb) Join Interval and Context Intervals Join Interval and Context Intervals 32/38

  33. Results 3: ◮ group phrase pairs in respect to size( ph a ) ◮ pairwise t-test between m- j ( ph a , b ) and m- c ( ph a , b ) ◮ China PI: 19/26, NIOI: 26/26 ◮ Germany PI: 6/19, NIOI: 15/19 33/38

  34. Results 3: Germanic Chinese 5 5 5 5 4.5 4.5 4.5 4.5 4 4 4 4 3.5 3.5 3.5 3.5 PI PI 3 3 3 3 2.5 2.5 2.5 2.5 2 2 2 2 1.5 1.5 1.5 1.5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 23 24 25 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 23 24 25 3 6 7 9 10 12 3 6 7 9 10 12 0.65 0.65 0.65 0.65 0.55 0.55 0.55 0.55 0.45 0.45 NIOI 0.45 NIOI 0.45 0.35 0.35 0.35 0.35 0.25 0.25 0.25 0.25 0.15 0.15 0.15 0.15 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 28 29 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 28 29 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 34/38 Length of ph a Length of ph a

Recommend

Family Violence: Beyond Cultural Competence Exploring the religious and cultural traditions of the

Family Violence: Beyond Cultural Competence Exploring the religious and cultural traditions of the

Family Violence: Beyond Cultural Competence Exploring the religious and cultural traditions of the Jewish Community Jewish Care Background Largest provider of services to the Victorian Jewish community Family violence services include:

421 views • 14 slides
Relationships By considering the key cultural factors (beliefs, values, traditions, languages,

Relationships By considering the key cultural factors (beliefs, values, traditions, languages,

Building Meaningful Relationships By considering the key cultural factors (beliefs, values, traditions, languages, laws) of our service population, meaningful mutually beneficial relationships evolved to promote the health and wellbeing of

278 views • 12 slides
Melodic Intonation Therapy Cassandra Coleman & Christine Truong What is Melodic Intonation

Melodic Intonation Therapy Cassandra Coleman & Christine Truong What is Melodic Intonation

Melodic Intonation Therapy Cassandra Coleman & Christine Truong What is Melodic Intonation Therapy (MIT)? MIT is an aphasia treatment method based on the observation that some people with aphasia can produce real words only when

368 views • 11 slides
Computational Tools for the Exploration of Melodic Characteristics CompMusic Seminar, IIT-Madras,

Computational Tools for the Exploration of Melodic Characteristics CompMusic Seminar, IIT-Madras,

Computational Tools for the Exploration of Melodic Characteristics CompMusic Seminar, IIT-Madras, Chennai, India 14 Dec, 2013 Sankalp Gulati Melodic similarity Raga recognition Motif extraction Intonation analysis Melody extraction Tonic

794 views • 64 slides
TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the

TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the

TEST TEST Some Reharmonization Techniques for Popular Music: Melodic Skeletons, the Melodic-Harmonic Divorce, and Meta-Schemas Trevor de Clercq June 25, 2018 Association for Popular Music Education Conference Middle Tennessee State

653 views • 46 slides
Characteriza*on of Melodic Mo*fs in Raag Music with

Characteriza*on of Melodic Mo*fs in Raag Music with

Characteriza*on of Melodic Mo*fs in Raag Music with Time-series Matching Contributors : Joe Ross Kaustuv Ganguli Vedhas Pandit Under guidance of :

818 views • 56 slides
VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a

VIDEO SIGNALS Segmentation WHAT IS SEGMENTATION WHAT IS SEGMENTATION Segmentation is a fundamental low level operation on Segmentation is a fundamental low-level operation on images. If an image is already partitioned into segments

639 views • 51 slides
The Mission Cultural Center For Latino Arts was established in 1977 by Artists And Community

The Mission Cultural Center For Latino Arts was established in 1977 by Artists And Community

z The Mission Cultural Center For Latino Arts was established in 1977 by Artists And Community Activists with a shared Vision to: Promote, Preserve and Develop The Latino Cultural Arts that reflect the living traditions of the

300 views • 15 slides
Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L.

Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L.

Segmentation Bottom-up Segmentation Semantic / instance segmentation Many Slides from L. Lazebnik. Outline Bottom-up segmentation Superpixel segmentation Semantic segmentation Metrics Architectures

1.28k views • 49 slides
RCIA 12: The Battle of Prayer and Traditions of Prayer 12: The Battle of Prayer and Traditions

RCIA 12: The Battle of Prayer and Traditions of Prayer 12: The Battle of Prayer and Traditions

9/2/2019 RCIA 12: The Battle of Prayer and Traditions of Prayer 12: The Battle of Prayer and Traditions of Prayer The Sign of the Cross A distinctly Catholic (and Orthodox) sign The world knows we are Catholic and witnesses to our

359 views • 11 slides
Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image

Day 4 Lecture 2 Segmentation Segmentation Segmentation Define the accurate boundaries of all objects in an image Segmentation: Datasets Pascal Visual Object Classes Microsoft COCO 20 Classes 80 Classes ~ 5.000 images ~ 300.000 images

995 views • 26 slides
Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation

Pixel-Level Im Image Understanding wit ith Semantic Segmentation and Panoptic Segmentation Hengshuang Zhao The Chinese University of Hong Kong May 29, 2019 Part I: I: Semantic Segmentation Semantic Segmentation background car person

510 views • 39 slides
Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08

Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08

Semantic Segmentation / Instance Segmentation Based on Deep learning Yiding Liu 2018.12.08 Outline Overview of segmentation problem Semantic segmentation Instance Segmentation Our work Definition of segmentation problem Image

900 views • 54 slides
Conceptual Blending: The CHAMELEON melodic harmonisation assistant Emilios Cambouropoulos School

Conceptual Blending: The CHAMELEON melodic harmonisation assistant Emilios Cambouropoulos School

Musical Creativity and Conceptual Blending: The CHAMELEON melodic harmonisation assistant Emilios Cambouropoulos School of Music Studies Aristotle University of Thessaloniki 16 th SBCM , 3-6 September 2017, Sao Paulo, Brasil Forms of

573 views • 53 slides
Using Transportation Distances for Measuring Melodic Similarity Rainer Typke, Panos Giannopoulos,

Using Transportation Distances for Measuring Melodic Similarity Rainer Typke, Panos Giannopoulos,

Using Transportation Distances for Measuring Melodic Similarity Rainer Typke, Panos Giannopoulos, Remco C. Veltkamp, Frans Wiering, Ren e van Oostrum Utrecht University, Institute of Information and Computing Sciences Center for Geometry,

711 views • 36 slides
Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory

Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory

Segmentation Segmentation Segmentation using Segmentation using Bayesian Decision Theory Bayesian Decision Theory Segmentation of images is the separation of pixels into different categories depending upon their intensities and/or other

109 views • 8 slides
She stepped away from the traditions She called for help from somebody that had been there She

She stepped away from the traditions She called for help from somebody that had been there She

She stepped away from the traditions She called for help from somebody that had been there She put trust in a person she barely knew and a method she totally did not understand The partial or total absence of light. Wickedness or Evil

230 views • 22 slides
Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV

Image Segmentation using Seg3D Segmentation From Clinical Scans RA RA LA RV LA LV RV LV Tools Layers Viewers Final Segmenting Original Scan Segmentation using Seg3D 2 3 Tools Menu Interactive tools for operating on volume

448 views • 10 slides
Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline

Image Segmentation Machine Learning Study Group Presented by Yaochen Xie Jan 25, 2018 Outline Overview Three Levels of Segmentation Basic Segmentation Semantic Segmentation (FCN, DeepLab) Instance Segmentation (Mask-RCNN)

449 views • 28 slides
Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan

Segmentation Shao-Yi Chien Department of Electrical Engineering National Taiwan University Fall 2018 1 Outline Segmentation Image segmentation Object selection with interactive segmentation Super-pixel methods

1.23k views • 87 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
STYLES FROM MELODIC CONTOURS Amruta Vidwans Kaustuv Kanti Ganguli Preeti Rao Department of

STYLES FROM MELODIC CONTOURS Amruta Vidwans Kaustuv Kanti Ganguli Preeti Rao Department of

DETECTING INDIAN CLASSICAL VOCAL STYLES FROM MELODIC CONTOURS Amruta Vidwans Kaustuv Kanti Ganguli Preeti Rao Department of Electrical Engineering Indian Institute of Technology Bombay 2 nd CompMusic Workshop, Istanbul, July 2012 Outline

927 views • 19 slides
Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a

Image Segmentation Image Segmentation: Definitions How do we know which groups of pixels in a Segmentation is the process of partitioning an digital image correspond to the objects to be image into semantically interpretable

766 views • 24 slides
Already Not Yet SHAVUOT TRADITIONS And when the day of Pentecost was fully come, they were

Already Not Yet SHAVUOT TRADITIONS And when the day of Pentecost was fully come, they were

Already Not Yet SHAVUOT TRADITIONS And when the day of Pentecost was fully come, they were all with one accord in one place. And suddenly there came a sound from heaven as of a rushing mighty wind, and it filled all the house where they

785 views • 65 slides

More recommend