unmixer
play

Unmixer An interface for extracting and remixing loops Jordan B. L. - PowerPoint PPT Presentation

Dec 01, 2023 •198 likes •476 views

Unmixer An interface for extracting and remixing loops Jordan B. L. Smith Yuta Kawasaki Masataka Goto Suppose you are a remix artist... Remix artists have ...but they want the the STEREO MIX... ISOLATED LOOPS. Song Ingredients

  1. Unmixer An interface for extracting and remixing loops Jordan B. L. Smith Yuta Kawasaki Masataka Goto

  2. Suppose you are a remix artist...

  3. Remix artists have ...but they want the the STEREO MIX... ISOLATED LOOPS. Song Ingredients ← Composition ← A B C D E F G 0:00 0:30 1:00 → De-composition → Goal of Unmixer: extract loops from mixed audio Algorithm Interface ≈

  4. Unmixer Interface

  5. 1. User uploads audio file 2. Wait for results (several minutes) 3. Click tiles to add or remove them from the mix 4. Add more songs, test out mashups 5. Adjust tempo 6. Download loops to remix in your favourite DAW

  6. Unmixer Algorithm

  7. Algorithm 1. Compute spectrum frequency → time →

  8. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) frequency → time →

  9. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  10. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  11. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  12. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  13. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  14. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  15. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  16. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → time → (in piece)

  17. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube frequency → bar (in piece) → time → (in bar)

  18. Algorithm 1. Compute spectrum 2. Estimate downbeats (madmom) 3. Stack into cube 4. Compute Tucker 
 decomposition frequency → bar (in piece) → time → (in bar)

  19. frequency → ≈ bar (in piece) → time → (in bar)

  20. Tucker decomposition: ≈ Spectral cube Core tensor and 3 templates ~20M elements ~0.2M elements

  21. ≈

  22. ≈ VISIT POSTER 
 . . . y 
 m r e h v t e y . 
 . h a . o d r FOR BONUS SLIDES! t f n o e d u n e e o o d c s d n h e a a t n i t p w s O o n o i l

  23. ≈

  24. Bar 52 Bar 58 Bar 65

  25. Song: “Doin’ it Right” by Daft Punk Bar #60 Ingredients 
 for bar #60: Bar #60 A B C D E F G Bar 52 Bar 58 Bar 65

  26. https://unmixer.ongaaccel.jp Thank you! At our poster: • learn how loops are selected; • learn how “recipes” made more independent; • use the interface! This work was supported in part by JST ACCEL Grant Number JPMJAC1602, Japan.

Recommend

More recommend