About Who is talking to you? Christian SoundFlow founder workflow platform sound designer shortcuts developer automation film composer be more creative entrepreneur be more productive 2 www.soundflow.org
Overview About me, SoundFlow Challenges with AI + Sound today A case study: From idea to platform, AI as an automation component Takeaways
Challenges with AI + Sound What should the product be? ML API’s & SDK’s are bundled in cloud solutions Acquiring data => Cloud solutions favored Black box algorithms are not disruptive in and of themselves AI needs proper integration into workflows 4 www.soundflow.org
AI in linear, destructive Black Box Algorithms (noise reduction, dialogue processing) vs human/machine interaction NLP, speech recognition/synthesis (Siri, Cortana, Echo) vs non-linear, non-destructive metadata processing/automation (SoundFlow)
Coming up with the idea
The question : Why does using computer systems involve huge amounts of manual, repetitive work?
Itch to pitch Private alpha Start using it yourself Development More goal-oriented. The Itch This could be something. Start with something Experimenting that’s broken, annoying, stupid, Play around. Have Product Strategy unnecessary. fun. SoundFlow 8 www.soundflow.org
Itch to pitch Sound Designer: eyes off screen SoundFlow Shortcuts Musician: new Origin, Library, sounds Sound Designer, iPad Private alpha Designer Start using it yourself Development More goal-oriented. The Itch This could be something. Start with something Experimenting that’s broken, annoying, stupid, Play around. Have Product Strategy unnecessary. fun. SoundFlow 9 www.soundflow.org
From itch to product Continued use and development. Extending Early start Researching making First launch of techniques. Full into a product. SoundFlow internal product. Rewrite begins. 2012 2014 2016 2013 2015 First iPad integration, Danish Sound Day 2017 implementations creative uses, new 2011 ideas. 10 www.soundflow.org
Think Abstract... Thin, UI-layer positioned, hackable, pluggable, shareable, metadata consuming, AI-enhanced, user mimicking automation
User vs Many systems Users need to manually interact with all the different apps Pros: Cons: Each app is best at what it does Many interfaces to interact with Many manual steps to implement simple actions User No automated cross communication Difficult to get an overview Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 12 www.soundflow.org
User vs Smart connected apps Apps talk with each other, but user still needs to perform many manual tasks in different GUIs Pros: Cons: Each app is best at what it does Many interfaces to interact with The apps talk together Still many steps to implement simple actions User Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 13 www.soundflow.org
User vs Monolith User is interacting with a giant monolithic software system, but it doesn’t cover everything. Many surprises. Pros: Cons: One interface (hopefully) Quick obsolescence Slow development User One vendor needs to be best at everything Features + corner cases are dropped Monolithic software Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 14 www.soundflow.org
User vs SoundFlow User is interacting with systems through SoundFlow. Feels like one app, but they can independently grow. Pros: Cons: User Each app is best at what it does Only SoundFlow enabled workflows are The apps talk together supported Use whatever interface you prefer Only 1 user action per decision Feels like 1 app/vendor SoundFlow Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 15 www.soundflow.org
User vs SoundFlow + native User is interacting with systems through SoundFlow and directly Pros: Cons: User Each app is best at what it does The apps talk together Use whatever interface you prefer Only 1 user action per decision Access both to accelerated workflows and direct manipulation of underlying software SoundFlow Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 16 www.soundflow.org
1 user decision = 1 user interaction Interaction Output Input Decision 17 www.soundflow.org
All industries: Disruption Spreading our wings User / AI SoundFlow System A System B System C System D System E 18 www.soundflow.org
Drag + drop your own user interface People work differently 1 user decision = 1 user interaction That is only possible with custom tailored, dynamic user interfaces
Build your own hardware interface
AI vs SoundFlow User is interacting with systems through SoundFlow Pros: Cons: User Each app is best at what it does The apps talk together Use whatever interface you prefer Only 1 user action per decision AI The AI knows what the user knows (eyes+ears) while SF executes the actions (hands) SoundFlow Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 21 www.soundflow.org
AI Data strategy How will you acquire and store the data necessary to feed the machine learning algorithms? Analyzed User Data Metadata Actions taken data SF Cloud Manual ML insights Training 22 www.soundflow.org
Hackable + pluggable User PTX EDL UI Audio User MIDI Cloud iPad SoundFlow Analysis AI Macros User Wizards Algorithms Logic UI Keyboard Files Mouse Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 23 www.soundflow.org
SoundFlow Platform User PTX EDL UI Audio User MIDI Cloud iPad SoundFlow Analysis AI Macros User Wizards Algorithms Logic UI Keyboard Files Mouse Final Cut Pro X Avid MC Pro Tools iZotope RX VST plugins 24 www.soundflow.org
Thin, UI-layer positioned, hackable, pluggable, shareable, metadata consuming, AI-enhanced, user mimicking automation
What can we learn from this? - Don’t reinvent the wheel - someone else does this better. Make glue - Have a strategy for acquiring data (MVP product first) - Insist on cloud to collect data - Be lazy when you can. Use open source as much as possible + makes bleeding edge easier. - Quick iterations - Choose the right strategy for implementation, right technology, right data storage, right architecture (both quick prototyping/iteration, and scaling) - Employ external testers extensively - make others do the testing for you - Platform - make others do the work for you - Get out of the basement (Martin Thorborg) 26 www.soundflow.org
Recommend
More recommend