6 23 09
play

6/23/09 J-DSP: An Online DSP Laboratory Overview J-DSP J-DSP - PDF document

6/23/09 J-DSP: An Online DSP Laboratory Overview J-DSP J-DSP Editor Editor J-DSP blocks to generate, process and understand analog signals. Application of J-DSP to courses in Arts, Media and Engineering Department at Arizona State


  1. 6/23/09 J-DSP: An Online DSP Laboratory Overview J-DSP J-DSP Editor Editor  J-DSP blocks to generate, process and understand analog signals.  Application of J-DSP to courses in Arts, Media and Engineering Department at Arizona State University. Sponsored by NSF Awards 0817596, NSF-DUE-CCLI-080975 NSF Program CCLI Phase 3 Award Started Apr. 2008 – Apr. 2013 involves 8 universities Also core software used in an NSF CRCD 2004-2006 FIE WORK IN Mohit Shah 1 FIE WORK IN Mohit Shah 2 PROGRESS 2005 PROGRESS 2005 Analog Signal Generator Analog Signal Processing J-DSP J-DSP Editor Editor  Parameters  Linear combination of signals ◦ Signal Type – Sine, Square, Triangular, Exp. ◦ Amplitude ◦ Analog Frequency ◦ Phase  Output: A string symbolic representation of the chosen signal. ◦ For e.g. - 4sin(50t + 60) or 16exp(-20t) FIE WORK IN Mohit Shah 3 FIE WORK IN Mohit Shah 4 PROGRESS 2005 PROGRESS 2005 1

  2. 6/23/09 Analog Signal Processing (Contd.) Future Work J-DSP J-DSP Editor Editor  Sampling and Quantization  Extend the algorithm to allow the user to enter any expression mathematically, automatically parse the expression and generate the corresponding signal.  Expand the current library of blocks to include more blocks that help understand the behavior of analog signals. FIE WORK IN Mohit Shah 5 FIE WORK IN Mohit Shah 6 PROGRESS 2005 PROGRESS 2005 Arts, Media and Engineering Pitch Estimation J-DSP J-DSP Editor Editor  Track the fundamental frequency or pitch of a given  Sound Sensing and Analysis frame. ◦ Algorithms to extract important features from audio, speech signals or environmental sounds based on their content. ◦ Some examples of common features - • Pitch • Temporal Energy • Harmonicity • Spectral Centroid • Mel Frequency Cepstral Coefficients. • Tonality Index FIE WORK IN Mohit Shah 7 FIE WORK IN Mohit Shah 8 PROGRESS 2005 PROGRESS 2005 2

  3. 6/23/09 Harmonicity Spectral Centroid J-DSP J-DSP Editor Editor  Probabilistically measure whether the given frame  Indicates the location of the ‘center of mass’ of the exhibits a harmonic frequency structure or not. spectrum.  Harmonicity averaged over a number of frames is an  Perceptually gives an impression regarding the important feature to study environmental sounds. ‘brightness’ a given sound. FIE WORK IN Mohit Shah 9 FIE WORK IN Mohit Shah 10 PROGRESS 2005 PROGRESS 2005 Tonality Index Temporal Energy J-DSP J-DSP Editor Editor  Used in psychoacoustic models to determine whether a  Calculate the average energy of a given frame. Use given sound exhibits a tone-like or noise-like threshold to mark the frame as voiced or unvoiced. characteristic. FIE WORK IN Mohit Shah 11 FIE WORK IN Mohit Shah 12 PROGRESS 2005 PROGRESS 2005 3

  4. 6/23/09 Future Work Acknowledgements J-DSP J-DSP Editor Editor  Professor Andreas Spanias, ASU.  Integrate J-DSP with Processing to create interactive simulations and programs to aid interdisciplinary  Professor Michael Stiber, UWB. students in AME.  Assistant Professor Harvey Thornburg, AME, ASU.  National Science Foundation. Thank You FIE WORK IN Mohit Shah 13 FIE WORK IN Mohit Shah 14 PROGRESS 2005 PROGRESS 2005 4

Recommend


More recommend