Presentation - Signal Processing Group

4 downloads 4073 Views 4MB Size Report
Jul 6, 2015 - Real-time on iPhone 4S and iPad 2 (and later). Guitar and effects written in the FAUST language: • Full physically modeled electric-guitar + ...
Recent Developments in Signal Processing for Audio and Music Julius Orion Smith and Kurt James Werner CCRMA, Stanford University 2015 EURASIP Workshop on Recent Trends in Signal Processing (RTSP-2015) Cluj-Napoca, Romania July 6, 2015

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 1 / 44

Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture Summary

Outline

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 2 / 44

New Enabling Technologies 1. Music Tech Snapshot (Recent CCRMA Dissertations) Enabling Technologies CCRMA Research

• Analysis, Spatial Audio, Speech, Audio EEG, Music Information Retrieval, Source Separation, Perception, Interaction, Physical Modeling / Virtual Analog

Tablet Instruments Theory/Architecture Summary

2. Smart-Phones and Tablets

• High-quality audio in (mono) and out (stereo) • Fast multicore processors (exponentially growing speed) • Multitouch display screens (5 for iPhone, 11 for iPad) 3. Theory/Architecture Advances

• • • •

2D Bridge Modeling for Bowed Strings Scattering Delay Networks (SDN) Recent Virtual Analog Dissertations Recent Wave Digital Filter (WDF) research

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 3 / 44

Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture Summary

Recent CCRMA Research

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 4 / 44

Recent CCRMA Research Analysis name Jorge Herrera Craig Sapp Gregory Sell Woon Seung Yeo

year current 2011 2011 2007

Randal Leistikow

2006

Yi-Wen Liu

2005

dissertation title (or topic) “Computational Beat Tracking with Gradient Frequency Neural Networks” “Computational methods for the analysis of musical structure” “Diffusion-Based Music Analysis” “Raster Scanning: A New Approach to Image Sonification, Sound Visualization, Sound Analysis, and Synthesis” “Bayesian Modeling of Musical Expectations via Maximum Entropy Stochastic Grammars” “Audio Watermarking Through Parametric Signal Representation”

Spatial Audio name Franc¸ois Germain ¨ Erlach Bjorn Tim O’Brien Elliot Kermit-Canfield

year current current current current

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) (sound field reproduction) (microphone array) (spherical microphone array) (ambisonics)

RTSP-2015 – 5 / 44

Recent CCRMA Research

Speech name Jieun Oh Sook Young Won

year 2014 2014

Pamornpol Jinachitra Rodrigo Segnini

2007 2006

dissertation title (or topic) “Affective Analysis and Synthesis of Laughter” “Simulating how humans hear themselves vocalize: a two-parameter spectral model” “Robust Structured Voice Extractino for Flexible Expressive Resynthesis” “On the Vocalization of Non-Speech Sounds: Implicit Mechanisms and Musical Applications”

Audio EEG name ´ Roman ´ Iran Madeline Huberth Alexander Chechile Blair Kaneshiro

year current current current current

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) (neurological expectation / ERAN) (EEG / polyphony) (otoacoustic emissions) (harmony, meter, tempo; categorical representation)

RTSP-2015 – 6 / 44

Recent CCRMA Research Music Information Retrieval name Jeffrey Smith Juhan Nam Kyogu Lee

year 2014 2013 2007

Parag Chordia Unjung Nam

2006 2004

dissertation title (or topic) “Correlation Analysis of Encoded Music Performance” “Learning Feature Representations for Music Classification” “A System for Chord Transcription, Key Extraction, and Cadence Recognition from Audio Using Hidden Markov Models Trained with Audio-fromSymbolic Data” “Automatic Transcription of Solo Tabla Music” “A method of automatic recognition of structural boundaries in recorded musical signals”

Source Separation name Dennis Sun Nicholas Bryan Gautham Mysore

year current 2014 2010

Aaron Steven Master

2006

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) (nonnegative matrix factorization) “Interactive Sound Source Separation” “A Non-negative Framework for Joint Modeling of Spectral Structure and Temporal Dynamics in Sound Mixture” “Stereo Music Source Separation via Bayesian Modeling”

RTSP-2015 – 7 / 44

Recent CCRMA Research

Perception name Hyung-Suk Kim Emily Graber Kitty Shi Miriam Kolar Hiroko Terasawa Ryan James Cassidy

year current current current 2013 2009 2008

Matthew Wright

2007

Harvey Thornburg

2005

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) (musical texture) (timbre perception) (computational models of auditory perception and stream segregation) ´ “Archaeological Psychoacoustics at Chavin de Huantar, Peru” ´ “A hybrid model for timbre perception” “Auditory Signal Processing to Improve Impaired Listening Experiences via Efficient, Loudness-Based Algorithms” “The shape of an instant: measuring and modeling perceptual attack time with probability density functions (if a tree falls in the forest, when did 57 people hear it make a sound?)” “Detection and Modeling of Transient audio Signals with Prior Information”

RTSP-2015 – 8 / 44

Recent CCRMA Research

Interaction name Romain Michon John Granzow Spencer Salazar Luke Dahl Rob Hamilton

year current current current 2014 2014

Hongchan Choi

2014

Ed Berdahl Jonathan Norton

2009 2008

Ge Wang

2008

Lonny Chu

2004

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) (interfaces for real-time physical model control, 3D printing) (3D printing for acoustics) “Handwritten Computer Music Composition and Design” “Timing of Discrete Music Air-Gestures” “Perceptually Coherent Mapping Schemata for Virtual Space and Musical Method” “The Design of a collaborative music system: rethinking music creation and production platform through web technology” “Applications of Feedback Control to Musical Instrument Design” “Motion Capture To Build A Foundation For A Computer Controlled Instrument By Study Of Classical Guitar Performance” “The ChucK Audio Programming Language: A Strongly-timed and On-thefly Environ/mentality” “Haptic Interfaces for Audio Navigation”

RTSP-2015 – 9 / 44

Recent CCRMA Research Physical Modeling / Virtual Analog name Kurt James Werner

year current

Jack Perng David Yeh

2012 2009

Michale Gurevich Scott Van Duyne

2007 2007

Tim Stilson

2006

Patricio de la Cuadra

2006

Tamara Smyth

2004

Stefania Serafin

2004

Julius Orion Smith and Kurt James Werner

dissertation title (or topic) “Like an 808: Circuit Models and Analog Musicology of the TR-808, including Advances in Wave Digital Filter Theory” “Physical Modeling of the Harpsichord Plectrum-String Interaction” “Digital Implementation of Musical Distortion Circuits by Analysis and Simulation” “Computational Acoustic Modeling of Cetacean Vocalizations” “Digital Filtering Applications to Modeling Wave Propagation in Springs, Strings, Membranes, and Acoustical Space” “Efficiently-Variable Non-Oversampled Algorithms in Virtual-Analog Music Synthesis: a Root-Locus Perspective” “The sound of oscillating air jets: Physics, modeling, and simulation in flutelike instruments” “Applications of Bioacoustics to the Development of Musical Instrument Technology” “The sound of friction: real-time models, playability and musical applications”

RTSP-2015 – 10 / 44

Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture Summary

Smart-Phone/Tablet Example: moForte Guitar

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 11 / 44

moForte Guitar for iOS and (later) Android Enabling Technologies CCRMA Research Tablet Instruments

• moForte Guitar • CPU Performance • Sound Examples

Real-time on iPhone 4S and iPad 2 (and later) Guitar and effects written in the FAUST language:

• Full physically modeled electric-guitar + effects:

Theory/Architecture Summary

• • •

Six vibrating strings — general excitations Distortion Feedback Compression Wah pedal or Autowah Phaser Flanger Five-band parametric equalizer Reverb Responds to accelerometer, gyros, touches (plucks), swipes (strumming), . . . It is challenging to fully utilize five points of multitouch on the iPhone and eleven on the iPad! Android audio latency is still a significant issue

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 12 / 44

All These Guitar Effects Run in Real Time on the iPhone 4S or iPad 2 Enabling Technologies CCRMA Research Tablet Instruments

• moForte Guitar • CPU Performance • Sound Examples Theory/Architecture Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 13 / 44

CPU Performance in Phones Enabling Technologies CCRMA Research Tablet Instruments

• moForte Guitar • CPU Performance • Sound Examples Theory/Architecture Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 14 / 44

Distortion Guitar Sound Examples on a Tablet Enabling Technologies

GeoShred Demo

CCRMA Research Tablet Instruments

• moForte Guitar • CPU Performance • Sound Examples

• YouTube (./mov/GeoShredPreviewNAMM2015.mov)

Theory/Architecture Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 15 / 44

Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture Summary

Recent Theory/Architecture Advances

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 16 / 44

Overview Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

1. 2. 3. 4.

2D Bridge Modeling for Bowed Strings Scattering Delay Networks (SDN) Recent Virtual Analog Dissertations Recent Wave Digital Filter (WDF)research

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 17 / 44

2D Bridge Modeling for Bowed Strings Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

Reference: E. Maestre, G. P. Scavone, and J. O. Smith III, “Digital Modeling of String Instrument Bridge Reflectance and Body Radiativity for Sound Synthesis by Digital Waveguides,” 2015 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, New Paltz, NY, Oct. 18–21. See also SMAC-13 paper:

http://www.speech.kth.se/smac-smc-2013/

Summary

Two-dimensional Bridge Model Julius Orion Smith and Kurt James Werner

RTSP-2015 – 18 / 44

Scattering Delay Networks (SDN) Enabling Technologies

Tablet Instruments

˘ Z. Cvetkovi´c, and J. O. Smith III, Reference: E. De Sena, H. Hacıhabiboglu, “Efficient Synthesis of Room Acoustics via Scattering Delay Networks,” IEEE/ACM Trans. Audio, Speech, Language Process., vol. 23, no. 9, Sept. 2015.

Theory/Architecture

http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=7113826

CCRMA Research

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 19 / 44

Recent Virtual Analog Dissertations

name Tim Stilson

year 2006

David Yeh

2009

Kristjan Dempwolf ´ Jarom´ır Maˇcak, Rafael C. D. de Paiva Julian Parker Jussi Pekonen Stefan D’Angelo Kurt James Werner

2012 2012 2013 2013 2014 2014 2016(?)

Julius Orion Smith and Kurt James Werner

dissertation title “Efficiently-Variable Non-Oversampled Algorithms in Virtual-Analog Music Synthesis: a Root-Locus Perspective” “Digital Implementation of Musical Distortion Circuits by Analysis and Simulation” “Modellierung analoger Gitarrenverstrker mit digitaler Signalverarbeitung” “Real-Time Digital Simulation of Guitar Amplifiers as Audio Effects” “Circuit modeling studies related to guitars and audio processing” “Dispersive Systems in Musical Audio Signal Processing” “Filter-Based Oscillator Algorithms for Virtual Analog Synthesis” “Virtual Analog Modeling of Nonlinear Musical Circuits” “Like an 808: Circuit Models and Analog Musicology of the TR-808, including Advances in Wave Digital Filter Theory”

RTSP-2015 – 20 / 44

Wave Digital Filters Enabling Technologies

Wave Digital Filters (WDFs) work by:

CCRMA Research Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Port-wise consideration of Kirchhoff-domain circuit • Discretize reactive elements w/ Bilinear Transformation (BLT):

1 − z −1 s←c , 1 + z −1

c = 2/T or 1, typically

(1)

• Move into the wave domain, with incident wave an and reflected wave bn , incorporating arbitrary port resistance Rn , at each port

n an = v n + in Rn

(2)

bn = vn − in Rn

(3)

• Scattering matrices at every impedance mismatch (typically •

3-port series and parallel connections) Choose port resistances to cancel delay-free loops

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 21 / 44

Wave Digital Filters Enabling Technologies

We’ll review developments in nonlinear WDFs:

CCRMA Research Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

1. 2. 3. 4. 5. 6. 7. 8.

Single Nonlinearity Consolidated One-Port Combinations Cross-Controlled Multiport Simplified Multiports Linearized Piecewise Linear Models Iterative Schemes Topological Aspects

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 22 / 44

WDFs: Single Nonlinearity I Enabling Technologies

¨ Reference: K. Meerkotter and R. Scholz, “Digital simulation of nonlinear circuits by

CCRMA Research

wave digital filter principles,” Proc. IEEE Int. Symp. Circuits Syst. June 1989.

Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Accomodate ONE one-port NL element, e.g.:

◦ Ideal rectifier (ideal diode) ◦ Piecewise linear resistance

• Can view as lookup table with interpolation or piece-wise linear segments

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 23 / 44

WDFs: Single Nonlinearity II Enabling Technologies

¨ Reference: K. Meerkotter and R. Scholz, “Digital simulation of nonlinear circuits by

CCRMA Research

wave digital filter principles,” Proc. IEEE Int. Symp. Circuits Syst. June 1989.

Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 24 / 44

WDFs: Single Nonlinearity III Enabling Technologies

Reference: A. Sarti and G. De Sanctis, “Systematic methods for the

CCRMA Research

implementation of nonlinear wave-digital structures,” IEEE Trans. Circuits Syst. I:

Tablet Instruments

Reg. Papers, vol. 56, no. 2, pp. 460–472, 2009.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Binary connection tree (BCT)

• •



systematizes WDF with only series and parallel connections Up to one nonlinearity N -port series (parallel) implemented with N − 2 3-port adaptors see: A. Fettweis and K. ¨ Meerkotter, “On adaptors for wave digital filters,” 1975.

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 25 / 44

WDFs: Single Nonlinearity IV Enabling Technologies

Reference: A. Sarti and G. De Poli, “Toward nonlinear wave digital filters,” IEEE

CCRMA Research

Trans. Signal Process., vol. 47, no. 6, pp. 1654–1668, 1999.

Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Use “mutators” from classical





network theory to enable, e.g., nonlinear q –v relationships These are needed for nonlinear elements “with memory” For example, nonlinear capacitors and inductors where flux or charge can saturate

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 26 / 44

WDFs: One-Port Combinations I Enabling Technologies

Reference: D. T. Yeh and J. O. Smith III, “Simulating guitar distortion circuits using

CCRMA Research

wave digital and nonlinear state-space formulations,” Proc. Int. Conf. Digital Audio

Tablet Instruments

Effects (DAFx-08), pp. 19–26, 2008.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary



b−a = Is e 2R

a+b 2VT

   a+b − − 1 − Is e 2VT − 1

(4)

• Multiple nonlinearities



handled by combining into a single one-port Implicit nonlinear function solved as b = f (a) with numerical methods

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 27 / 44

WDFs: One-Port Combinations II Enabling Technologies

¨ aki, ¨ “Emulation Reference: R. C. D. Paiva, S. D’Angelo, J. Pakarinen, and V. Valim

CCRMA Research

of operational amplifiers and diodes in audio distortion circuits,” IEEE Tran. Circuits

Tablet Instruments

Syst. II: Expr. Briefs, vol. 59, no. 10, pp. 688-692, 2012.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

b = f (a) for diode pair solved using Lambert W function, assuming one diode dominates:



• One diode (Kirchhoff): i = Is e • One diode (wave, implicit): e

a+b 2VT

v VT

 −1

=

a−b 2RIs

+1

• One diode (wave, explicit):

b = f (a) = a + 2RIs − 2VT W

Summary



RIs VT e

RIs +a VT



• Diode pair (approx., assuming one diode dominates):

b = sgn(a) · f (|a|)

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 28 / 44

WDFs: One-Port Combinations III Enabling Technologies

Reference: K. J. Werner, V. Nangia, A. Bernardini, J. O. Smith III, and A. Sarti, “An

CCRMA Research

Improved and Generalized Diode Clipper Model for Wave Digital Filters,” Proc.

Tablet Instruments

Audio Eng. Soc. (AES), New York, NY, Oct.–Nov. 2015.

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

abs(reflected voltage wave (b) error)

Theory/Architecture

10 10 10 10 10 10

−8

−10

−12

Paiva Improved Model

−14

−16

−18

−10

Summary

−5 0 5 incident voltage wave (a)

10

Explicit b = f (a) model improved by cancelling some approximation error of Paiva et al. (2013) model with additional Lambert W term. Julius Orion Smith and Kurt James Werner

RTSP-2015 – 29 / 44

WDFs: One-Port Combinations IV Reference: K. J. Werner and J. O. Smith III, “An Energetic Interpretation of Enabling Technologies

Nonlinear Wave Digital Filter Lookup Table Error,” Proc. Int. Symp. Signals, Circuits,

CCRMA Research

Syst. (ISSCS), Iasi, Romani, July 2015.

Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

Linear secant interpolation and tangent extrapolation can be incrementally (gray) or globally (thatched) non-passive.

Summary

Choosing table points and secant/tangent properly (considering sgn(a) and a′′ ) yields interpolation methods that respect passivity. Julius Orion Smith and Kurt James Werner

RTSP-2015 – 30 / 44

WDFs: Cross-Control Multiport I Reference: M. Karjalainen and J. Pakarinen, “Wave digital simulation of a Enabling Technologies

vacuum-tube amplifier,” Proc. IEEE Int. Conf. Acoust., Speech Signal Process.

CCRMA Research Tablet Instruments

(ICASSP), Toulouse, France, May 14–19 2006.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Grid–Cathode voltage “cross-control” w/ ad-hoc delay to aid •

realizability. Refined in J. Pakarinen and M. Karjalainen, “Enhanced wave digital triode model for real-time tube amplifier emulation,” IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 4, pp. 738–746, May 2010.

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 31 / 44

WDFs: Cross-Control Multiport II Enabling Technologies

Reference: G. De Sanctis and A. Sarti, “Virtual analog modeling in the wave-digital

CCRMA Research

domain,” IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 4, pp.

Tablet Instruments

715–727, 2010.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Frame BJT as two-port nonlinear element • Two linear WDF subtrees • Emitter voltage VE proposed as “cross-control” on BJT

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 32 / 44

WDFs: Linearized Enabling Technologies

Reference: G. De Sanctis and A. Sarti, “Virtual analog modeling in the wave-digital

CCRMA Research

domain,” IEEE Trans. Audio, Speech, Language Process., vol. 18, no. 4, pp.

Tablet Instruments

715–727, 2010.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

• Proposes linearized Hybrid-π model of BJT • Three linear WDF subtrees

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 33 / 44

WDFs: Multiple NLE, Piecewise Linear Model I Enabling Technologies

Reference: S. Petrausch, R. Rabenstein, “Wave digital filters with multiple

CCRMA Research

nonlinearities,” Proc. European Signal Process. Conf. (EUSIPCO), vol. 12. Vienna,

Tablet Instruments

Austria, Sept. 2004.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Represent vector of nonlinear root elements with piecewise linear •

approximations Limited to vector parallel relationship between “internal” (a and b) and “external” (al and bl ) root ports

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 34 / 44

WDFs: Piecewise Linear Model II Enabling Technologies

Reference: A. Bernardini, K. J. Werner, A. Sarti, and J. O. Smith III, “Multi-Port

CCRMA Research

NonLinearities in Wave Digital Structures,” IEEE Int. Symp. Signals, Circuits, Syst.

Tablet Instruments

(ISSCS), Iasi, Romania, July 9–10 2015. 0.04

P − 1 = [i − 1, v − 1]

0.02 0.01 0 -0.01

P 0 = [0, 0]

0.03

voltage v (volts)

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

P 1 = [i 1 , v 1 ]

Theory/Architecture

line s e gme nt s v v v v

= = = =

λ 1 ( i) i + λ 0 ( i) i + λ − 1( i) i + λ − 2( i) i +

q 1 ( i) q 0 ( i) q − 1( i) q − 2( i)

-0.02 Shockley PWL approx.

-0.03

Summary

-1

-0.5

0

0.5 1 1.5 current i (amps)

2

2.5

3 -12

x 10

Addresses Petrausch & Rabenstein limit to vector parallel case for multiple one-port nonlinearities. Julius Orion Smith and Kurt James Werner

RTSP-2015 – 35 / 44

WDFs: Simplified Multiports Enabling Technologies

Reference: A. Bernardini, “Modeling NonLinear Circuits with Multi-Port Elements in

CCRMA Research

the Wave Digital Domain,” M. S. thesis, Politecnico di Milano, 2015.

Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

• Depending on operating



Summary



Julius Orion Smith and Kurt James Werner

point, transport across particular p–n junctions in a BJT can be reasonably neglected Introduces some approximation error, but renders equations tractable using the Lambert W , as in Paiva et al., 2013 Opportunities for treating feedback cases

RTSP-2015 – 36 / 44

WDFs: Iterative Schemes I Enabling Technologies

¨ aki, ¨ “New Family of Wave-Digital Reference: S. D’Angelo, J. Pakarinen, and V. Valim

CCRMA Research

Triode Models,” IEEE Trans. Audio, Speech, Language Process., vol. 21, no. 2, pp.

Tablet Instruments

313–321, 2013.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Entire triode nonlinearity contained in root element • Three linear WDF subtrees • Root solved with customized secant method (specific to triode model)

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 37 / 44

WDFs: Iterative Schemes II Enabling Technologies

Reference: T. Schwerdtfeger and A. Kummert, “A Multidimensional Approach to

CCRMA Research

Wave Digital Filters with Multiple Nonlinearities,” Proc. European Signal Process.

Tablet Instruments

Conf. (EUSIPCO), Lisbon, Portugal, Sept. 1–5 2014.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

• Multiple nonlinearities create delay-free loops • Resolved by inserting extra delay elements as second time • •

dimension (T2 ) Framed as extension to multidimensional case T2 solved by iteration

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 38 / 44

WDFs: Iterative Schemes III Enabling Technologies

Reference: T. Schwerdtfeger and A. Kummert, “A multidimensional signal

CCRMA Research

processing approach to wave digital filters with topology-related delay-free loops,”

Tablet Instruments

Proc. IEEE Int. Conf. Acoust., Speech, Signal Process. (ICASSP), Florence, Italy,

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

May 4–9 2014, pp. 389–393.

Same technique applied to topological problems in linear circuits (bridged-T).

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 39 / 44

WDFs: Topologically Problematic circuits Enabling Technologies

• Any circuit that can’t be decomposed completely into series and

CCRMA Research Tablet Instruments Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies

• • • •

parallel connections This includes some linear circuits Especially problematic for circuits with multiple or multiport nonlinearities Especially problematic for circuits with controlled sources (VCVS, VCCS, CCCS, CCVS, op-amps, etc.) in feedback configuration Issues arise in deceptively simple circuits (simple amplifiers, bridged-T, tone stack)

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 40 / 44

WDFs: Topological Insights Enabling Technologies

¨ Reference: D. Franken, J. Ochs, K. Ochs, “Generation of wave digital structures for

CCRMA Research

connection networks containing mutiport elements,” IEEE Trans. Circuits Syst. I:

Tablet Instruments

Reg. Papers, vol. 52, no. 3, pp. 586–596, 2005.

Theory/Architecture

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 41 / 44

WDFs: New Use of SPQR Tree Reference: K. J. Werner, V. Nangia, J. O. Smith III, and J. S. Abel, “A General and Enabling Technologies

Explicit Formulation for Wave Digital Filters with Multiple/Multiport Nonlinearities

CCRMA Research Tablet Instruments Theory/Architecture

and Complicated Topologies,” Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), New Paltz, NY, Oct. 18–21.

• Overview • 2D Bridge Modeling • Waveguide Reverb • recent VA diss. • WDF Overview • WDF: single NL • WDF: one-port NL • WDF: cross-control • WDF: linearized • WDF: PWL • Simplified Multiports • WDF: iterative • WDF: topologies Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 42 / 44

Enabling Technologies CCRMA Research Tablet Instruments Theory/Architecture Summary

Summary

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 43 / 44

Summary Enabling Technologies

1.

CCRMA Research Tablet Instruments Theory/Architecture Summary

2. 3.

Hardware advances enable efficient and complex implementations of older theory Software advances ease implementation effort and portability Theory advances continue to improve models and render elegant formulations (WDF) applicable to a wider class of reference systems

Thank you for listening! :)

http://ccrma.stanford.edu/~jos/pdf/RTSP-2015.pdf

Julius Orion Smith and Kurt James Werner

RTSP-2015 – 44 / 44