US20030055630A1 - Method and apparatus for a tunable high-resolution spectral estimator - Google Patents

Method and apparatus for a tunable high-resolution spectral estimator Download PDF

Info

Publication number
US20030055630A1
US20030055630A1 US10/162,182 US16218202A US2003055630A1 US 20030055630 A1 US20030055630 A1 US 20030055630A1 US 16218202 A US16218202 A US 16218202A US 2003055630 A1 US2003055630 A1 US 2003055630A1
Authority
US
United States
Prior art keywords
filter
signal
parameters
encoder
bank
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/162,182
Inventor
Christopher Byrnes
Anders Lindquist
Tryphon Georgiou
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Washington University in St Louis WUSTL
Original Assignee
Washington University in St Louis WUSTL
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Washington University in St Louis WUSTL filed Critical Washington University in St Louis WUSTL
Priority to US10/162,182 priority Critical patent/US20030055630A1/en
Publication of US20030055630A1 publication Critical patent/US20030055630A1/en
Assigned to NATIONAL SCIENCE FOUNDATION reassignment NATIONAL SCIENCE FOUNDATION CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS). Assignors: UNIVERSITY OF MINNESOTA
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/06Determination or coding of the spectral characteristics, e.g. of the short-term prediction coefficients
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/03Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters
    • G10L25/12Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 characterised by the type of extracted parameters the extracted parameters being prediction coefficients

Definitions

  • LPC Linear Predictive Code
  • FIG. 1 depicts the power spectrum of a sample signal, plotted in logarithmic scale.
  • LPC filter has power spectral density cannot match the “valleys,” or “notches,” in a power spectrum, or in a periodogram. For this reason encoding and decoding devices for signal transmission and processing which utilize LPC filter design result in a synthesized signal which is rather “flat,” reflecting the fact that the LPC filter is an “all-pole model.” Indeed, in the signal and speech processing literature it is widely appreciated that regeneration of human speech requires the design of filters having zeros, without which the speech will sound flat or artificial; see, e.g., [C. G. Bell, H. Fujisaaki, J. M. Heinz, K. N. Stevons and A. S.
  • Another feature of linear predictive coding is that the LPC filter reproduces a random signal with the same statistical parameters (covariance sequence) estimated from the finite window of observed data. For longer windows of data this is an advantage of the LPC filter, but for short data records relatively few of the terms of the covariance sequence can be computed robustly. This is a limiting factor of any filter which is designed to match a window of covariance data.
  • the method and apparatus we disclose here incorporates two features which are improvements over these prior art limitations: The ability to include “notches” in the power spectrum of the filter, and the design of a filter based instead on the more robust sequence of first covariance coefficients obtained by passing the observed signal through a bank of first order filters.
  • the desired notches and the sequence of (first-order) covariance data uniquely determine the filter parameters.
  • a filter a tunable high resolution estimator, or THREE filter
  • the desired notches and the natural frequencies of the bank of first order filters are tunable.
  • a choice of the natural frequencies of the bank of filters correspond to the choice of a band of frequencies within which one is most interested in the power spectrum, and can also be automatically tuned.
  • FIG. 3 depicts the power spectrum estimated from a particular choice of 4th order THREE filter for the same data used to generate the LPC estimate depicted in FIG. 2, together with the true power spectrum, depicted in FIG. 1, which is marked with a dotted line.
  • FIG. 4 depicts five runs of a signal comprised of the superposition of two sinusoids with colored noise, the number of sample points for each being 300.
  • FIG. 5 depicts the five corresponding periodograms computed with state-of-the-art windowing technology. The smooth curve represents the true power spectrum of the colored noise, and the two vertical lines the position of the sinusoids.
  • FIG. 6 depicts the five corresponding power spectra obtained through LPC filter design
  • FIG. 7 depicts the corresponding power spectra obtained through the THREE filter design
  • FIGS. 8, 9 and 10 show similar plots for power spectra estimated using state-of-the-art periodogram, LPC, and our invention, respectively. It is apparent that the invention disclosed herein is capable of resolving the two sinusoids, clearly delineating their position by the presence of two peaks. We also disclose that, even under ideal noise conditions the periodogram cannot resolve these two frequencies. In fact, the theory of spectral analysis [P. Stoica and R.
  • THREE filter design leads to a method and apparatus, which can be readily implemented in hardware or hardware/software with ordinary skill in the art of electronics, for spectral estimation of sinusoids in colored noise.
  • This type of problem also includes time delay estimation [M. A. Hasan and M. R. Asimi-Sadjadi, Separation of multiple time delays in using new spectral estimation schemes , IEEE Transactions on Signal Processing 46 (1998), 2618-2630] and detection of harmonic sets [M. Zeytino ⁇ haeck over (g) ⁇ lu and K. M. Wong, Detection of harmonic sets, IEEE Transactions on Signal Processing 43 (1995), 2618-2630], such as in identification of submarines and aerospace vehicles.
  • FIG. 1 is a graphical representation of the power spectrum of a sample signal
  • FIG. 2 is a graphical representation of the spectral estimate of the sample signal depicted in FIG. 1 as best matched with an LPC filter;
  • FIG. 3 is a graphical representation of the spectral estimate of the sample signal with true spectrum shown in FIG. 1 (and marked with dotted line here for comparison), as produced with the invention;
  • FIG. 4 is a graphical representation of five sample signals comprised of the superposition of two sinusoids with colored noise
  • FIG. 5 is a graphical representation of the five periodograms corresponding to the sample signals of FIG. 4;
  • FIG. 6 is a graphical representation of the five corresponding power spectra obtained through LPC filter design for the five sample signals of FIG. 4;
  • FIG. 7 is a graphical representation of the five corresponding power spectra obtained through the invention filter design
  • FIG. 8 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using periodogram;
  • FIG. 9 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using LPC design;
  • FIG. 10 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using the invention
  • FIG. 11 is a schematic representation of a lattice-ladder filter in accordance with the present invention.
  • FIG. 12 is a block diagram of a signal encoder portion of the present invention.
  • FIG. 13 is a block diagram of a signal synthesizer portion of the present invention.
  • FIG. 14 is a block diagram of a spectral analyzer portion of the present invention.
  • FIG. 15 is a block diagram of a bank of filters, preferably first order filters, as utilized in the encoder portion of the present invention.
  • FIG. 16 is a graphical representation of a unit circle indicating the relative location of poles for one embodiment of the present invention.
  • FIG. 17 is a block diagram depicting a speaker verification enrollment embodiment of the present invention.
  • FIG. 18 is a block diagram depicting a speaker verification embodiment of the present invention.
  • FIG. 19 is a block diagram of a speaker identification embodiment of the present invention.
  • FIG. 20 is a block diagram of a doppler-based speed estimator embodiment of the present invention.
  • FIG. 21 is a block diagram for a time delay estimator embodiment of the present invention.
  • the present invention of a THREE filter design retains two important advantages of linear predictive coding.
  • the specified parameters (specs) which appear as coefficients (linear prediction coefficients) in the mathematical description (transfer function) of the LPC filter can be computed by optimizing a (convex) entropy functional.
  • the circuit, or integrated circuit device, which implements the LPC filter is designed and fabricated using ordinary skill in the art of electronics (see, e.g., U.S. Pat. Nos. 4,209,836 and 5,048,088) on the basis of the specified parameters (specs).
  • the expression of the specified parameters is often conveniently displayed in a lattice filter representation of the circuit, containing unit delays z ⁇ 1 , summing junctions, and gains.
  • the design of the associated circuit is well within the ordinary skill of a routineer in the art of electronics.
  • this filter design has been fabricated by Texas Instruments, starting from the lattice filter representation (see, e.g., U.S. Pat. No. 4,344,148), and is used in the LPC speech synthesizer chips TMS 5100, 5200, 5220 (see e.g. D. Quarmby, Signal Processing Chips , Prentice-Hall, 1994, pages 27-29).
  • the lattice-ladder filter consists of gains, which are the parameter specs, unit delays z ⁇ 1 , and summing junctions and therefore can be easily mapped onto a custom chip or onto any programmable digital signal processor (e.g., the Intel 2920, the TMS 320, or the NEC 7720) using ordinary skill in the art; see, e.g. D. Quarmby, Signal Processing Chips , Prentice-Hall, 1994, pages 27-29.
  • gains are the parameter specs, unit delays z ⁇ 1 , and summing junctions and therefore can be easily mapped onto a custom chip or onto any programmable digital signal processor (e.g., the Intel 2920, the TMS 320, or the NEC 7720) using ordinary skill in the art; see, e.g. D. Quarmby, Signal Processing Chips , Prentice-Hall, 1994, pages 27-29.
  • the lattice-ladder filter representation is an enhancement of the lattice filter representation, the difference being the incorporation of the spec parameters denoted by ⁇ , which allow for the incorporation of zeros into the filter design.
  • the parameters ⁇ 0 , ⁇ 1 , . . . , ⁇ n ⁇ 1 are not the reflection coefficients (PARCOR parameters).
  • Tunable High Resolution Estimator Tunable High Resolution Estimator
  • the basic parts of the THREE are: the Encoder, the Signal Synthesizer, and the Spectral Analyzer.
  • the Encoder samples and processes a time signal (e.g., speech, radar, recordings, etc.) and produces a set of parameters which are made available to the Signal Synthesizer and the Spectral Analyzer.
  • the Signal Synthesizer reproduces the time signal from these parameters. From the same parameters, the Spectral Analyzer generates the power spectrum of the time-signal.
  • the THREE filter is tunable.
  • the tunable feature of the filter may be eliminated so that the invention incorporates in essence a high resolution estimator (HREE) filter.
  • HREE high resolution estimator
  • the default settings, or a priori information is used to preselect the frequencies of interest.
  • this a priori information is available and does not detract from the effective operation of the invention.
  • the tunable feature is not needed for these applications.
  • Another advantage of not utilizing the tunable aspect of the invention is that faster operation is achieved. This increased operational speed may be more important for some applications, such as those which operate in real time, rather than the increased accuracy of signal reproduction expected with tuning. This speed advantage is expected to become less important as the electronics available for implementation are further improved.
  • the intended use of the apparatus is to achieve one or both of the following objectives: (1) a time signal is analyzed by the Encoder and the set of parameters are encoded, and transmitted or stored. Then the Signal Synthesizer is used to reproduce the time signal; and/or (2) a time signal is analyzed by the Encoder and the set of parameters are encoded, and transmitted or stored. Then the Spectral Analyzer is used to identify the power spectrum of time signal over selected frequency bands.
  • A/D This is done in the box designated as A/D in FIG. 12.
  • This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, Speech Coding: A Computer Laboratory Textbook , John Wiley & Sons, New York, 1996].
  • the separation of window frames is decided by the Initializer/Resetter, which is Component 3 in FIG. 12.
  • the central component of the Encoder is the Filter Bank, given as component 1 . This consists of a collection of n+1 low-order filters, preferably first order filters, which process the observed time series in parallel.
  • the output of the Filter Bank consists of the individual outputs compiled into a time sequence of vectors [ ⁇ u 0 ⁇ ( t 0 ) u 1 ⁇ ( t 0 ) ⁇ u n ⁇ ( t 0 ) ⁇ ] , [ ⁇ u 0 ⁇ ( t 0 + 1 ) u 1 ⁇ ( t 0 + 1 ) ⁇ u n ⁇ ( t 0 + 1 ) ⁇ ] , ... ⁇ , [ ⁇ u 0 ⁇ ( N ) u 1 ⁇ ( N ) ⁇ u n ⁇ ( N ) ⁇ ] ( 2.2 )
  • these numbers can either be set to default values, determined automatically from the rules disclosed below, or tuned to desired values, using an alternative set of rules which are also disclosed below.
  • Component 2 in FIG. 12, indicated as Covariance Estimator, produces from the sequence u(t) in (2.2) a set of n+1 complex numbers
  • Component 5 designated as Excitation Signal Selection, refers to a class of procedures to be discussed below, which provide the modeling filter (Component 9 ) of the signal Synthesizer with an appropriate input signal.
  • Component 6 designated as MA Parameters in FIG. 12, refers to a class of procedures for determining n real numbers
  • the Signal Synthesizer The core component of the Signal Synthesizer is the Decoder, given as Component 7 in FIG. 13, and described in detail below. This component can be implemented in a variety of ways, and its purpose is to integrate the values w, p and r into a set of n+1 real parameters
  • Component 8 which is a standard modeling filter to be described below.
  • the modeling filter is driven by an excitation signal produced by Component 5 ′.
  • the Spectral Analyzer The core component of the Spectral Analyzer is again the Decoder, given as Component 7 in FIG. 14.
  • the output of the Decoder is the set of AR parameters used by the ARMA modeling filter (Component 10 ) for generating the power spectrum.
  • Two optional features are driven by the Component 10 .
  • Spectral estimates can be used to identify suitable updates for the MA parameters and/or updates of the Filter Bank parameters. The latter option may be exercised when, for instance, increased resolution is desired over an identified frequency band.
  • the filter-bank poles p 0 , p 1 , . . . , p n are available for tuning.
  • these filters process in parallel the input time series (2.1), each yielding an output U k satisfying the recursion
  • u 0 y. If p k is a real number, this is a standard first-order filter. If p k is complex,
  • the same second order filter (2.7) replaces two complex one-order filters.
  • the hardware implementation of such a filter bank is standard in the art.
  • [0066] can be done in a variety of ways.
  • c 0 ( u k ): c 0 ( ⁇ k ) ⁇ c 0 ( ⁇ k )+2i cov( ⁇ k , ⁇ k ),
  • Initializer/Resetter The purpose of this component is to identify and truncate portions of an incoming time series to produce windows of data (2.1), over which windows the series is stationary. This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, Speech Coding: A Computer Laboratory Textbook , John Wiley & Sons, New York, 1996]. At the beginning of each window it also initializes the states of the Filter Bank to zero, as well as resets summation buffers in the Covariance Estimator (Component 2 ).
  • the total number of elements in the filter bank should be at least equal to the number suggested earlier, e.g., two times the number of formants expected in the signal plus two.
  • a THREE filter is determined by the choice of filter-bank poles and a choice of MA parameters.
  • Excitation Signal Selection An excitation signal is needed in conjunction with the time synthesizer and is marked as Component 5′.
  • the generic choice of white noise may be satisfactory, but in general, and especially in speech it is a standard practice in vocoder design to include a special excitation signal selection.
  • This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, Speech Coding: A Computer Laboratory Textbook , John Wiley & Sons, New York, 1996, page 101 and pages 129-132] when applied to LPC filters and can also be implemented for general digital filters.
  • the general idea adapted to our situation requires the following implementation.
  • Component 5 in FIG. 12 includes a copy of the time synthesizer. That is, it receives as input the values w, p, and r, along with the time series y. It generates the coefficients a of the ARMA model precisely as the decoding section of the time synthesizer. Then it processes the time series through a filter which is the inverse of this ARMA modeling filter. The “approximately whitened” signal is compared to a collection of stored excitation signals. A code identifying the optimal matching is transmitted to the time synthesizer. This code is then used to retrieve the same excitation signal to be used as an input to the modeling filter (Component 9 in FIG. 13).
  • Excitation signal selection is not needed if only the frequency synthesizer is used.
  • the MA parameters can either be directly tuned using special knowledge of spectral zeros present in the particular application or set to a default value. However, based on available data (2.1), the MA parameter selection can also be done on-line, as described in Appendix A.
  • Decoder Given p, w, and r, the Decoder determines n+1 real numbers
  • ⁇ ( z ): a 0 z n +a 1 z n ⁇ 1 + . . . +a n
  • [0099] has all its roots less than one in absolute value. This is done by solving a convex optimization problem via an algorithm presented in papers C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A generalized entropy criterion for Nevanlinna - Pick interpolation: A convex optimization approach to certain problems in systems and control , preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to Spectral Estimation: A tunable high - resolution spectral estimator , preprint.
  • r 1 , r 2 , . . . , r n are the MA parameters delivered by Component 6 (as for the Signal Synthesizer) or Component 6′ (in the Spectral Analyzer) and a 0 , a 1 , . . . , a n delivered from the Decoder (Component 7 )
  • Component 6 as for the Signal Synthesizer
  • Component 6′ in the Spectral Analyzer
  • a 0 , a 1 , . . . , a n delivered from the Decoder Component 7
  • This can be done in many different ways [L. A. Chua, C. A. Desoer and E. S. Kuh, Linear and Nonlinear Circuits , McGraw-Hill, 1989], depending on desired filter architecture.
  • a filter design which is especially suitable for an apparatus with variable dimension is the lattice-ladder architecture depicted in FIG. 11.
  • [0104] are chosen in the following way.
  • ARMA filter An ARMA modeling filter consists of gains, unit delays z ⁇ 1 , and summing junctions, and can therefore easily be mapped onto a custom chip or any programmable digital signal processor using ordinary skill in the art.
  • Spectral plotter [0108] Spectral plotter.
  • This evaluation can be efficiently computed using standard FFT transform [P. Stoica and R. Moses, Introduction to Spectral Anqalysis, Prentice-Hall, 1997].
  • Decoder Algorithms We now disclose the algorithms used for the Decoder.
  • the input data consists of
  • [0117] has all its roots less than one in absolute value, such that ⁇ ⁇ ⁇ ( ⁇ ⁇ ) ⁇ ⁇ ( ⁇ ⁇ ) ⁇ 2
  • the required b is obtained by removing the last component of the (n+1)-vector R - 1 ⁇ [ 0 x ] ,
  • N (I ⁇ P o P c ) ⁇ 1 ,
  • h 0 (2) 0
  • h 0 (3) 0
  • ⁇ circumflex over ( ⁇ ) ⁇ ( z ) ⁇ circumflex over ( ⁇ ) ⁇ 0 z n + ⁇ circumflex over ( ⁇ ) ⁇ 1 z n ⁇ 1 + . . . + ⁇ circumflex over ( ⁇ ) ⁇ n ,
  • ⁇ circumflex over ( ⁇ ) ⁇ ( z ) ⁇ circumflex over ( ⁇ ) ⁇ 0 z n + ⁇ circumflex over ( ⁇ ) ⁇ 1 z n ⁇ 1 + . . . + ⁇ circumflex over ( ⁇ ) ⁇ n .
  • ⁇ c (Z) is the ⁇ -polynomial obtained by first running the algorithm for the central solution described above.
  • the vector (3.13) is the quantity on which iterations are made in order to update ⁇ (z). More precisely, a convex function J(q) presented in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A generalized entropy criterion for Nevanlina - Pick interpolation: A convex optimization approach to certain problems in systems and control , preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to spectral estimation: A tunable high - resolution spectral estimator , preprint, is minimized recursively over the region where
  • ⁇ ( z ) ⁇ ( z ⁇ 1 ) ⁇ 0 + ⁇ 1 (z+z ⁇ 1 )+ ⁇ 2 ( z 2 +z ⁇ 2 )+ . . . + ⁇ n ( z n +z ⁇ n ).
  • ⁇ *( z ) ⁇ n z n + ⁇ n ⁇ 1 z n ⁇ 1 + . . . + ⁇ 1 z +1.
  • is the companion matrix (formed analogously to A in (3. 10)) of the polynomial ⁇ (z) 2 and ⁇ is the 2n row vector (0, 0, . . . , 0, 1) .
  • is the companion matrix (formed analogously to A in (3. 10)) of the polynomial ⁇ (z) 2 and ⁇ is the 2n row vector (0, 0, . . . , 0, 1) .
  • is the companion matrix (formed analogously to A in (3.10)) of the polynomial ⁇ (z) 2 ⁇ (z) and ⁇ tilde over (c) ⁇ is the 3n row vector (0, 0, . . . , 0, 1).
  • H 2 ⁇ H 1 + H 2 + H 2 ′ ⁇ ⁇
  • H 1 L n ⁇ M ⁇ ( ⁇ ) ⁇ L ⁇ ( ⁇ 2 ) - 1 ⁇ [ P ⁇ 0 0 1 ] ⁇ L ⁇ ( ⁇ 2 ) - 1 ⁇ M ⁇ ( ⁇ ) ′ ⁇ L n
  • H 2 L n ⁇ M ⁇ ( ⁇ * ⁇ ) ⁇ L ⁇ ( ⁇ 2 ⁇ ⁇ ) - 1 ⁇ [ P ⁇ 0 0 1 ] ⁇ L ⁇ ( ⁇ 2 ⁇ ) - 1 ⁇ M ⁇ ( ⁇ ) ′ ⁇ L ⁇ n (3.24)
  • Step 2 In this step a line search in the search direction d is performed.
  • an updated value for a is obtained by determining the polynomial (3.4) with all roots less than one in absolute value, satisfying
  • ⁇ ( z ) ⁇ ( z ⁇ 1 ) ⁇ ( z ) ⁇ ( z ⁇ 1 )+ ⁇ ( z ⁇ 1 ) ⁇ ( z )
  • This factorization can be performed if and only if q(z) satisfies condition (3.15). If this condition fails, this is determined in the factorization procedure, and then the value of ⁇ is scaled down by a factor of c 4 , and (3.26) is used to compute a new value for h new and then of q(z) successfully until condition (3.15) is met.
  • Routine q2a which is used to perform the technical step of factorization described in Step 2 . More precisely, given q(z) we need to compute a rational function a(z) such that
  • a ( z ) c ( zI ⁇ A ) ⁇ 1 ( g ⁇ APc ′)/ ⁇ square root ⁇ square root over (2 h 0 ⁇ cPc ′) ⁇ +. ⁇ square root ⁇ square root over (2 h 0 ⁇ cPc ′) ⁇ .
  • Routine central which computes the central solution as described above.
  • Routine decoder which integrates the above and provides the complete function for the decoder of the invention.
  • speaker verification the person to be identified claims an identity, by for example presenting a personal smart card, and then speaks into an apparatus that will confirm or deny this claim.
  • speaker identification the person makes no claim about his identity, and the system must decide the identity of the speaker, individually or as part of a group of enrolled people, or decide whether to classify the person as unknown.
  • each person to be identified must first enroll into the system.
  • the enrollment or training is a procedure in which the person's voice is recorded and the characteristic features are extracted and stored.
  • a feature set which is commonly used is the LPC coefficients for each frame of the speech signal, or some (nonlinear) transformation of these [Jarna M. Naik, Speaker Verification: A tutorial , IEEE Communications Magazine, January 1990, page 43], [Joseph P. Campbell Jr., Speaker Recognition: A tutorial , Proceedings of the IEEE 85 (1997), 1436-1462], [Sadaoki Furui, recent advances in Speaker Recognition, Lecture Notes in Computer Science 1206, 1997, page 239].
  • the vocal tract can be modeled using a LPC filter and that these coefficients are related to the anatomy of the speaker and are thus speaker specific.
  • the LPC model assumes a vocal tract excited at a closed end, which is the situation only for voiced speech. Hence it is common that the feature selection only processes the voiced segments of the speech [Joseph P. Campbell Jr., Speaker Recognition: A tutorial , Proceedings of the IEEE 85 (1997), page 1455]. Since the THREE filter is more general, other segments can also be processed, thereby extracting more information about the speaker.
  • Speaker recognition can further be divided into text-dependent and text-independent methods. The distinction between these is that for text-dependent methods the same text or code words are spoken for enrollment and for recognition, whereas for text-independent methods the words spoken are not specified.
  • the pattern matching the procedure of comparing the sequence of feature vectors with the corresponding one from the enrollment, is performed in different ways.
  • the procedures for performing the pattern matching for text-dependent methods can be classified into template models and stochastic models.
  • a template model as the Dynamic Time Warping (DTW) [Hiroaki Sakoe and Seibi Chiba, Dynamic Programming Algorithm Optimization for Spoken Word Recognition , IEEE Transactions on Acoustics, Speech and Signal Processing ASSP-26 (1978), 43-49] one assigns to each frame of speech to be tested a corresponding frame from the enrollment.
  • DTW Dynamic Time Warping
  • HMM Hidden Markov Model
  • FIG. 17 depicts an apparatus for enrollment.
  • An enrollment session in which certain code words are spoken by a person later to be identified produces via this apparatus a list of speech frames and their corresponding MA parameters r and AR parameters a, and these triplets are stored, for example, on a smart card, together with the filter-bank parameters p used to produce them.
  • the information encoded on the smart card (or equivalent) is speaker specific.
  • the person inserts his smart card in a card reader and speaks the code words into an apparatus as depicted in FIG. 18.
  • each frame of the speech is identified. This is done by any of the pattern matching methods mentioned above.
  • FIG. 19 depicts an apparatus for speaker identification. It works like that in FIG. 17 except that there is a frame identification box (Box 12) as in FIG. 18, the output of which together with the MA parameters a and AR parameters a are fed into a data base. The feature triplets are compared to the corresponding triplets for the population of the database and a matching score is given to each. On the basis of the (weighted) sum of the matching scores of each frame the identity of the speaker is decided.
  • ⁇ 1 , ⁇ 2 , . . . , ⁇ m are the Doppler frequencies
  • ⁇ (t) is the measurement noise
  • ⁇ 1 , ⁇ 2 , . . . , ⁇ m are (complex) amplitudes.
  • is the pulse repetition interval, assuming once-per-pulse coherent in-phase/quadrature sampling.
  • FIG. 20 illustrates a Doppler radar environment for our method, which is based on the Encoder and Spectral Analyzer components of the THREE filter.
  • To estimate the velocities amounts to estimating the Doppler frequencies which appear as spikes in the estimated spectrum, as illustrated in FIG. 7.
  • the device is tuned to give high resolution in the particular frequency band where the Doppler frequencies are expected.
  • the dotted lines can be replaced by solid (open) communication links, which then transmit the tuned values of the MA parameter sequence r from Box 6 to Box 7 ′ and Box 10 .
  • Tunable high-resolution time-delay estimator The use of THREE filter design in line spectra estimation also applies to time delay estimation [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes , IEEE Transactions on Signal Processing 46 (1998), 2618-2630] [M. Zeytino ⁇ haeck over (g) ⁇ lu and K. M. Wong, Detection of harmonic sets , IEEE Transactions on Signal Processing 43 (1995), 2618-2630] in communication. Indeed, the tunable resolution of THREE filters can be applied to sonar signal analysis, for example the identification of time-delays in underwater acoustics [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes , IEEE Transactions on Signal Processing 46 (1998), 2618-2630].
  • FIG. 21 illustrates a possible time-delay estimator environment for our method, which has precisely the same THREE-filter structure as in FIG. 20 except for the preprocessing of the signal.
  • this adaptation of THREE filter design is a consequence of Fourier analysis, which gives a method of interchanging frequency and time.
  • the first term is a sum of convolutions of delayed copies of the emitted signal and v(t) represents ambient noise and measurement noise.
  • THREE filter method and apparatus can be used in the encoding and decoding of signals more broadly in applications of digital signal processing.
  • THREE filter design could be used as a part of any system for speech compression and speech processing.
  • the use of THREE filter design line spectra estimation also applies to detection of harmonic sets [M. Zeytino ⁇ haeck over (g) ⁇ lu and K. M. Wong, Detection of harmonic sets , IEEE Transactions on Signal Processing 43 (1995), 2618-2630].
  • Other areas of potential importance include identification of formants in speech and data decimation [M. A. Hasan and M. R.
  • the fixed-mode THREE filter where the values of the MA parameters are set at the default values determined by the filter-bank poles also possesses a security feature because of its fixed-mode feature: If both the sender and receiver share a prearranged set of filter-bank parameters, then to encode, transmit and decode a signal one need only encode and transmit the parameters w generated by the bank of filters. Even in a public domain broadcast, one would need knowledge of the filter-bank poles to recover the transmitted signal.

Abstract

A tunable high resolution spectral estimator is disclosed as a method and apparatus for encoding and decoding signals, signal analysis and synthesis, and for performing high resolution spectral estimation. The invention is comprised of an encoder coupled with either or both of a signal synthesizer and a spectral analyzer. The encoder processes a frame of a time-based input signal by passing it through a bank of lower order filters and estimating a plurality of lower order covariances from which a plurality of filter parameters may be determined. Coupled to the encoder, through any appropriate data link or interface including telecommunication links, is one or both of a signal synthesizer and a spectral analyzer. The signal synthesizer includes a decocer for processing the covariances and a parameter transformer. The signal synthesizer includes a decoder for processing the covariances and a parameter transformer for determining filter parameters for an ARMA filter. An excitation signal is processed through the ARMA filter to reproduce, or synthesize, a representation of the input filter. The spectral analyzer also includes a decoder which processes the covariances for input to a spectral plotter to detemine the power frequency spectrum of the input signal. The invention may be used in a myriad of applications including voice identification, doppler-based radar speed estimation, time delay estimation, and others.

Description

    BACKGROUND OF THE INVENTION
  • We disclose a new method and apparatus for encoding and decoding signals and for performing high resolution spectral estimation. Many devices used in communications employ such devices for data compression, data transmission and for the analysis and processing of signals. The basic capabilities of the invention pertain to all areas of signal processing, especially for spectral analysis based on short data records or when increased resolution over desired frequency bands is required. One such filter frequently used in the art is the Linear Predictive Code (LPC) filter. Indeed, the use of LPC filters in devices for digital signal processing (see, e.g., U.S. Pat. Nos. 4,209,836 and 5,048,088 and D. Quarmby, [0001] Signal Processing Chips, Prentice Hall, 1994, and L. R. Rabiner, B. S. Atal, and J. L. Flanagan, Current methods of digital speech processing, Selected Topics in Signal Processing (S. Haykin, editor), Prentice Hall, 1989, 112-132) is pertinent prior art to the alternative which we shall disclose.
  • We now describe this available art, the difference between the disclosed invention and this prior art, and the principal advantages of the disclosed invention. FIG. 1 depicts the power spectrum of a sample signal, plotted in logarithmic scale. [0002]
  • We have used standard methods known to those of ordinary skill in the art to develop a 4th order LPC filter from a finite window of this signal. The power spectrum of this LPC filter is depicted in FIG. 2. [0003]
  • One disadvantage of the prior art LPC filter is that its power spectral density cannot match the “valleys,” or “notches,” in a power spectrum, or in a periodogram. For this reason encoding and decoding devices for signal transmission and processing which utilize LPC filter design result in a synthesized signal which is rather “flat,” reflecting the fact that the LPC filter is an “all-pole model.” Indeed, in the signal and speech processing literature it is widely appreciated that regeneration of human speech requires the design of filters having zeros, without which the speech will sound flat or artificial; see, e.g., [C. G. Bell, H. Fujisaaki, J. M. Heinz, K. N. Stevons and A. S. House, [0004] Reduction of Speech Spectra by Analysis-by-Synthesis Techniques, J. Acoust. Soc. Am. 33 (1961), page 1726], [J. D. Markel and A. H. Gray, Linear Prediction of Speech, Springer Verlag, Berlin, 1976, pages 271-272], [L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals, Prentice-Hall, Englewood Cliffs, N.J., 1978, pages 105, 76-78]. Indeed, while all pole filters can reproduce much of human speech sounds, the acoustic theory teaches that nasals and fricatives require both zeros and poles [J. D. Markel and A. H. Gray, Linear Prediction of Speech, Springer Verlag, Berlin, 1976, pages 271-272], [L. R. Rabiner and R. W. Schafer, Digital Processing of Speech Signals, Prentice-Hall, Englewood Cliffs, N.J., 1978, page 105]. This is related to the technical fact that the LPC filter only has poles and has no transmission zeros. To say that a filter has a transmission zero at a frequency ζ is to say that the filter, or corresponding circuit, will absorb damped periodic signals which oscillate at a frequency equal to the phase of ζ and with a damping factor equal to the modulus of ζ. This is the well-known blocking property of transmission zeros of circuits, see for example [L. O. Chua, C. A. Desoer and E. S. Kuh, Linear and Nonlinear Circuits, McGraw-Hill, 1989, page 659]. This is reflected in the fact, illustrated in FIG. 2, that the power spectral density of the estimated LPC filter will not match the power spectrum at “notches,” that is, frequencies where the observed signal is at its minimum power. Note that in the same figure the true power spectrum is indicated by a dotted line for comparison.
  • Another feature of linear predictive coding is that the LPC filter reproduces a random signal with the same statistical parameters (covariance sequence) estimated from the finite window of observed data. For longer windows of data this is an advantage of the LPC filter, but for short data records relatively few of the terms of the covariance sequence can be computed robustly. This is a limiting factor of any filter which is designed to match a window of covariance data. The method and apparatus we disclose here incorporates two features which are improvements over these prior art limitations: The ability to include “notches” in the power spectrum of the filter, and the design of a filter based instead on the more robust sequence of first covariance coefficients obtained by passing the observed signal through a bank of first order filters. The desired notches and the sequence of (first-order) covariance data uniquely determine the filter parameters. We refer to such a filter as a tunable high resolution estimator, or THREE filter, since the desired notches and the natural frequencies of the bank of first order filters are tunable. A choice of the natural frequencies of the bank of filters correspond to the choice of a band of frequencies within which one is most interested in the power spectrum, and can also be automatically tuned. FIG. 3 depicts the power spectrum estimated from a particular choice of 4th order THREE filter for the same data used to generate the LPC estimate depicted in FIG. 2, together with the true power spectrum, depicted in FIG. 1, which is marked with a dotted line. [0005]
  • We expect that this invention will have application as an alternative for the use of LPC filter design in other areas of signal processing and statistical prediction. In particular, many devices used in communications, radar, sonar and geophysical seismology contain a signal processing apparatus which embodies a method for estimating how the total power of a signal, or (stationary) data sequence, is distributed over frequency, given a finite record of the sequence. One common type of apparatus embodies spectral analysis methods which estimate or describe the signal as a sum of harmonics in additive noise [P. Stoica and R. Moses, [0006] Introduction to Spectral Analysis, Prentice-Hall, 1997, page 139]. Traditional methods for estimating such spectral lines are designed for either white noise or no noise at all and can illustrate the comparative effectiveness of THREE filters with respect to both non-parametric and parametric based spectral estimation methods for the problem of line spectral estimation. FIG. 4 depicts five runs of a signal comprised of the superposition of two sinusoids with colored noise, the number of sample points for each being 300. FIG. 5 depicts the five corresponding periodograms computed with state-of-the-art windowing technology. The smooth curve represents the true power spectrum of the colored noise, and the two vertical lines the position of the sinusoids.
  • FIG. 6 depicts the five corresponding power spectra obtained through LPC filter design, while FIG. 7 depicts the corresponding power spectra obtained through the THREE filter design. FIGS. 8, 9 and [0007] 10 show similar plots for power spectra estimated using state-of-the-art periodogram, LPC, and our invention, respectively. It is apparent that the invention disclosed herein is capable of resolving the two sinusoids, clearly delineating their position by the presence of two peaks. We also disclose that, even under ideal noise conditions the periodogram cannot resolve these two frequencies. In fact, the theory of spectral analysis [P. Stoica and R. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997, page 33] teaches that the separation of the sinusoids is smaller than the theoretically possible distance that can be resolved by the periodogram using a 300 point record under ideal noise conditions, conditions which are not satisfied here. This example represents a typical situation in applications.
  • The broader technology of the estimation of sinusoids in colored noise has been regarded as difficult [B. Porat, Digital [0008] Processing of Random Signals, Prentice-Hall, 1994, pages 285-286]. The estimation of sinusoids in colored noise using autoregressive moving-average filters, or ARMA models, is desirable in the art. As an ARMA filter, the THREE filter therefore possesses “super-resolution” capabilities [P. Stoica and R. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997, page 136].
  • We therefore disclose that the THREE filter design leads to a method and apparatus, which can be readily implemented in hardware or hardware/software with ordinary skill in the art of electronics, for spectral estimation of sinusoids in colored noise. This type of problem also includes time delay estimation [M. A. Hasan and M. R. Asimi-Sadjadi, [0009] Separation of multiple time delays in using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630] and detection of harmonic sets [M. Zeytino{haeck over (g)}lu and K. M. Wong, Detection of harmonic sets, IEEE Transactions on Signal Processing 43 (1995), 2618-2630], such as in identification of submarines and aerospace vehicles. Indeed, those applications where tunable resolution of a THREE filter will be useful include radar and sonar signal analysis, and identification of spectral lines in doppler-based applications [P. Stoica and R. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997, page 248]. Other areas of potential importance include identification of formants in speech, data decimation [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630], and nuclear magnetic resonance.
  • We also disclose that the basic invention could be used as a part of any system for speech compression and speech processing. In particular, in certain applications of speech analysis, such as speaker verification and speech recognition, high quality spectral analysis is needed [Joseph P. Campbell, Jr., [0010] Speaker Recognition: A tutorial, Proceedings of the IEEE 85 (1997), 1436-1463], [Jayant M. Naik, Speaker Verification: A tutorial, IEEE Communications Magazine, January 1990, 42-48], [Sadaoki Furui, Recent advances in Speaker Recognition, Lecture Notes in Computer Science 1206, 1997, 237-252], [Hiroaki Sakoe and Seibi Chiba, Dynamic Programming Altorithm Optimization for Spoken Word Recognition, IEEE Transactions on Acoustics, Speech and Signal Processing ASSP-26 (1978), 43-49]. The tuning capabilities of the device should prove especially suitable for such applications. The same holds for analysis of biomedical signals such as EMG and EKG signals.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a graphical representation of the power spectrum of a sample signal; [0011]
  • FIG. 2 is a graphical representation of the spectral estimate of the sample signal depicted in FIG. 1 as best matched with an LPC filter; [0012]
  • FIG. 3 is a graphical representation of the spectral estimate of the sample signal with true spectrum shown in FIG. 1 (and marked with dotted line here for comparison), as produced with the invention; [0013]
  • FIG. 4 is a graphical representation of five sample signals comprised of the superposition of two sinusoids with colored noise; [0014]
  • FIG. 5 is a graphical representation of the five periodograms corresponding to the sample signals of FIG. 4; [0015]
  • FIG. 6 is a graphical representation of the five corresponding power spectra obtained through LPC filter design for the five sample signals of FIG. 4; [0016]
  • FIG. 7 is a graphical representation of the five corresponding power spectra obtained through the invention filter design; [0017]
  • FIG. 8 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using periodogram; [0018]
  • FIG. 9 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using LPC design; [0019]
  • FIG. 10 is a graphical representation of a power spectrum estimated from a time signal with two closely spaced sinusoids (marked by vertical lines), using the invention; [0020]
  • FIG. 11 is a schematic representation of a lattice-ladder filter in accordance with the present invention; [0021]
  • FIG. 12 is a block diagram of a signal encoder portion of the present invention; [0022]
  • FIG. 13 is a block diagram of a signal synthesizer portion of the present invention; [0023]
  • FIG. 14 is a block diagram of a spectral analyzer portion of the present invention; [0024]
  • FIG. 15 is a block diagram of a bank of filters, preferably first order filters, as utilized in the encoder portion of the present invention; [0025]
  • FIG. 16 is a graphical representation of a unit circle indicating the relative location of poles for one embodiment of the present invention; [0026]
  • FIG. 17 is a block diagram depicting a speaker verification enrollment embodiment of the present invention; [0027]
  • FIG. 18 is a block diagram depicting a speaker verification embodiment of the present invention; [0028]
  • FIG. 19 is a block diagram of a speaker identification embodiment of the present invention; [0029]
  • FIG. 20 is a block diagram of a doppler-based speed estimator embodiment of the present invention; and [0030]
  • FIG. 21 is a block diagram for a time delay estimator embodiment of the present invention.[0031]
  • The present invention of a THREE filter design retains two important advantages of linear predictive coding. The specified parameters (specs) which appear as coefficients (linear prediction coefficients) in the mathematical description (transfer function) of the LPC filter can be computed by optimizing a (convex) entropy functional. Moreover, the circuit, or integrated circuit device, which implements the LPC filter is designed and fabricated using ordinary skill in the art of electronics (see, e.g., U.S. Pat. Nos. 4,209,836 and 5,048,088) on the basis of the specified parameters (specs). For example, the expression of the specified parameters (specs) is often conveniently displayed in a lattice filter representation of the circuit, containing unit delays z[0032] −1, summing junctions, and gains. The design of the associated circuit is well within the ordinary skill of a routineer in the art of electronics. In fact, this filter design has been fabricated by Texas Instruments, starting from the lattice filter representation (see, e.g., U.S. Pat. No. 4,344,148), and is used in the LPC speech synthesizer chips TMS 5100, 5200, 5220 (see e.g. D. Quarmby, Signal Processing Chips, Prentice-Hall, 1994, pages 27-29).
  • In order to incorporate zeros as well as poles into digital filter models, it is customary in the prior art to use alternative architectures, for example the lattice-ladder architecture [K. J. Åström, [0033] Evaluation of quadratic loss functions for linear systems, in Fundamentals of Discrete-time systems: A tribute to Professor Eliahu I. Jury, M. Jamshidi, M. Mansour, and B.D.O. Anderson (editors), IITSI Press, Albuquerque, N. Mex., 1993, pp. 45-56] depicted in FIG. 11.
  • As for the lattice representation of the LPC filter, the lattice-ladder filter consists of gains, which are the parameter specs, unit delays z[0034] −1, and summing junctions and therefore can be easily mapped onto a custom chip or onto any programmable digital signal processor (e.g., the Intel 2920, the TMS 320, or the NEC 7720) using ordinary skill in the art; see, e.g. D. Quarmby, Signal Processing Chips, Prentice-Hall, 1994, pages 27-29. We observe that the lattice-ladder filter representation is an enhancement of the lattice filter representation, the difference being the incorporation of the spec parameters denoted by β, which allow for the incorporation of zeros into the filter design. In fact, the lattice filter representation of an all-pole filter can be designed from the lattice-ladder filter architecture by setting the parameter specifications: β0=rn −½, β12=. . . =βn=0 and αkk for k=0, 1, . . . , n−1 . We note that, in general, the parameters α0, α1, . . . , αn−1 are not the reflection coefficients (PARCOR parameters).
  • As part of this disclosure, we disclose a method and apparatus for determining the gains in a ladder-lattice embodiment of THREE filter from a choice of notches in the power spectrum and of natural frequencies for the bank of filters, as well as a method of automatically tuning these notches and the natural frequencies of the filter bank from the observed data. Similar to the case of LPC filter design, the specs, or coefficients, of the THREE filter are also computed by optimizing a (convex) generalized entropy functional. One might consider an alternative design using adaptive linear filters to tune the parameters in the lattice-ladder filter embodiment of an autoregressive moving-average (ARMA) model of a measured input-output history, as has been done in [M. G. Bellanger, [0035] Computational complexity and accuracy issues in fast least squares algorithms for adaptive filtering, Proc. 1988 IEEE International Symposium on Circuits and Systems, Espoo, Finland, Jun. 7-9, 1988] for either lattice or ladder filter tuning. However, one should note that the input string which might generate the observed output string is not necessarily known, nor is it necessarily available, in all situations to which THREE filter methods apply (e.g., speech synthesis). For this reason, one might then consider developing a tuning method for the lattice-ladder filter parameters using a system identification scheme based on an autoregressive moving-average with exogenous variables (ARMAX). However, the theory of system identification teaches that these optimization schemes are nonlinear but nonconvex [T. Söderström and P. Stoica, Systems Identification, Prentice-Hall, New York, 1989, page 333, equations (9.47), and page 334, equations (9.48)]. Moreover, the theory teaches that there are examples where global convergence of the associated algorithms may fail depending on the choice of certain design parameters (e.g., forgetting factors) in the standard algorithm [T. Söderström and P. Stoica, op. cit., page 340, Example 9.6]—in sharp contrast to the convex minimization scheme we disclose for the lattice-ladder parameters realizing a THREE filter. In addition, ARMAX schemes will not necessarily match the notches of the power spectrum. Finally, we disclose here that our extensive experimentation with both methods for problems of formant identification show that ARMAX methods require significantly higher order filters to begin to identify formants, and also lead to the introduction of spurious formants, in cases where THREE filter methods converge quite quickly and reliably.
  • We now disclose a new method and apparatus for encoding and reproducing time signals, as well as for spectral analysis of signals. The method and apparatus, which we refer to as the Tunable High Resolution Estimator (THREE), is especially suitable for processing and analyzing short observation records. [0036]
  • The basic parts of the THREE are: the Encoder, the Signal Synthesizer, and the Spectral Analyzer. The Encoder samples and processes a time signal (e.g., speech, radar, recordings, etc.) and produces a set of parameters which are made available to the Signal Synthesizer and the Spectral Analyzer. The Signal Synthesizer reproduces the time signal from these parameters. From the same parameters, the Spectral Analyzer generates the power spectrum of the time-signal. [0037]
  • The design of each of these components is disclosed with both fixed-mode and tunable features. Therefore, an essential property of the apparatus is that the performance of the different components can be enhanced for specific applications by tuning two sets of tunable parameters, referred to as the filter-bank poles p=(p[0038] 0, p1, . . . , pn) and the MA parameters r=(r1, r2, . . . , rn) respectively. In this disclosure we shall teach how the value of these parameters can be (a) set to fixed “default” values, and (b) tuned to give improved resolution at selected portions of the power spectrum, based on a priori information about the nature of the application, the time signal, and statistical considerations. In both cases, we disclose what we believe to be the preferred embodiments for either setting or tuning the parameters.
  • As noted herein, the THREE filter is tunable. However, in its simplest embodiment, the tunable feature of the filter may be eliminated so that the invention incorporates in essence a high resolution estimator (HREE) filter. In this embodiment the default settings, or a priori information, is used to preselect the frequencies of interest. As can be appreciated by those of ordinary skill in the art, in many applications this a priori information is available and does not detract from the effective operation of the invention. Indeed the tunable feature is not needed for these applications. Another advantage of not utilizing the tunable aspect of the invention is that faster operation is achieved. This increased operational speed may be more important for some applications, such as those which operate in real time, rather than the increased accuracy of signal reproduction expected with tuning. This speed advantage is expected to become less important as the electronics available for implementation are further improved. [0039]
  • The intended use of the apparatus is to achieve one or both of the following objectives: (1) a time signal is analyzed by the Encoder and the set of parameters are encoded, and transmitted or stored. Then the Signal Synthesizer is used to reproduce the time signal; and/or (2) a time signal is analyzed by the Encoder and the set of parameters are encoded, and transmitted or stored. Then the Spectral Analyzer is used to identify the power spectrum of time signal over selected frequency bands. [0040]
  • These two objectives could be achieved in parallel, and in fact, data produced in conjunction with (2) may be used to obtain more accurate estimates of the MA parameters, and thereby improve the performance of the time synthesizer in objective (1). Therefore, a method for updating the MA parameters on-line is also disclosed. [0041]
  • The Encoder. Long samples of data, as in speech processing, are divided into windows or frames (in speech typically a few 10 ms.), on which the process can be regarded as being stationary. The procedure of doing this is well-known in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, [0042] Speech Coding: A Computer Laboratory Textbook, John Wiley & Sons, New York, 1996]. The time signal in each frame is sampled, digitized, and de-trended (i.e., the mean value subtracted) to produce a (stationary) finite time series
  • y(0),y(1), . . . , y(N).  (2.1)
  • This is done in the box designated as A/D in FIG. 12. This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, [0043] Speech Coding: A Computer Laboratory Textbook, John Wiley & Sons, New York, 1996]. The separation of window frames is decided by the Initializer/Resetter, which is Component 3 in FIG. 12. The central component of the Encoder is the Filter Bank, given as component 1. This consists of a collection of n+1 low-order filters, preferably first order filters, which process the observed time series in parallel. The output of the Filter Bank consists of the individual outputs compiled into a time sequence of vectors [ u 0 ( t 0 ) u 1 ( t 0 ) u n ( t 0 ) ] , [ u 0 ( t 0 + 1 ) u 1 ( t 0 + 1 ) u n ( t 0 + 1 ) ] , , [ u 0 ( N ) u 1 ( N ) u n ( N ) ] ( 2.2 )
    Figure US20030055630A1-20030320-M00001
  • The choice of starting point t[0044] 0 will be discussed in the description of Component 2.
  • As will be explained in the description of [0045] Component 7, the Filter Bank is completely specified by a set p=(p0, p1, . . . , pn) of complex numbers. As mentioned above, these numbers can either be set to default values, determined automatically from the rules disclosed below, or tuned to desired values, using an alternative set of rules which are also disclosed below. Component 2 in FIG. 12, indicated as Covariance Estimator, produces from the sequence u(t) in (2.2) a set of n+1 complex numbers
  • w=(w0, w1, . . . , wn)  (2.3)
  • which are coded and passed on via a suitable interface to the Signal Synthesizer and the Spectral Analyzer. It should be noted that both sets p and w are self-conjugate. Hence, for each of them, the information of their actual values is carried by n+1 real numbers. [0046]
  • Two additional features which are optional, are indicated in FIG. 12 by dashed lines. First, [0047] Component 5, designated as Excitation Signal Selection, refers to a class of procedures to be discussed below, which provide the modeling filter (Component 9) of the signal Synthesizer with an appropriate input signal. Second, Component 6, designated as MA Parameters in FIG. 12, refers to a class of procedures for determining n real numbers
  • r=(r1, r2, . . . , rn),  (2.4)
  • the so-called MA parameters, to be defined below. [0048]
  • The Signal Synthesizer. The core component of the Signal Synthesizer is the Decoder, given as [0049] Component 7 in FIG. 13, and described in detail below. This component can be implemented in a variety of ways, and its purpose is to integrate the values w, p and r into a set of n+1 real parameters
  • a=(a0, a1, . . . , an),  (2.5)
  • called the AR parameters. This set along with parameters r are fed into [0050] Component 8, called Parameter Transformer in FIG. 13, to determine suitable ARMA parameters for Component 9, which is a standard modeling filter to be described below. The modeling filter is driven by an excitation signal produced by Component 5′.
  • The Spectral Analyzer. The core component of the Spectral Analyzer is again the Decoder, given as [0051] Component 7 in FIG. 14. The output of the Decoder is the set of AR parameters used by the ARMA modeling filter (Component 10) for generating the power spectrum. Two optional features are driven by the Component 10. Spectral estimates can be used to identify suitable updates for the MA parameters and/or updates of the Filter Bank parameters. The latter option may be exercised when, for instance, increased resolution is desired over an identified frequency band.
  • Components. Now described in detail are the key components of the parts and their function. They are discussed in the same order as they have been enumerated in FIGS. [0052] 12-14.
  • Bank of Filters. The core component of the Encoder is a bank of n+1 filters with transfer functions [0053] G k ( z ) = z z - p k , k = 0 , 1 , 2 , ,
    Figure US20030055630A1-20030320-M00002
  • where the filter-bank poles p[0054] 0, p1, . . . , pn) are available for tuning. The poles are taken to be distinct and one of them, p0 at the origin, i.e. p0=0. As shown in FIG. 15, these filters process in parallel the input time series (2.1), each yielding an output Uk satisfying the recursion
  • u k(t)=p k u k(t−1)+y(t).  (2.6)
  • Clearly, u[0055] 0=y. If pk is a real number, this is a standard first-order filter. If pk is complex,
  • u k(t):=ξk(t)+ k(t)
  • can be obtained via the second order filter [0056] [ ξ k ( t ) η k ( t ) ] = [ a - b b a ] [ ξ k ( t - 1 ) η k ( t - 1 ) ] + [ 1 0 ] y ( t ) , ( 2.7 )
    Figure US20030055630A1-20030320-M00003
  • where p[0057] k=a+ib . Since complex filter-bank poles occur in conjugate pairs a±ib, and since the filter with the pole pl=a−ib produces the output
  • u k(t):=ξk(t)− k(t)
  • the same second order filter (2.7) replaces two complex one-order filters. We also disclose that for tunability of the apparatus to specific applications there may also be switches at the input buffer so that one or more filters in the bank can be turned off. The hardware implementation of such a filter bank is standard in the art. [0058]
  • The key theoretical idea on which our design relies, described in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0059] A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint, is the following: Given the unique proper rational function f(z) with all poles in the unit disc {z||z|<1} such that
  • Φ(e ):=ƒ(e )+ƒ(e −i θ), −π≦θ≦π  (2.8)
  • is the power spectrum of y, it can be shown that [0060] f ( p k - 1 ) = 1 2 ( 1 - p k 2 ) E { u k ( t ) 2 } , t t 0 , ( 2.9 )
    Figure US20030055630A1-20030320-M00004
  • where E{•} is mathematical expectation, provided t[0061] 0 is chosen large enough for the filters to have reached steady state so that (2.2) is a stationary process; see C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint. The idea is to estimate the variances
  • c0(uk):=E{uk(t)2}, k=0, 1, . . . , n
  • from output data, as explained under [0062] point 2 below, to yield interpolation conditions
  • ƒ(Zk)=wk, k=0, 1, . . . , n where zk=pk −1
  • from which the function f(z), and hence the power spectrum Φ can be determined. The theory described in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0063] A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint teaches that there is not a unique such f(z), and our procedure allows for making a choice which fulfills other design specifications.
  • Covariance Estimator. Estimation of the variance[0064]
  • c0(ν):=E{ν(t)2 }
  • of a stationary stochastic process v(t) from an observation record[0065]
  • ν0, ν1, ν2, . . . , νN
  • can be done in a variety of ways. The preferred procedure is to evaluate [0066] c ^ 0 ( v ) := 1 N + 1 t = 0 N v t 2 ( 2.10 )
    Figure US20030055630A1-20030320-M00005
  • over the available frame. [0067]
  • In the present application, the variances ĉ[0068] 0 (u0), ĉ0 (u1). . . , ĉ0 (un) are estimated and the numbers (2.3) are formed as w k := 1 2 ( 1 - p k 2 ) c ^ 0 ( u k ) , k = 0 , 1 , , n . ( 2.11 )
    Figure US20030055630A1-20030320-M00006
  • Complex arithmetic is preferred, but, if real filter parameters are desired, the output of the second-order filter (2.7) can be processed by noting that[0069]
  • c 0(u k):=c 0k)−c 0k)+2i cov(ξkk),
  • where cov(ξ[0070] kk):=E{ξ(t)ηk(t)} is estimated by a mixed ergodic sum formed in analogy with (2.10).
  • Before delivering w=(w[0071] 0, w1, . . . , wn) as the output, check that the Pick matrix P = [ w j + w _ k 1 - p j p _ k ] j , k = 0 n
    Figure US20030055630A1-20030320-M00007
  • is positive definite. If not, exchange w[0072] k for wk+λ for k=0, 1, . . . , n, where λ is larger than the absolute value of the smallest eigenvalue of PP0 −1 where P 0 = [ 2 1 - p j p _ k ] j , k = 0 n
    Figure US20030055630A1-20030320-M00008
  • Initializer/Resetter. The purpose of this component is to identify and truncate portions of an incoming time series to produce windows of data (2.1), over which windows the series is stationary. This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, [0073] Speech Coding: A Computer Laboratory Textbook, John Wiley & Sons, New York, 1996]. At the beginning of each window it also initializes the states of the Filter Bank to zero, as well as resets summation buffers in the Covariance Estimator (Component 2).
  • Filter Bank Parameters. The theory described in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0074] A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint, requires that the pole of one of the filters in the bank be at z=0 for normalization purposes; we take this to be p0. The location of the poles of the other filters in the bank represents a design trade-off. The presence of Filter Bank poles close to a selected arc {e|θ∈[θ1, θ2]} of the unit circle, allows for high resolution over the corresponding frequency band. However, proximity of the poles to the unit circle may be responsible for deterioration of the variability of the covariance estimates obtained by Component 2.
  • There are two observations which are useful in addressing the design trade-off. First, the size n of the data bank is dictated by the quality of the desired reproduction of the spectrum and the expected complexity of it. For instance, if the spectrum is expected to have k spectral lines or formants within the targeted frequency band, typically, a filter of order n=2k+2 is required for reasonable reproduction of the characteristics. [0075]
  • Second, if N is the length of the window frame, a useful rule of thumb is to place the poles within [0076] p < 10 - 10 N .
    Figure US20030055630A1-20030320-M00009
  • This guarantees that the output of the filter bank attains stationarity in about {fraction (1/10)} of the length of the window frame. Accordingly the Covariance Estimator may be activated to operate on the later 90% stationary portion of the processed window frame. Hence, t[0077] 0 in (2.2) can be taken to be the smallest integer larger than N 10 .
    Figure US20030055630A1-20030320-M00010
  • This typically gives a slight improvement as compared to the Covariance Estimator processing the complete processed window frame. [0078]
  • There is a variety of ways to take advantage of the design trade-offs. We now disclose what we believe are the best available rules to automatically determine a default setting of the bank of filter poles, as well as to automatically determine the setting of the bank of filter poles given a priori information on a bandwidth of frequencies on which higher resolution is desired. [0079]
  • Default Values. [0080]
  • (a) One pole is chosen at the origin, [0081]
  • (b) choose one or two real poles at [0082] p = ± 10 10 N
    Figure US20030055630A1-20030320-M00011
  • (c) choose an even number of equally spaced poles on the circumference of a circle with radius [0083] 10 - 10 N ,
    Figure US20030055630A1-20030320-M00012
  • in a Butterworth-like pattern with angles spanning the range of frequencies where increased resolution is desired. [0084]
  • The total number of elements in the filter bank should be at least equal to the number suggested earlier, e.g., two times the number of formants expected in the signal plus two. [0085]
  • In the tunable case, it may be necessary to switch off one or more of the filters in the bank. [0086]
  • As an illustration, take the signal of two sinusoidal components in colored noise depicted in FIG. 4. More specifically, in this example,[0087]
  • y(t)=0.5 sin (ω1 t1)+0.5 sin (ω2 t2)+z(t)t=0,1,2, . . . ,
  • z(t)=0.8z(t−1)+0.5ν(t)+0.25ν(t−1)
  • with ω[0088] 1=0.42,ω2=0.53, and φ1, φ2 and ν(t) independent N(0,1) random variables, i.e., with zero mean and unit variance. The squares in FIG. 16 indicate suggested position of filter bank poles in order to attain sufficient resolution over the frequency band [0.4 0.5] so as to resolve spectral lines situated there and indicated by 0. The position of the poles on the circle |z|=0.9 is dictated by the length N˜300 for the time series window.
  • A THREE filter is determined by the choice of filter-bank poles and a choice of MA parameters. The comparison of the original line spectra with the power spectrum of the THREE filter determined by these filter-bank poles and the default value of the MA parameters, discussed below, is depicted in FIG. 7. [0089]
  • Excitation Signal Selection. An excitation signal is needed in conjunction with the time synthesizer and is marked as [0090] Component 5′. For some applications the generic choice of white noise may be satisfactory, but in general, and especially in speech it is a standard practice in vocoder design to include a special excitation signal selection. This is standard in the art [T. P. Barnwell III, K. Nayebi and C. H. Richardson, Speech Coding: A Computer Laboratory Textbook, John Wiley & Sons, New York, 1996, page 101 and pages 129-132] when applied to LPC filters and can also be implemented for general digital filters. The general idea adapted to our situation requires the following implementation.
  • [0091] Component 5 in FIG. 12 includes a copy of the time synthesizer. That is, it receives as input the values w, p, and r, along with the time series y. It generates the coefficients a of the ARMA model precisely as the decoding section of the time synthesizer. Then it processes the time series through a filter which is the inverse of this ARMA modeling filter. The “approximately whitened” signal is compared to a collection of stored excitation signals. A code identifying the optimal matching is transmitted to the time synthesizer. This code is then used to retrieve the same excitation signal to be used as an input to the modeling filter (Component 9 in FIG. 13).
  • Excitation signal selection is not needed if only the frequency synthesizer is used. [0092]
  • MA Parameter Selection. As for the filter-bank poles, the MA parameters can either be directly tuned using special knowledge of spectral zeros present in the particular application or set to a default value. However, based on available data (2.1), the MA parameter selection can also be done on-line, as described in Appendix A. [0093]
  • There are several possible approaches to determining a default value. For example, the choice r[0094] 1=r2=. . . =rn=0 produces a purely autoregressive (AR) model which, however, is different from the LPC filter since it interpolates the filter-bank data rather than matching the covariance lags of the original process.
  • We now disclose what we believe is the best available method for determining the default values of the MA parameters. Choose r[0095] 1, r2, . . . , rn so that
  • z n +r 1 z n−1 + . . . +r=(z−p 1)(z−p 2) . . . (z−p n),  (2.12)
  • which corresponds to the central solution, described in [0096] Section 3. This setting is especially easily implemented, as disclosed below.
  • Decoder. Given p, w, and r, the Decoder determines n+1 real numbers[0097]
  • a0, a1, a2, . . . , an,  (2.13)
  • with the property that the polynomial[0098]
  • α(z):=a 0 z n +a 1 z n−1 + . . . +a n
  • has all its roots less than one in absolute value. This is done by solving a convex optimization problem via an algorithm presented in papers C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0099] A generalized entropy criterion for Nevanlinna-Pick interpolation: A convex optimization approach to certain problems in systems and control, preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint. While our disclosure teaches how to determine the THREE filter parameters on-line in the section on the Decoder algorithms, an alternative method and apparatus can be developed off-line by first producing a look-up table. The on-line algorithm has been programmed in MATLAB, and the code is enclosed in the Appendix B.
  • For the default choice (2.12) of MA-parameters, a much simpler algorithm is available, and it is also presented in the section on the Decoder algorithms. The MATLAB code for this algorithm is also enclosed in the Appendix B. [0100]
  • Parameter Transformer. The purpose of [0101] Component 8 in FIG. 13 is to compute the filter gains for a modeling filter with transfer function R ( z ) = z n + r 1 z n - 1 + + r n a 0 z n + a 1 z n - 1 + + a n , ( 2.14 )
    Figure US20030055630A1-20030320-M00013
  • where r[0102] 1, r2, . . . , rn are the MA parameters delivered by Component 6 (as for the Signal Synthesizer) or Component 6′ (in the Spectral Analyzer) and a0, a1, . . . , an delivered from the Decoder (Component 7) This can be done in many different ways [L. A. Chua, C. A. Desoer and E. S. Kuh, Linear and Nonlinear Circuits, McGraw-Hill, 1989], depending on desired filter architecture.
  • A filter design which is especially suitable for an apparatus with variable dimension is the lattice-ladder architecture depicted in FIG. 11. In this case, the gain parameters[0103]
  • α0, α1, . . . , αn−1 and β0, β1, . . . , βn
  • are chosen in the following way. For k=n, n−1, . . . , 1, solve the recursions [0104] { a k - 1 , j = a kj + α k - 1 a k , k - j , a nj = a j α k - 1 = - a kk a k0 r k - 1 , j = r kj - β k a k , k - j , r nj = r j β k = r kk a k0 ( 2.15 )
    Figure US20030055630A1-20030320-M00014
  • for j=0, 1, . . . , k, and set [0105] β 0 = r 00 a 00 .
    Figure US20030055630A1-20030320-M00015
  • This is a well-known procedure; see, e.g., K. J. Astrtöm, Introduction to stochastic realization theory, Academic Press, 1970; and K. J. Aström, [0106] Evaluation of quadratic loss functions of linear systems, in Fundamentals of Discrete-time systems: A tribute to Professor Eliahu I. Jury, M. Jarnshidi, M. Mansour, and B. D. O. Anderson (editors), IITSI Press, Albuquerque, N. Mex., 1993, pp. 45-56. The algorithm is recursive, using only ordinary arithmetic operations, and can be implemented with an MAC mathematics processing chip using ordinary skill in the art.
  • ARMA filter. An ARMA modeling filter consists of gains, unit delays z[0107] −1, and summing junctions, and can therefore easily be mapped onto a custom chip or any programmable digital signal processor using ordinary skill in the art. The preferred filter design, which easily can be adjusted to different values of the dimension n, is depicted in FIG. 11. If the AR setting r1=r2=. . . =rn=0 of the MA parameters has been selected, β0=rn −½, β12=. . . =βn=0 and αkk for k=0, 1, . . . , n−1, where γk,k=0,1, . . . ,n−1, are the first n PARCOR parameters and the algorithm (2.15) reduces to the Levinson algorithm [B. Porat, digital Processing of Random Signals, Prentice-Hall, 1994; and P. Stoica and R. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997].
  • Spectral plotter. The Spectral Plotter amounts to numerical implementation of the evaluation Φ(e[0108] ):=|R(e)|2, where R(z) is defined by (2.14), and θ ranges over the desired portion of the spectrum. This evaluation can be efficiently computed using standard FFT transform [P. Stoica and R. Moses, Introduction to Spectral Anqalysis, Prentice-Hall, 1997]. For instance, the evaluation of a polynomial (3.4) over a frequency range z=e, with θ∈{0, Δθ, . . . , 2π−Δθ} and Δθ=2π/M, can be conveniently computed by obtaining the discrete Fourier transform of
  • (an, . . . , a1,1, 0, . . . , 0).
  • This is the coefficient vector padded with M-n-1 zeros. The discrete Fourier transform can be implemented using the FFT algorithm in standard form. [0109]
  • Decoder Algorithms. We now disclose the algorithms used for the Decoder. The input data consists of [0110]
  • (i) the filter-bank poles p=(p[0111] 0, p1, . . . , pn), which are represented as the roots of a polynomial τ ( z ) : = k = 1 n ( z - p k ) = z n + τ 1 z n - 1 + + τ n - 1 z + τ n , ( 3.1 )
    Figure US20030055630A1-20030320-M00016
  • (ii) the MA parameters r=(r[0112] 1, r2, . . . , rn), which are real numbers such that the polynomial
  • ρ(z)=z n +r 1 z n−1 + . . . +r n−1 z+r n  (3.2)
  • has all its roots less than one in absolute value, and [0113]
  • (iii) the complex numbers[0114]
  • w=(w0, w1, . . . , wn)
  • determined as (2.11) in the Covariance Estimator. [0115]
  • The problem is to find AR parameters a=(a[0116] 0, a1, . . . , an), real numbers with the property that the polynomial
  • α(z)=a 0 z n +a 1 z n−1 + . . . +a n−1 z+a n  (3.4)
  • has all its roots less than one in absolute value, such that [0117] ρ ( θ ) α ( θ ) 2
    Figure US20030055630A1-20030320-M00017
  • is a good approximation of the power spectrum Φ(e[0118] ) of the process y in some desired part of the spectrum θ∈[−π,π]. More precisely, we need to determine the function f(z) in (2.8). Mathematically, this problem amounts to finding a polynomial (3.4) and a corresponding polynomial
  • β(z)=b 0 z n +b 1 z n−1 + . . . +b n−1 z+b n,  (3.5)
  • satisfying[0119]
  • α(z)β(z −1)+β(z)α(z −1)=ρ(z)ρ(z −1)  (3.6)
  • such that the rational function [0120] f ( z ) = β ( z ) α ( z ) ( 3.7 )
    Figure US20030055630A1-20030320-M00018
  • satisfies the interpolation condition[0121]
  • ƒ(zk)=wk, k=0, 1, . . . , n where zk=pk −1.  (3.8)
  • For this purpose the parameters p and r are available for tuning. If the choice of r corresponds to the default value, r[0122] kk for k=1, 2, . . . , n (i.e., taking ρ(z)=τ(z)), the determination of the THREE filter parameters is considerably simplified. The default option is disclosed in the next subsection. The method for determining the THREE filter parameters in the tunable case is disclosed in the subsection following the next. Detailed theoretical descriptions of the method, which is based on convex optimization, are given in the papers [C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A generalized entropy criterion for Nevanlinna-Pick interpolation: A convex optimization approach to certain problems in systems and control, preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to Spectral Estimation: A tunable high-resolution spectral estimator, preprint].
  • The central solution algorithm for the default filter. In the special case in which the MA parameters r=(r[0123] 1, r2, . . . , rn) are set equal to the coefficients of the polynomial (3.1), i.e., when ρ(z)=τ(z), a simpler algorithm is available. Here we disclose such an algorithm which is particularly suited to our application. Given the filter-bank parameters p0, p1, . . . , pn and the interpolation values w0, w1, . . . , wn determine two sets of parameters s1, s2, . . . , sn and ν1, ν2, . . . , νn defined as s k = 1 - p k 1 + p k and v k = 1 - w k / w 0 1 + w k / w 0 k = 1 , 2 , , n
    Figure US20030055630A1-20030320-M00019
  • and the coefficients σ[0124] 1, σ2, . . . , σn of the polynomial
  • σ(s)=(s−s 1)(s−s 2) . . . (s−s n)=s n1 s n−1+ . . . +σn.
  • We need a rational function [0125] p ( s ) : = x 1 s n - 1 + + x n s n + σ 1 s n - 1 + + σ n
    Figure US20030055630A1-20030320-M00020
  • such that[0126]
  • p(sk)=νkk=1, 2, . . . , n,
  • and a realization p(z)=c(sI−A)[0127] −1b, where A = [ - σ 1 - σ 2 - σ n - 1 - σ n 1 0 0 0 0 1 0 0 0 0 1 0 ] , c = [ 0 0 0 1 ]
    Figure US20030055630A1-20030320-M00021
  • and the n-vector b remains to be determined. To this end, choose a (reindexed) subset s[0128] 1, s2, . . . , sm of the parameters s1,s2, . . . , sn, including one and only one sk from each complex pair (sk,{overscore (s)}k), and decompose the following complex Vandermonde matrix and complex vector into their real and imaginary parts: [ s 1 n - 1 s 1 n - 2 1 s 2 n - 1 s 2 n - 2 1 s m n - 1 s m n - 2 1 ] = U r + iU i , [ v 1 σ ( s 1 ) v 2 σ ( s 2 ) v m σ ( s m ) ] = u r + iu i .
    Figure US20030055630A1-20030320-M00022
  • Then, remove all zero rows from u[0129] i and ui to obtain Ut and Ut, respectively, and solve the n×n system [ U r U t ] x = [ u r u t ]
    Figure US20030055630A1-20030320-M00023
  • for the n-vector x with components x[0130] 1, x2, . . . , xn. Then, padding x with a zero entry to obtain the (n+1)-vector [ 0 x ] ,
    Figure US20030055630A1-20030320-M00024
  • the required b is obtained by removing the last component of the (n+1)-vector [0131] R - 1 [ 0 x ] ,
    Figure US20030055630A1-20030320-M00025
  • where R is the triangular (n+1)×(n+1)-matrix [0132] R = [ 1 1 σ 1 1 σ 1 σ 2 1 σ 1 σ 2 σ n ] ,
    Figure US20030055630A1-20030320-M00026
  • where empty matrix entries denote zeros. [0133]
  • Next, with prime (′) denoting transposition, solve the Lyapunov equations[0134]
  • PoA+A′P0=c′c
  • (A−Po −1c′c)Pc+Pc(A−Po −1c′c)′=bb′
  • which is a standard routine, form the matrix[0135]
  • N=(I−PoPc)−1,
  • and compute the (n+1)-vectors h[0136] (1),h(2),h(3) and h(4) with components
  • h[0137] 0 (1)=1, hk (1)=cAk−1Po −1Nc′, k=1, 2, . . . , n
  • h[0138] 0 (2)=0, hk (2)=cAk−1N′b, k=1, 2, . . . , n
  • h[0139] 0 (3)=0, hk (3)=−b′PoAk−1Po −1Nc′, k=1, 2, . . . , n
  • h[0140] 1 (4)=1, hk (4)=−b′PoAk−1N′b, k=1, 2, . . . , n.
  • Finally, compute the (n+1)-vectors [0141]
  • y[0142] (j)=TRh(j), j=1,2,3,4
  • with components y[0143] 0 (j), y1 (j), . . , yn (j), j=1,2,3,4, where T is the (n+1)×(n+1) matrix, the k: th column of which is the vector of coefficients of the polynomial
  • (s+1)n−k(s−1)k, for k=0, 1, . . . , n,
  • starting with the coefficient of S[0144] n and going down to the constant term, and R is the matrix defined above. Now form α ^ k = 1 1 - μ 2 [ μ ( y k ( 3 ) + y k ( 1 ) ) + ( y k ( 4 ) + y k ( 2 ) ) ] , k = 0 , 1 , , n , β ^ k = w 0 1 - μ 2 [ μ ( y k ( 3 ) - y k ( 1 ) ) + ( y k ( 4 ) - y k ( 2 ) ) ] , k = 0 , 1 , , n , where μ = - y 0 ( 2 ) y 0 ( 1 ) .
    Figure US20030055630A1-20030320-M00027
  • The (central) interpolant (3.7) is then given by [0145] f ( z ) = β ^ ( z ) α ^ ( z ) ,
    Figure US20030055630A1-20030320-M00028
  • where {circumflex over (α)}(z) and {circumflex over (β)}(z) are the polynomials[0146]
  • {circumflex over (α)}(z)={circumflex over (α)}0 z n+{circumflex over (α)}1 z n−1+ . . . +{circumflex over (α)}n,
  • {circumflex over (β)}(z)={circumflex over (β)}0 z n+{circumflex over (β)}1 z n−1+ . . . +{circumflex over (β)}n.
  • However, to obtain the α(z) which matches the MA parameters r=τ, {circumflex over (α)}(z) needs to be normalized by setting [0147] α ( z ) = 1 + τ 1 2 + + τ n 2 2 ( α ^ 0 β ^ 0 + α ^ 1 β ^ 1 + α ^ n β ^ n ) α ^ ( z ) .
    Figure US20030055630A1-20030320-M00029
  • This is the output of the central solver. [0148]
  • Convex optimization algorithm for the tunable filter. To initiate the algorithm, one needs to choose an initial value for a, or, equivalently, for α(z), to be recursively updated. We disclose two methods of initialization, which can be used if no other guidelines, specific to the application, are available. [0149]
  • [0150] Initialization method 1. Given the solution of the Lyapunov equation S = A SA + c c , where ( 3.9 ) A = [ - τ 1 - τ 2 - τ n - 1 - τ n 1 0 0 0 0 1 0 0 1 0 ] , ( 3.10 ) c = [ 0 0 0 1 ] , form κ = y [ S 0 0 1 ] y , y = L n - 1 r , ( 3.11 )
    Figure US20030055630A1-20030320-M00030
  • where r is the column vector having the [0151] coefficients 1, r1, . . . , rn of (3.2) as components and where L n = [ 1 1 τ 1 1 τ 1 τ 2 1 τ 1 τ 2 τ n ] . Then take α ( z ) = κ 2 w 0 τ ( z ) ( 3.12 )
    Figure US20030055630A1-20030320-M00031
  • as initial value. [0152]
  • [0153] Initialization method 2. Take α ( z ) = 1 + r 1 + + r n 1 + τ 1 + + τ n α c ( z ) ,
    Figure US20030055630A1-20030320-M00032
  • where α[0154] c(Z) is the α-polynomial obtained by first running the algorithm for the central solution described above.
  • Algorithm. Given the initial (3.4) and (3.1), solve the linear system of equations [0155] ( [ 1 τ n - 2 τ n - 1 τ n τ 1 τ n - 1 τ n τ 2 τ n τ n ] + [ 1 τ 1 τ 2 τ n 1 τ 1 τ n - 1 1 τ n - 2 1 ] ) [ s 0 s 1 s 2 s n ] = [ a 0 2 + a 1 2 + a 2 2 + + a n 2 a 0 a 1 + a 1 a 2 + a n - 1 a n a 0 a 2 + a 1 a 3 + a n - 2 a n a 0 a n ]
    Figure US20030055630A1-20030320-M00033
  • for the column vector S with components s[0156] 0, s1, . . . , sn. Then, with the matrix Ln given by (3.12), solve the linear system
  • Lnh=s
  • for the vector [0157] h = [ h n h n - 1 h 0 ] (3.13)
    Figure US20030055630A1-20030320-M00034
  • The components of h are the Markov parameters defined via the expansion [0158] q ( z ) = σ ( z ) τ ( z ) = h 0 + h 1 z - 1 + h 2 z - 2 + h 3 z - 3 + , where σ ( z ) := s 0 z n + s 1 z n - 1 + + s n . (3.14)
    Figure US20030055630A1-20030320-M00035
  • The vector (3.13) is the quantity on which iterations are made in order to update α(z). More precisely, a convex function J(q) presented in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0159] A generalized entropy criterion for Nevanlina-Pick interpolation: A convex optimization approach to certain problems in systems and control, preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to spectral estimation: A tunable high-resolution spectral estimator, preprint, is minimized recursively over the region where
  • q(e)+q(e−iθ)>0, for −π≦θ≦π  (3.15)
  • This is done by upholding condition (3.6) while successively trying to satisfy the interpolation condition (3.8) by reducing the errors[0160]
  • e k =w k−ƒ(p k −1), k=0, 1, . . . , n.  (3.16)
  • Each iteration of the algorithm consists of two steps. Before turning to these, some quantities, common to each iteration and thus computed off-line, need to be evaluated. [0161]
  • Given the MA parameter polynomial (3.2), let the real numbers π[0162] 0, π1, . . . , πn can be defined via the expansion
  • ρ(z)ρ(z −1)=π01(z+z−1)+π2(z 2 +z −2)+ . . . +πn(z n +z −n).
  • Moreover, given a subset p[0163] 1, p2, . . . , pm of the filter-bank poles p1, p2, . . . , pn obtained by only including one pk in each complex conjugate pair (pk,{overscore (p)}k), form the corresponding Vandermonde matrix V := [ p 1 - ( n - 1 ) p 1 - ( n - 2 ) p 1 - 1 1 p 2 - ( n - 1 ) p 2 - ( n - 2 ) p 2 - 1 1 p m - ( n - 1 ) p m - ( n - 2 ) p m - 1 1 ] = V r + V i , (3.18)
    Figure US20030055630A1-20030320-M00036
  • together with its real part V[0164] r and imaginary part Vi. Moreover, given an arbitrary real polynomial
  • γ(z)=g 0 z m +g 1 z m−1 + . . . +g m,  (3.19)
  • define the (n+1)×(m+1) matrix [0165] M ( γ ) := [ g 0 g 1 g n g n + 1 g m g 0 g 1 g n g n + 1 g m g 0 g 1 g n g n + 1 g m ] . (3.20)
    Figure US20030055630A1-20030320-M00037
  • We compute off-line M(ρ), M(τ*ρ) and M(τρ), where ρ and τ are the polynomials (3.2) and (3.1) and τ*(z) is the reversed polynomial[0166]
  • τ*(z)=τn z nn−1 z n−1+ . . . +τ1 z+1.
  • Finally, we compute off-line L[0167] n, defined by (3.12), as well as the submatrix Ln−1.
  • [0168] Step 1. In this step the search direction of the optimization algorithm is determined. Given α(z), first find the unique polynomial (3.5) satisfying (3.6). Identifying coefficients of zk, k=0, 1, . . . , n, this is seen to be a (regular) system of n+1 linear equations in the n+1 unknown b0, b1, . . . , bn namely ( [ a 0 a n - 2 a n - 1 a n a 1 a n - 1 a n a 2 a n a n ] + [ a 0 a 1 a 2 a n a 0 a 1 a n - 1 a 0 a n - 2 a 0 ] ) [ b 0 b 1 b 2 b n ] = [ π 0 π 1 π 2 π n ] ,
    Figure US20030055630A1-20030320-M00038
  • where π[0169] 0, π1, . . . , πn are given by (3.17). The coefficient matrix is a sum of a Hankel and a Toeplitz matrix and there are fast and efficient ways of solving such systems [G. Heinig, P. Jankowski and K. Rost, Fast Inversion Algorithms of Toeplitz-plus-Hankel Matrices, Numerische Mathematik 52 (1988), 665-682]. Next, form the function f ( z ) = β ( z ) α ( z ) .
    Figure US20030055630A1-20030320-M00039
  • This is a candidate for an approximation of the positive real part of the power spectrum Φ as in (2.8). [0170]
  • Next, we describe how to compute the gradient ∇J. Evaluate the interpolation errors (3.16), noting that e[0171] 0=w0−b0/a0, and decompose the complex vector [ ( e 1 - e 0 ) τ ( p 1 - 1 ) ( e 2 - e 0 ) τ ( p 2 - 1 ) ( e n - e 0 ) τ ( p n - 1 ) ] = v r + iv i
    Figure US20030055630A1-20030320-M00040
  • into its real part ν[0172] r and imaginary part νi Let Vr and Vi be defined by (3.18). Remove all zero rows from Vi and νi to obtain Vt and νt. Solve the system [ V r V t ] x = [ v r v t ]
    Figure US20030055630A1-20030320-M00041
  • for the column vector x and form the gradient as [0173] J = 2 [ SL n - 1 - 1 x 2 e 0 ] , (3.21)
    Figure US20030055630A1-20030320-M00042
  • where S is the solution to the Lyapunov equation (3.9) and L[0174] n−1 is given by (3.12).
  • To obtain the search direction, using Newton's method, we need the Hessian. Next, we describe how it is computed. Let the 2n×2n-matrix {circumflex over (P)} be the solution to the Lyapunov equation[0175]
  • {circumflex over (P)}=Â′{circumflex over (P)}Â+ĉ′ĉ,
  • where  is the companion matrix (formed analogously to A in (3. 10)) of the polynomial α(z)[0176] 2 and ĉ is the 2n row vector (0, 0, . . . , 0, 1) . Analogously, determine the 3n×3n -matrix {tilde over (P)} solving the Lyapunov equation
  • {tilde over (P)}=Ã′{tilde over (P)}Ã+{tilde over (c)}′{tilde over (c)},
  • where à is the companion matrix (formed analogously to A in (3.10)) of the polynomial α(z)[0177] 2τ(z) and {tilde over (c)} is the 3n row vector (0, 0, . . . , 0, 1). Then, the Hessian is H = 2 H 1 + H 2 + H 2 where (3.22) H 1 = L n M ( ρ ) L ( α 2 ) - 1 [ P ^ 0 0 1 ] L ( α 2 ) - 1 M ( ρ ) L n (3.23) H 2 = L n M ( τ * ρ ) L ( α 2 τ ) - 1 [ P ~ 0 0 1 ] L ( α 2 τ ) - 1 M ( τρ ) L ~ n (3.24)
    Figure US20030055630A1-20030320-M00043
  • where the precomputed matrices L[0178] n and {tilde over (L)}n are given by (3.12) and by reversing the order of the rows in (3.12), respectively. Also M(ρ), M(τ*ρ) and M(τρ) are computed off-line, as in (3.20), whereas L(α2)−1 and L(α2τ)−1 are computed in the following way:
  • For an arbitrary polynomial (3.19), determine λ[0179] 0, λ1, . . . , λm such that
  • γ(z)(λ0 z m1 z m−1+ . . . +λm)=z 2m+π(z),
  • where π(z) is a polynomial of at most degree m−1. This yields m+1 linear equation for the m+1 unknowns λ[0180] 0, λ1, . . . , λm, from which we obtain L ( γ ) - 1 = [ λ n λ 1 λ 0 λ n - 1 λ 0 λ 0 ] .
    Figure US20030055630A1-20030320-M00044
  • Finally, the new search direction becomes[0181]
  • d=H−1∇J.  (3.25)
  • Let d[0182] previous denote the search direction d obtained in the previous iteration. If this is the first iteration, initialize by setting dprevious=0
  • [0183] Step 2. In this step a line search in the search direction d is performed. The basic elements are as follows. Five constants cj,j=1,2,3,4,5, are specified with suggested default values C1=10−10, c2=1.5, C3=1.5, c4=0.5, and c5=0.001. If this is the first iteration, set λ=c5.
  • If ||d||<c[0184] 2||dprevious||, increase the value of a parameter λ by a factor c3. Otherwise, retain the previous value of λ. Using this λ, determine
  • h new =h−λd.  (3.26)
  • Then, an updated value for a is obtained by determining the polynomial (3.4) with all roots less than one in absolute value, satisfying[0185]
  • α(z)α(z −1)=σ(z)τ(z −1)+σ(z −1)τ(z)
  • with σ(z) being the updated polynomial (3.14) given by[0186]
  • σ(z)=τ(z)q(z),
  • where the updated q(z) is given by [0187] q ( z ) = c ( zI - A ) - 1 g + h 0 , g = [ h n h 1 ] ,
    Figure US20030055630A1-20030320-M00045
  • with h[0188] n, hn−1, . . . , h0 being the components of hnew, A and C given by (3.10). This is a standard polynomial factorization problem for which there are several algorithms [F. L. Bauer, Ein direktes Iterationsverfahren zur Hurwitz-Zerlegung eines Polynoms, Arch. Elek. Ubertragung, 9 (1955), 285-290; Z. Vostrý, New algorithm for polynomial spectral factorization with quadratic convergence I, Kybernetika 77 (1975), 411-418], using only ordinary arithmetic operations. Hence they can be implemented with an MAC mathematics processing chip using ordinary skill in the art. However, the preferred method is described below (see explanation of routine q2a).
  • This factorization can be performed if and only if q(z) satisfies condition (3.15). If this condition fails, this is determined in the factorization procedure, and then the value of λ is scaled down by a factor of c[0189] 4, and (3.26) is used to compute a new value for hnew and then of q(z) successfully until condition (3.15) is met.
  • The algorithm is terminated when the approximation error given in (3.16) becomes less than a tolerance level specified by c[0190] 1, e.g., when 0 n ( e k ) 2 < c 1 .
    Figure US20030055630A1-20030320-M00046
  • Otherwise, set h equal to h[0191] new and return to Step 1.
  • Description of technical steps in the procedure. The MATLAB code for this algorithm is given in Appendix B. As an alternative a state-space implementation presented in C. I. Byrnes, T. T. Georgiou, and A. Lindquist, [0192] A generalized entropy criterion for Nevanlinna-Pick interpolation: A convex optimization approach to certain problems in systems and control, preprint, and C. I. Byrnes, T. T. Georgiou, and A. Lindquist, A new approach to spectral estimation: A tunable high-resolution spectral estimator, preprint, may also be used. The steps are conveniently organized in four routines:
  • (1) Routine pm, which computes the Pick matrix from the given data p=(p[0193] 0, p1, . . . , pn) and w=(w0, w1, . . . , wn)
  • (2) Routine q2a which is used to perform the technical step of factorization described in [0194] Step 2. More precisely, given q(z) we need to compute a rational function a(z) such that
  • a(z)a(z −1)=q(z)+q(z −1)
  • for the minimum-phase solution a(z), in terms of which α(z)=τ(z)a(z). This is standard and is done by solving the algebraic Riccati equation[0195]
  • P−APA′−(g−APc′)(2h 0 −cPc′)−1(g−APc′)=0,
  • for the stabilizing solution. This yields[0196]
  • a(z)=c(zI−A)−1(g−APc′)/{square root}{square root over (2h 0 −cPc′)}+. {square root}{square root over (2h 0 −cPc′)}.
  • This is a standard MATLAB routine [W. F. Arnold, III and A. J. Laub, [0197] Generalized Eigenproblem Algorithms and Software for Albebraic Riccati Equations, Proc. IEEE, 72 (1984), 1746-1754].
  • (3) Routine central, which computes the central solution as described above. [0198]
  • (4) Routine decoder which integrates the above and provides the complete function for the decoder of the invention. [0199]
  • An application to speaker recognition. In automatic speaker recognition a person's identity is determined from a voice sample. This class of problems come in two types, namely speaker verification and speaker identification. In speaker verification, the person to be identified claims an identity, by for example presenting a personal smart card, and then speaks into an apparatus that will confirm or deny this claim. In speaker identification, on the other hand, the person makes no claim about his identity, and the system must decide the identity of the speaker, individually or as part of a group of enrolled people, or decide whether to classify the person as unknown. [0200]
  • Common for both applications is that each person to be identified must first enroll into the system. The enrollment (or training) is a procedure in which the person's voice is recorded and the characteristic features are extracted and stored. A feature set which is commonly used is the LPC coefficients for each frame of the speech signal, or some (nonlinear) transformation of these [Jayant M. Naik, [0201] Speaker Verification: A tutorial, IEEE Communications Magazine, January 1990, page 43], [Joseph P. Campbell Jr., Speaker Recognition: A tutorial, Proceedings of the IEEE 85 (1997), 1436-1462], [Sadaoki Furui, recent advances in Speaker Recognition, Lecture Notes in Computer Science 1206, 1997, page 239]. The motivation for using these is that the vocal tract can be modeled using a LPC filter and that these coefficients are related to the anatomy of the speaker and are thus speaker specific. The LPC model assumes a vocal tract excited at a closed end, which is the situation only for voiced speech. Hence it is common that the feature selection only processes the voiced segments of the speech [Joseph P. Campbell Jr., Speaker Recognition: A tutorial, Proceedings of the IEEE 85 (1997), page 1455]. Since the THREE filter is more general, other segments can also be processed, thereby extracting more information about the speaker.
  • Speaker recognition can further be divided into text-dependent and text-independent methods. The distinction between these is that for text-dependent methods the same text or code words are spoken for enrollment and for recognition, whereas for text-independent methods the words spoken are not specified. [0202]
  • Depending on whether a text-dependent or text-independent method is used, the pattern matching, the procedure of comparing the sequence of feature vectors with the corresponding one from the enrollment, is performed in different ways. The procedures for performing the pattern matching for text-dependent methods can be classified into template models and stochastic models. In a template model as the Dynamic Time Warping (DTW) [Hiroaki Sakoe and Seibi Chiba, [0203] Dynamic Programming Algorithm Optimization for Spoken Word Recognition, IEEE Transactions on Acoustics, Speech and Signal Processing ASSP-26 (1978), 43-49] one assigns to each frame of speech to be tested a corresponding frame from the enrollment. In a stochastic model as the Hidden Markov Model (HMM) [L. R. Rabiner and B. H. Juang, An Introduction to Hidden Markov Models, IEEE ASSP Magazine, January 1986, 4-16] a stochastic model is formed from the enrollment data, and the frames are paired in such a way as to maximize the probability that the feature sequence is generated by this model.
  • For text-independent speaker recognition the procedure can be used in a similar manner for speech-recognition-based methods and text-prompted recognition [Sadaoki Furui, Recent advances in Speaker Recognition, Lecture Notes in Computer Science 1206, 1997, page 241f] where the phonemes can be identified. [0204]
  • Speaker verification. FIG. 17 depicts an apparatus for enrollment. An enrollment session in which certain code words are spoken by a person later to be identified produces via this apparatus a list of speech frames and their corresponding MA parameters r and AR parameters a, and these triplets are stored, for example, on a smart card, together with the filter-bank parameters p used to produce them. Hence, the information encoded on the smart card (or equivalent) is speaker specific. When the identity of the person in question needs to be verified, the person inserts his smart card in a card reader and speaks the code words into an apparatus as depicted in FIG. 18. Here, in [0205] Box 12, each frame of the speech is identified. This is done by any of the pattern matching methods mentioned above. These are standard procedures known in the literature [Joseph P. Campbell Jr., Speaker Recognition: A tutorial, Proceedings of the IEEE 85 (1997), pages 1452-1454]. From the smart card the corresponding r, a and p are retrieved. The filter-bank poles are transferred to the Bank of Filters and the Decoder. (Another p could be used, but the same has to be used in both Box 1 and Box 7.) The parameters r and a are also transferred to the Decoder. The AR parameters a are used as initial condition in the Decoder algorithm (unless the central solution is used in which case no initial condition is needed). Box 7 produces AR parameters â which hopefully are close to a. The error â-a from each frame is compounded in a measure of goodness-of-fit, and decision is finally made as to whether to accept or reject the person.
  • Speaker identification. In speaker identification the enrollment is carried out in a similar fashion as for speaker verification except that the feature triplets are stored in a database. FIG. 19 depicts an apparatus for speaker identification. It works like that in FIG. 17 except that there is a frame identification box (Box 12) as in FIG. 18, the output of which together with the MA parameters a and AR parameters a are fed into a data base. The feature triplets are compared to the corresponding triplets for the population of the database and a matching score is given to each. On the basis of the (weighted) sum of the matching scores of each frame the identity of the speaker is decided. [0206]
  • Doppler-Based Applications and Measurement of Time-Delays. In communications, radar, sonar and geophysical seismology a signal to be estimated or reconstructed can often be described as a sum of harmonics in additive noise [P. Stoica and Ro. Moses, [0207] Introduction to Spectral Analysis, Prentice-Hall, 1997, page 139]. While traditional methods are designed for either white noise or no noise at all, estimation of sinusoids in colored noise has been regarded as difficult problem [B. Porat, Digital Processing of Random Signals, Prentice-Hall, 1994, pages 285-286]. THREE filter design is particularly suited for the colored noise case, and as an ARMA method it offers “super-resolution” capabilities [P. Stoica and Ro. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997, page 136]. As an illustration, see the second example in the introduction.
  • Tunable high-resolution speed estimation by Doppler radar. We disclose an apparatus based on THREE filter design for determining the velocities of several moving objects. If we track m targets moving with constant radial velocities v[0208] 1, v2, . . . , vm, respectively, by a pulse-Doppler radar emitting a signal of wave-length λ, the backscattered signal measured by the radar system after reflection of the objects takes the form y ( t ) = k = 1 m α k θ k t + v ( t ) ,
    Figure US20030055630A1-20030320-M00047
  • where θ[0209] 1, θ2, . . . , θm are the Doppler frequencies, ν(t) is the measurement noise, and α1, α2, . . . , αm are (complex) amplitudes. (See, e.g., B. Porat, Digital Processing of Random Signals, Prentice-Hall, 1994, page 402] or [P. Stoica and Ro. Moses, Introduction to Spectral Analysis, Prentice-Hall, 1997, page 175].) The velocities can then be determined as v k = λθ k 4 π Δ k = 1 , 2 , , m ,
    Figure US20030055630A1-20030320-M00048
  • where Δ is the pulse repetition interval, assuming once-per-pulse coherent in-phase/quadrature sampling. [0210]
  • FIG. 20 illustrates a Doppler radar environment for our method, which is based on the Encoder and Spectral Analyzer components of the THREE filter. To estimate the velocities amounts to estimating the Doppler frequencies which appear as spikes in the estimated spectrum, as illustrated in FIG. 7. The device is tuned to give high resolution in the particular frequency band where the Doppler frequencies are expected. [0211]
  • The only variation in combining the previously disclosed Encoder and Spectral Estimator lies in the use of dashed rather than solid communication links in FIG. 20. The dashed communication links are optional. When no sequence r of MA parameters is transmitted from [0212] Box 6 to Box 7′, Box 7′ chooses the default values r=(τ1, τ2, . . . , τm) , which are defined via (3.1) in terms of the sequence p of filter-bank parameters, transmitted by Component 4 to Box 7′. In the default case, Box 7′ also transmits the default values r=τ to Box 10. For those applications when it is desirable to tune the MA parameters sequence r from the observed data stream, as disclosed above, the dotted lines can be replaced by solid (open) communication links, which then transmit the tuned values of the MA parameter sequence r from Box 6 to Box 7′ and Box 10.
  • The same device can also be used for certain spatial doppler-based applications [P. Stoica and Ro. Moses, [0213] Introduction to Spectral Analysis, Prentice-Hall, 1997, page 248].
  • Tunable high-resolution time-delay estimator. The use of THREE filter design in line spectra estimation also applies to time delay estimation [M. A. Hasan and M. R. Azimi-Sadjadi, [0214] Separation of multiple time delays using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630] [M. Zeytino{haeck over (g)}lu and K. M. Wong, Detection of harmonic sets, IEEE Transactions on Signal Processing 43 (1995), 2618-2630] in communication. Indeed, the tunable resolution of THREE filters can be applied to sonar signal analysis, for example the identification of time-delays in underwater acoustics [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630].
  • FIG. 21 illustrates a possible time-delay estimator environment for our method, which has precisely the same THREE-filter structure as in FIG. 20 except for the preprocessing of the signal. In fact, this adaptation of THREE filter design is a consequence of Fourier analysis, which gives a method of interchanging frequency and time. In more detail, if x(t) is the emitted signal, the backscattered signal is of the form [0215] z ( t ) = k = 1 m h k ( t ) * x ( t - δ k ) + v ( t ) ,
    Figure US20030055630A1-20030320-M00049
  • where the first term is a sum of convolutions of delayed copies of the emitted signal and v(t) represents ambient noise and measurement noise. The convolution kernels h[0216] k, k=1, 2, . . . , m, represent effects of media or reverberation [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630], but they could also be δ-functions with Fourier transforms Hk(ω)≡1. Taking the Fourier transform, the signal becomes Z ( ω ) = k = 1 m H k ( ω ) X ( ω ) ωδ k + n ( ω ) ,
    Figure US20030055630A1-20030320-M00050
  • where the Fourier transform X(ω) of the original signal is known and can be divided off. [0217]
  • It is standard in the art to obtain a frequency-dependent signal from the time-dependent signal by fast Fourier methods, e.g., FFT. Sampling the signal Z(w) at frequencies ω=τω[0218] 0, τ=0, 1, 2, . . . , N, and using our knowledge of the power spectrum X(ω) of the emitted signal, we obtain an observation record
  • y[0219] 0,y1, y2. . . , yN
  • of a time series [0220] y ( τ ) = k = 1 m α k τθ k + v ( τ ) ,
    Figure US20030055630A1-20030320-M00051
  • where θ[0221] k0δk and ν(τ) is the corresponding noise. To estimate spectral lines for this observation record is to estimate θk, and hence δk for k=1, 2, . . . , m. The method and apparatus described in FIG. 20 is then a THREE line-spectra estimator as the one disclosed above and described in FIG. 20 with the modifications described here. In particular, the Transmitter/Receiver could be a sonar.
  • Other Areas of Application. The THREE filter method and apparatus can be used in the encoding and decoding of signals more broadly in applications of digital signal processing. In addition to speaker identification and verification, THREE filter design could be used as a part of any system for speech compression and speech processing. The use of THREE filter design line spectra estimation also applies to detection of harmonic sets [M. Zeytino{haeck over (g)}lu and K. M. Wong, [0222] Detection of harmonic sets, IEEE Transactions on Signal Processing 43 (1995), 2618-2630]. Other areas of potential importance include identification of formants in speech and data decimation [M. A. Hasan and M. R. Azimi-Sadjadi, Separation of multiple time delays using new spectral estimation schemes, IEEE Transactions on Signal Processing 46 (1998), 2618-2630]. Finally, we disclose that the fixed-mode THREE filter, where the values of the MA parameters are set at the default values determined by the filter-bank poles also possesses a security feature because of its fixed-mode feature: If both the sender and receiver share a prearranged set of filter-bank parameters, then to encode, transmit and decode a signal one need only encode and transmit the parameters w generated by the bank of filters. Even in a public domain broadcast, one would need knowledge of the filter-bank poles to recover the transmitted signal.
  • Various changes may be made to the invention as would be apparent to those skilled in the art. However, the invention is limited only to the scope of the claims appended hereto, and their equivalents. [0223]
    Figure US20030055630A1-20030320-P00001
    Figure US20030055630A1-20030320-P00002
    Figure US20030055630A1-20030320-P00003
    Figure US20030055630A1-20030320-P00004
    Figure US20030055630A1-20030320-P00005
    Figure US20030055630A1-20030320-P00006
    Figure US20030055630A1-20030320-P00007
    Figure US20030055630A1-20030320-P00008
    Figure US20030055630A1-20030320-P00009
    Figure US20030055630A1-20030320-P00010
    Figure US20030055630A1-20030320-P00011
    Figure US20030055630A1-20030320-P00012
    Figure US20030055630A1-20030320-P00013
    Figure US20030055630A1-20030320-P00014
    Figure US20030055630A1-20030320-P00015
    Figure US20030055630A1-20030320-P00016
    Figure US20030055630A1-20030320-P00017
    Figure US20030055630A1-20030320-P00018
    Figure US20030055630A1-20030320-P00019
    Figure US20030055630A1-20030320-P00020
    Figure US20030055630A1-20030320-P00021
    Figure US20030055630A1-20030320-P00022
    Figure US20030055630A1-20030320-P00023
    Figure US20030055630A1-20030320-P00024
    Figure US20030055630A1-20030320-P00025
    Figure US20030055630A1-20030320-P00026
    Figure US20030055630A1-20030320-P00027
    Figure US20030055630A1-20030320-P00028
    Figure US20030055630A1-20030320-P00029
    Figure US20030055630A1-20030320-P00030
    Figure US20030055630A1-20030320-P00031
    Figure US20030055630A1-20030320-P00032
    Figure US20030055630A1-20030320-P00033
    Figure US20030055630A1-20030320-P00034
    Figure US20030055630A1-20030320-P00035
    Figure US20030055630A1-20030320-P00036
    Figure US20030055630A1-20030320-P00037
    Figure US20030055630A1-20030320-P00038
    Figure US20030055630A1-20030320-P00039
    Figure US20030055630A1-20030320-P00040
    Figure US20030055630A1-20030320-P00041
    Figure US20030055630A1-20030320-P00042
    Figure US20030055630A1-20030320-P00043
    Figure US20030055630A1-20030320-P00044
    Figure US20030055630A1-20030320-P00045
    Figure US20030055630A1-20030320-P00046
    Figure US20030055630A1-20030320-P00047
    Figure US20030055630A1-20030320-P00048
    Figure US20030055630A1-20030320-P00049
    Figure US20030055630A1-20030320-P00050
    Figure US20030055630A1-20030320-P00051
    Figure US20030055630A1-20030320-P00052
    Figure US20030055630A1-20030320-P00053
    Figure US20030055630A1-20030320-P00054
    Figure US20030055630A1-20030320-P00055
    Figure US20030055630A1-20030320-P00056
    Figure US20030055630A1-20030320-P00057
    Figure US20030055630A1-20030320-P00058
    Figure US20030055630A1-20030320-P00059
    Figure US20030055630A1-20030320-P00060
    Figure US20030055630A1-20030320-P00061
    Figure US20030055630A1-20030320-P00062
    Figure US20030055630A1-20030320-P00063
    Figure US20030055630A1-20030320-P00064
    Figure US20030055630A1-20030320-P00065
    Figure US20030055630A1-20030320-P00066
    Figure US20030055630A1-20030320-P00067
    Figure US20030055630A1-20030320-P00068
    Figure US20030055630A1-20030320-P00069
    Figure US20030055630A1-20030320-P00070
    Figure US20030055630A1-20030320-P00071
    Figure US20030055630A1-20030320-P00072
    Figure US20030055630A1-20030320-P00073
    Figure US20030055630A1-20030320-P00074
    Figure US20030055630A1-20030320-P00075
    Figure US20030055630A1-20030320-P00076
    Figure US20030055630A1-20030320-P00077
    Figure US20030055630A1-20030320-P00078
    Figure US20030055630A1-20030320-P00079
    Figure US20030055630A1-20030320-P00080
    Figure US20030055630A1-20030320-P00081
    Figure US20030055630A1-20030320-P00082
    Figure US20030055630A1-20030320-P00083
    Figure US20030055630A1-20030320-P00084
    Figure US20030055630A1-20030320-P00085
    Figure US20030055630A1-20030320-P00086
    Figure US20030055630A1-20030320-P00087
    Figure US20030055630A1-20030320-P00088
    Figure US20030055630A1-20030320-P00089
    Figure US20030055630A1-20030320-P00090
    Figure US20030055630A1-20030320-P00091
    Figure US20030055630A1-20030320-P00092
    Figure US20030055630A1-20030320-P00093
    Figure US20030055630A1-20030320-P00094
    Figure US20030055630A1-20030320-P00095
    Figure US20030055630A1-20030320-P00096
    Figure US20030055630A1-20030320-P00097
    Figure US20030055630A1-20030320-P00098
    Figure US20030055630A1-20030320-P00099
    Figure US20030055630A1-20030320-P00100
    Figure US20030055630A1-20030320-P00101

Claims (28)

What is claimed is:
1. A signal encoder for determining a plurality of filter parameters from an input signal for later reproduction of said signal, said encoder comprising a bank of first order filters, each of said filters being tuned to a preselected frequency, and a covariance estimator connected to the output of said filter bank for estimating covariances from which filter parameters may be calculated for a filter to reproduce said signal.
2. The signal encoder of claim 1 wherein said filter parameters comprise specification of filter poles and filter zeros.
3. The signal encoder of claim 2 wherein said filters comprising said bank of filters are adjustable to permit their being tuned to a desired frequency based on a priori information.
4. The signal encoder of claim 2 wherein said filters comprising said bank of filters are adjustable to permit their being tuned to a desired frequency based on properties of said input signal.
5. The signal encoder of claim 4 wherein said properties are measured frequencies of said input signal.
6. The signal encoder of claim 3 wherein the number of filters comprising said filter bank are adjustable.
7. The signal encoder of claim 6 wherein said filter parameters at least partially define an ARMA filter, and wherein one or more filter zeros are preselected to further define said ARMA filter.
8. The signal encoder of claim 7 wherein said ARMA filter is of lattice-ladder architecture.
9. The signal encoder of claim 1 further comprising a signal synthesizer coupled to said signal encoder.
10. The signal encoder/signal synthesizer of claim 9 wherein said signal synthesizer further comprises a decoder for receiving the covariances from said signal encoder and produce a plurality of filter parameters in response thereto, a parameter transformer coupled to said decoder, and an ARMA filter coupled to said parameter transformer, said ARMA filter being adjustable to effect reproduction of said input signal through processing of a preselected excitation signal.
11. The signal encoder/signal synthesizer of claim 10 wherein said ARMA filter is adjustable in response to said parameter transformer output.
12. The signal encoder/signal synthesizer of claim 11 wherein said excitation signal is preselected.
13. The signal encoder/signal synthesizer of claim 12 wherein said excitation signal is determined by said signal encoder and communicated to said signal synthesizer for excitation of said ARMA filter.
14. The signal encoder/signal synthesizer of claim 13 wherein said ARMA filter includes filter zeros, and wherein said filter zeros are preselected.
15. The signal encoder/signal synthesizer of claim 13 wherein said ARMA filter includes filter zeros, and wherein said filter zeros are specified by a set of MA parameters generated by said signal encoder, said set of MA parameters being adjustable in response to said input signal.
16. The signal encoder of claim 1 further comprising a spectral analyzer coupled to said signal encoder, said spectral analyzer determining the power frequency spectrum of said input signal in response to the output of said signal encoder.
17. The signal encoder/spectral analyzer of claim 16 wherein said spectral analyzer includes a decoder for producing a set of filter parameters, and a spectral plotter for producing a response reflective of the power frequency spectrum of the input signal.
18. A device for verifying the identity of a speaker based on his spoken speech, said device comprising a voice input device for receiving a speaker's voice and processing it for further comparison, a bank of first order filters coupled to said voice input device, each of said filters being tuned to a preselected frequency, a covariance estimator coupled to said filter bank for estimating filter covariances, a decoder coupled to said covariance estimator for producing a plurality of filter parameters, and a comparator for comparing said produced filter parameters with prerecorded speaker input filter parameters and thereby verifying the speaker's identity or not.
19. The device of claim 18 further comprising a memory coupled to said comparator for storing said prerecorded speaker input filter parameters.
20. The device of claim 18 further comprising an input device coupled to said comparator to allow for the contemporaneous input of pre-recorded speaker filter parameters by a user.
21. A Doppler-based speed estimator comprising a pulse-Doppler radar for producing an output of Doppler frequencies, a HREE filter coupled to said radar, and a spectral plotter coupled to said HREE filter for determining the power frequency spectrum of said radar output, said power frequency spectrum thereby specifying the speed of any objects sensed by said radar.
22. A device for estimating the delay between any two signals, said device including a sensing device for producing a time based output reflective of any delay desired to be estimated, a Fourier transformer for converting said time based output to a frequency based output, a HREE filter coupled to said transformer, and a spectral plotter coupled to said HREE filter for determining the power frequency spectrum of said time based signal, said power frequency spectrum thereby specifying said delay.
23. A method for analyzing a signal comprising the steps of passing said signal through a bank of lower order filters, each of said filters being tuned to a preselected frequency, and estimating a plurality of covariances from the output of said filter bank, said covariances being sufficient for calculating a plurality of filter parameters for a HREE filter, said HREE filter thereby being capable of reproducing said signal.
24. The method of claim 23 further comprising the step of calculating the HREE filter parameters from said covariances, and adjusting a HREE filter in accordance with said calculated filter parameters for reproduction of said signal.
25. The method of claim 24 further comprising the step of adjusting said filter parameters based on the input signal.
26. A method of verifying the identity of a speaker based on his spoken speech, said method comprising the steps of receiving a speaker's voice, processing said voice input for further comparison by passing it through a bank of lower order filters, each of said filters being tuned to a preselected frequency, estimating a plurality of filter covariances from said filter outputs, producing a plurality of filter parameters from said filter covariances, and comparing said filter parameters with prerecorded speaker input filter parameters and thereby verifying the speaker's identity or not.
27. A method of estimating a speed of an object with a Doppler-based radar comprising the steps of producing an output of Doppler frequencies with said Doppler-based radar, passing said frequencies through a HREE filter, and determining the power frequency spectrum of said frequencies to thereby specify the speed of said object.
28. A method for estimating the delay between any two signals, said method comprising the steps of producing a time based output reflective of any delay desired to be estimated, converting said time based output to a frequency based output by taking its Fourier transform, and determining the power frequency spectrum of said frequency based signal to thereby specify said delay.
US10/162,182 1998-10-22 2002-06-04 Method and apparatus for a tunable high-resolution spectral estimator Abandoned US20030055630A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/162,182 US20030055630A1 (en) 1998-10-22 2002-06-04 Method and apparatus for a tunable high-resolution spectral estimator

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/176,984 US6400310B1 (en) 1998-10-22 1998-10-22 Method and apparatus for a tunable high-resolution spectral estimator
US10/162,182 US20030055630A1 (en) 1998-10-22 2002-06-04 Method and apparatus for a tunable high-resolution spectral estimator

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/176,984 Division US6400310B1 (en) 1998-10-22 1998-10-22 Method and apparatus for a tunable high-resolution spectral estimator

Publications (1)

Publication Number Publication Date
US20030055630A1 true US20030055630A1 (en) 2003-03-20

Family

ID=22646701

Family Applications (3)

Application Number Title Priority Date Filing Date
US09/176,984 Expired - Fee Related US6400310B1 (en) 1998-10-22 1998-10-22 Method and apparatus for a tunable high-resolution spectral estimator
US10/162,182 Abandoned US20030055630A1 (en) 1998-10-22 2002-06-04 Method and apparatus for a tunable high-resolution spectral estimator
US10/162,502 Expired - Fee Related US7233898B2 (en) 1998-10-22 2002-06-04 Method and apparatus for speaker verification using a tunable high-resolution spectral estimator

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/176,984 Expired - Fee Related US6400310B1 (en) 1998-10-22 1998-10-22 Method and apparatus for a tunable high-resolution spectral estimator

Family Applications After (1)

Application Number Title Priority Date Filing Date
US10/162,502 Expired - Fee Related US7233898B2 (en) 1998-10-22 2002-06-04 Method and apparatus for speaker verification using a tunable high-resolution spectral estimator

Country Status (5)

Country Link
US (3) US6400310B1 (en)
EP (1) EP1131817A4 (en)
AU (1) AU1312200A (en)
CA (1) CA2347187A1 (en)
WO (1) WO2000023986A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050273319A1 (en) * 2004-05-07 2005-12-08 Christian Dittmar Device and method for analyzing an information signal
US20070063887A1 (en) * 2005-09-06 2007-03-22 Christian Chaure Method of determining the velocity field of an air mass by high resolution doppler analysis
US20110295599A1 (en) * 2009-01-26 2011-12-01 Telefonaktiebolaget Lm Ericsson (Publ) Aligning Scheme for Audio Signals
CN104376306A (en) * 2014-11-19 2015-02-25 天津大学 Optical fiber sensing system invasion identification and classification method and classifier based on filter bank
CN107561484A (en) * 2017-08-24 2018-01-09 浙江大学 The Wave arrival direction estimating method rebuild based on the relatively prime array covariance matrix of interpolation
CN110648658A (en) * 2019-09-06 2020-01-03 北京达佳互联信息技术有限公司 Method and device for generating voice recognition model and electronic equipment

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3151489B2 (en) * 1998-10-05 2001-04-03 運輸省船舶技術研究所長 Apparatus for detecting fatigue and dozing by sound and recording medium
US6400310B1 (en) * 1998-10-22 2002-06-04 Washington University Method and apparatus for a tunable high-resolution spectral estimator
FR2789492A1 (en) * 1999-02-08 2000-08-11 Mitsubishi Electric Inf Tech METHOD OF ESTIMATING THE RELATIVE MOTION SPEED OF A TRANSMITTER AND A COMMUNICATION RECEIVER WITH EACH OTHER OF A TELECOMMUNICATIONS SYSTEM
EP1200851B1 (en) * 1999-07-20 2010-01-27 Qualcom Incorporated Method for determining a change in a communication signal and using this information to improve sps signal reception and processing
US7047196B2 (en) * 2000-06-08 2006-05-16 Agiletv Corporation System and method of voice recognition near a wireline node of a network supporting cable television and/or video delivery
US8095370B2 (en) 2001-02-16 2012-01-10 Agiletv Corporation Dual compression voice recordation non-repudiation system
US6690166B2 (en) * 2001-09-26 2004-02-10 Southwest Research Institute Nuclear magnetic resonance technology for non-invasive characterization of bone porosity and pore size distributions
FR2847361B1 (en) * 2002-11-14 2005-01-28 Ela Medical Sa DEVICE FOR ANALYZING A SIGNAL, IN PARTICULAR A PHYSIOLOGICAL SIGNAL SUCH AS AN ECG SIGNAL
WO2004095713A2 (en) * 2003-04-14 2004-11-04 Bae Systems Information And Electronic Systems Integration Inc. Joint symbol, amplitude, and rate estimator
US7184938B1 (en) * 2004-09-01 2007-02-27 Alereon, Inc. Method and system for statistical filters and design of statistical filters
US10223934B2 (en) 2004-09-16 2019-03-05 Lena Foundation Systems and methods for expressive language, developmental disorder, and emotion assessment, and contextual feedback
US8938390B2 (en) * 2007-01-23 2015-01-20 Lena Foundation System and method for expressive language and developmental disorder assessment
US9355651B2 (en) 2004-09-16 2016-05-31 Lena Foundation System and method for expressive language, developmental disorder, and emotion assessment
US9240188B2 (en) 2004-09-16 2016-01-19 Lena Foundation System and method for expressive language, developmental disorder, and emotion assessment
US7720013B1 (en) * 2004-10-12 2010-05-18 Lockheed Martin Corporation Method and system for classifying digital traffic
US20070206705A1 (en) * 2006-03-03 2007-09-06 Applied Wireless Identification Group, Inc. RFID reader with adjustable filtering and adaptive backscatter processing
US7450051B1 (en) 2005-11-18 2008-11-11 Valentine Research, Inc. Systems and methods for discriminating signals in a multi-band detector
US8112247B2 (en) * 2006-03-24 2012-02-07 International Business Machines Corporation Resource adaptive spectrum estimation of streaming data
JP4573792B2 (en) * 2006-03-29 2010-11-04 富士通株式会社 User authentication system, unauthorized user discrimination method, and computer program
CN101051464A (en) * 2006-04-06 2007-10-10 株式会社东芝 Registration and varification method and device identified by speaking person
WO2007130588A2 (en) * 2006-05-04 2007-11-15 Regents Of The University Of Minnesota Radio frequency field localization for magnetic resonance
EP2126901B1 (en) * 2007-01-23 2015-07-01 Infoture, Inc. System for analysis of speech
DE102007018190B3 (en) * 2007-04-18 2009-01-22 Lfk-Lenkflugkörpersysteme Gmbh Method for ascertaining motion of target object involves utilizing semi-martingale algorithm based on model equations that represented by smooth semi-martingales for estimating motion
CN101578659B (en) * 2007-05-14 2012-01-18 松下电器产业株式会社 Voice tone converting device and voice tone converting method
KR100922897B1 (en) * 2007-12-11 2009-10-20 한국전자통신연구원 An apparatus of post-filter for speech enhancement in MDCT domain and method thereof
TW201131511A (en) * 2010-03-10 2011-09-16 Chunghwa Picture Tubes Ltd Super-resolution method for video display
US8527268B2 (en) 2010-06-30 2013-09-03 Rovi Technologies Corporation Method and apparatus for improving speech recognition and identifying video program material or content
US20120004911A1 (en) * 2010-06-30 2012-01-05 Rovi Technologies Corporation Method and Apparatus for Identifying Video Program Material or Content via Nonlinear Transformations
US8761545B2 (en) 2010-11-19 2014-06-24 Rovi Technologies Corporation Method and apparatus for identifying video program material or content via differential signals
US8816899B2 (en) * 2012-01-26 2014-08-26 Raytheon Company Enhanced target detection using dispersive vs non-dispersive scatterer signal processing
US9363024B2 (en) * 2012-03-09 2016-06-07 The United States Of America As Represented By The Secretary Of The Army Method and system for estimation and extraction of interference noise from signals
EP2828853B1 (en) 2012-03-23 2018-09-12 Dolby Laboratories Licensing Corporation Method and system for bias corrected speech level determination
US9128064B2 (en) 2012-05-29 2015-09-08 Kla-Tencor Corporation Super resolution inspection system
CN104885150B (en) * 2012-08-03 2019-06-28 弗劳恩霍夫应用研究促进协会 The decoder and method of the universal space audio object coding parameter concept of situation are mixed/above mixed for multichannel contracting
KR20160014625A (en) * 2013-05-28 2016-02-11 톰슨 라이센싱 Method and system for identifying location associated with voice command to control home appliance
EP2830061A1 (en) 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding and decoding an encoded audio signal using temporal noise/patch shaping
US20150242547A1 (en) * 2014-02-27 2015-08-27 Phadke Associates, Inc. Method and apparatus for rapid approximation of system model
WO2016095218A1 (en) 2014-12-19 2016-06-23 Dolby Laboratories Licensing Corporation Speaker identification using spatial information
US10529357B2 (en) 2017-12-07 2020-01-07 Lena Foundation Systems and methods for automatic determination of infant cry and discrimination of cry from fussiness

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4344148A (en) * 1977-06-17 1982-08-10 Texas Instruments Incorporated System using digital filter for waveform or speech synthesis
US4544919A (en) * 1982-01-03 1985-10-01 Motorola, Inc. Method and means of determining coefficients for linear predictive coding
US4827518A (en) * 1987-08-06 1989-05-02 Bell Communications Research, Inc. Speaker verification system using integrated circuit cards
US4837830A (en) * 1987-01-16 1989-06-06 Itt Defense Communications, A Division Of Itt Corporation Multiple parameter speaker recognition system and methods
US5293448A (en) * 1989-10-02 1994-03-08 Nippon Telegraph And Telephone Corporation Speech analysis-synthesis method and apparatus therefor
US5522012A (en) * 1994-02-28 1996-05-28 Rutgers University Speaker identification and verification system
US5943421A (en) * 1995-09-11 1999-08-24 Norand Corporation Processor having compression and encryption circuitry
US6064768A (en) * 1996-07-29 2000-05-16 Wisconsin Alumni Research Foundation Multiscale feature detector using filter banks
US6064962A (en) * 1995-09-14 2000-05-16 Kabushiki Kaisha Toshiba Formant emphasis method and formant emphasis filter device

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5053983A (en) * 1971-04-19 1991-10-01 Hyatt Gilbert P Filter system having an adaptive control for updating filter samples
CA976154A (en) * 1972-07-12 1975-10-14 Morio Shibata Blender with algorithms associated with selectable motor speeds
US4209836A (en) 1977-06-17 1980-06-24 Texas Instruments Incorporated Speech synthesis integrated circuit device
FR2481026B1 (en) 1980-04-21 1984-06-15 France Etat
US4941178A (en) 1986-04-01 1990-07-10 Gte Laboratories Incorporated Speech recognition using preclassification and spectral normalization
AU620384B2 (en) 1988-03-28 1992-02-20 Nec Corporation Linear predictive speech analysis-synthesis apparatus
US5023910A (en) 1988-04-08 1991-06-11 At&T Bell Laboratories Vector quantization in a harmonic speech coding arrangement
US5179626A (en) 1988-04-08 1993-01-12 At&T Bell Laboratories Harmonic speech coding arrangement where a set of parameters for a continuous magnitude spectrum is determined by a speech analyzer and the parameters are used by a synthesizer to determine a spectrum which is used to determine senusoids for synthesis
DE3829999A1 (en) * 1988-09-01 1990-03-15 Schering Ag ULTRASONIC METHOD AND CIRCUITS THEREOF
GB9016341D0 (en) 1990-07-25 1990-09-12 British Telecomm Speed estimation
WO1993018505A1 (en) 1992-03-02 1993-09-16 The Walt Disney Company Voice transformation system
US5432822A (en) 1993-03-12 1995-07-11 Hughes Aircraft Company Error correcting decoder and decoding method employing reliability based erasure decision-making in cellular communication system
JP2964879B2 (en) 1994-08-22 1999-10-18 日本電気株式会社 Post filter
US5790754A (en) * 1994-10-21 1998-08-04 Sensory Circuits, Inc. Speech recognition apparatus for consumer electronic applications
SE505156C2 (en) 1995-01-30 1997-07-07 Ericsson Telefon Ab L M Procedure for noise suppression by spectral subtraction
US5774839A (en) 1995-09-29 1998-06-30 Rockwell International Corporation Delayed decision switched prediction multi-stage LSF vector quantization
US5930753A (en) 1997-03-20 1999-07-27 At&T Corp Combining frequency warping and spectral shaping in HMM based speech recognition
US5940791A (en) * 1997-05-09 1999-08-17 Washington University Method and apparatus for speech analysis and synthesis using lattice ladder notch filters
JPH10326287A (en) 1997-05-23 1998-12-08 Mitsubishi Corp System and device for digital content management
US6236727B1 (en) 1997-06-24 2001-05-22 International Business Machines Corporation Apparatus, method and computer program product for protecting copyright data within a computer system
US6400310B1 (en) * 1998-10-22 2002-06-04 Washington University Method and apparatus for a tunable high-resolution spectral estimator

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4344148A (en) * 1977-06-17 1982-08-10 Texas Instruments Incorporated System using digital filter for waveform or speech synthesis
US4544919A (en) * 1982-01-03 1985-10-01 Motorola, Inc. Method and means of determining coefficients for linear predictive coding
US4837830A (en) * 1987-01-16 1989-06-06 Itt Defense Communications, A Division Of Itt Corporation Multiple parameter speaker recognition system and methods
US4827518A (en) * 1987-08-06 1989-05-02 Bell Communications Research, Inc. Speaker verification system using integrated circuit cards
US5293448A (en) * 1989-10-02 1994-03-08 Nippon Telegraph And Telephone Corporation Speech analysis-synthesis method and apparatus therefor
US5522012A (en) * 1994-02-28 1996-05-28 Rutgers University Speaker identification and verification system
US5943421A (en) * 1995-09-11 1999-08-24 Norand Corporation Processor having compression and encryption circuitry
US6064962A (en) * 1995-09-14 2000-05-16 Kabushiki Kaisha Toshiba Formant emphasis method and formant emphasis filter device
US6064768A (en) * 1996-07-29 2000-05-16 Wisconsin Alumni Research Foundation Multiscale feature detector using filter banks

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050273319A1 (en) * 2004-05-07 2005-12-08 Christian Dittmar Device and method for analyzing an information signal
US7565213B2 (en) * 2004-05-07 2009-07-21 Gracenote, Inc. Device and method for analyzing an information signal
US20090265024A1 (en) * 2004-05-07 2009-10-22 Gracenote, Inc., Device and method for analyzing an information signal
US8175730B2 (en) 2004-05-07 2012-05-08 Sony Corporation Device and method for analyzing an information signal
US20070063887A1 (en) * 2005-09-06 2007-03-22 Christian Chaure Method of determining the velocity field of an air mass by high resolution doppler analysis
US7535403B2 (en) * 2005-09-06 2009-05-19 Thales Method of determining the velocity field of an air mass by high resolution doppler analysis
US20110295599A1 (en) * 2009-01-26 2011-12-01 Telefonaktiebolaget Lm Ericsson (Publ) Aligning Scheme for Audio Signals
CN104376306A (en) * 2014-11-19 2015-02-25 天津大学 Optical fiber sensing system invasion identification and classification method and classifier based on filter bank
CN107561484A (en) * 2017-08-24 2018-01-09 浙江大学 The Wave arrival direction estimating method rebuild based on the relatively prime array covariance matrix of interpolation
CN110648658A (en) * 2019-09-06 2020-01-03 北京达佳互联信息技术有限公司 Method and device for generating voice recognition model and electronic equipment
US20200402500A1 (en) * 2019-09-06 2020-12-24 Beijing Dajia Internet Information Technology Co., Ltd. Method and device for generating speech recognition model and storage medium

Also Published As

Publication number Publication date
WO2000023986A1 (en) 2000-04-27
WO2000023986A8 (en) 2001-05-03
EP1131817A4 (en) 2005-02-09
US7233898B2 (en) 2007-06-19
US20030074191A1 (en) 2003-04-17
AU1312200A (en) 2000-05-08
EP1131817A1 (en) 2001-09-12
US6400310B1 (en) 2002-06-04
CA2347187A1 (en) 2000-04-27

Similar Documents

Publication Publication Date Title
US6400310B1 (en) Method and apparatus for a tunable high-resolution spectral estimator
EP0998740B1 (en) Method and apparatus for speech analysis and synthesis using lattice-ladder filters
McCree et al. A mixed excitation LPC vocoder model for low bit rate speech coding
US5781880A (en) Pitch lag estimation using frequency-domain lowpass filtering of the linear predictive coding (LPC) residual
Chazan et al. Speech reconstruction from mel frequency cepstral coefficients and pitch frequency
EP0575815B1 (en) Speech recognition method
US8447614B2 (en) Method and system to authenticate a user and/or generate cryptographic data
Quatieri et al. Estimation of handset nonlinearity with application to speaker recognition
CN1142274A (en) Speaker identification and verification system
Hwang et al. LP-WaveNet: Linear prediction-based WaveNet speech synthesis
US6456965B1 (en) Multi-stage pitch and mixed voicing estimation for harmonic speech coders
US20030187635A1 (en) Method for modeling speech harmonic magnitudes
Kumar Real‐time implementation and performance evaluation of speech classifiers in speech analysis‐synthesis
Pati et al. Speaker verification using excitation source information
McAulay Maximum likelihood spectral estimation and its application to narrow-band speech coding
Eyben et al. Acoustic features and modelling
Srivastava Fundamentals of linear prediction
Schafer Homomorphic systems and cepstrum analysis of speech
Pati et al. A comparative study of explicit and implicit modelling of subsegmental speaker-specific excitation source information
US6438517B1 (en) Multi-stage pitch and mixed voicing estimation for harmonic speech coders
Kim et al. Use of spectral autocorrelation in spectral envelope linear prediction for speech recognition
Krobba et al. Multitaper chirp group delay Hilbert envelope coefficients for robust speaker verification
Mudgal et al. Template Based Real-Time Speech Recognition Using Digital Filters on DSP-TMS320F28335
Fitzgerald et al. Speech processing using Bayesian inference
Zieliński et al. Speech Compression and Recognition

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA

Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF MINNESOTA;REEL/FRAME:035563/0053

Effective date: 20150428