WO2001003112A1 - Speech recognition system and method - Google Patents
Speech recognition system and method Download PDFInfo
- Publication number
- WO2001003112A1 WO2001003112A1 PCT/AU2000/000817 AU0000817W WO0103112A1 WO 2001003112 A1 WO2001003112 A1 WO 2001003112A1 AU 0000817 W AU0000817 W AU 0000817W WO 0103112 A1 WO0103112 A1 WO 0103112A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- speech
- speaker
- signification
- order
- words
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/1807—Speech classification or search using natural language modelling using prosody or stress
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/04—Speaking
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/06—Foreign languages
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L15/18—Speech classification or search using natural language modelling
- G10L15/183—Speech classification or search using natural language modelling using context dependencies, e.g. language models
- G10L15/187—Phonemic context, e.g. pronunciation rules, phonotactical constraints or phoneme n-grams
Definitions
- speech recognition is to be given a broad meaning
- the expression recognition' for example is to be understood to include, inter alia, analysis (including forensic analysis), synthesis and interpretation, coding and de-coding
- speech ' is to be understood to include all speech and voice whether human or artificial Common expressions used in the art and which are to be regarded as being included within the meaning of the expression speech recognition" as used herein include voice recognition, language processing, speech research, spoken-language processing, speech perception, speech synthesis etc
- the invention has particular but not exclusive application to the recognition, analysis and interpretation of spoken English (SE)
- SE spoken English
- SE spoken English
- VRT voice recognition technology
- ESL teaching and analysis of SE, both as a first language and as a second or other language, hereafter called 'English as a second language
- Linguistic s general definition that language is a communication system composed of arbitrary symbols which possess an agreed-upon significance within a community, are independent of immediate context and are connected in rule-governing ways
- VRT Voice recognition techniques and technology
- Timetable voice activated hands-free control such as for example can be used for vehicular and appliance control, voice activated control of bio-medical devices for the disabled, name dialling for telephones etc
- VRT associated with SE has not achieved its potential and advanced to the extent that technology would otherwise permit because modern SE is traditionally regarded as a stress timed language and is analysed for VRT purposes in accordance with the classical Saussarean universal language sign and the Applied Linguistic general definition and other theories of language that are based upon them
- SE has an analytic (hereafter called analytical) phonology in which words and language have two values or orders of signification
- the first value relating to words is a standardised or fixed phonetic value and entity which is set by convention, such for example, as defined by the phonetic entries of individual words found in dictionaries using the International Phonetic Alphabet (IPA) and other systems of phonetic notation such as those used by American dictionaries, or as defined by common usage
- IPA International Phonetic Alphabet
- the word s first value possesses an agreed upon meaning
- standardised forms functions and structures signify readily understood grammatical syntactical and linguistic forms functions and structures (hereafter called standardised forms functions and structures or readily understood forms, functions and structures' or 'standardised indicators')
- standardised forms, functions and structures exist independently of the speaker and include such things as for example word order, syntactical formulas, phrases, clauses, sentences, parts of speech, reference words, verb tense, case, voice, aspect, mood, marking the sequencing and relationships of clauses, discourse marking and structuring, time and place markers, register, and socio-linguistic practices, etc.
- standardised forms, functions and structures are established by convention and common usage and may enable more complex social communication to occur within that community of SE speakers.
- the forms, structures and functions desc ⁇ bed above can effectively be regarded as a first value or order of signification relating to language.
- the second value relating to words is a variable phonetic value and identity.
- the second value is variable in time and sound qualities and composition and is defined by the individual speaker at the moment of utterance
- the word's second value may possess a further variable meaning, or meanings, that emanates from its first value but which is also relative to the circumstances of the word's immediate "real life" context and the word's place within the flow of connected speech
- the variable sound and time imagery obtained by the second value of words and language may also signify some of the various standardised forms, functions and structures of speech, as outlined above
- the present invention aims to provide an alternative to known speech recognition systems and methods
- This invention in one aspect resides broadly in a method of recognising speech consisting of words having syllables and phonemes, the method including:- assigning first and second orders of signification to a word; wherein the first order of signification includes standardised indicators having agreed meanings independent of the speaker, and the second order of signification includes variable indicators having meanings which are generated by the speaker and are dependent on the context of the word in the flow of connected speech
- the speech is spoken English.
- the method includes - assigning first and second orders of signification to language, wherein the first order of signification assigned to language includes forms, functions and structures independent of the speaker, and the second order of signification assigned to language includes variable forms, functions and structures which are generated by the speaker and are dependent on the context of the word(s) and/or utterance(s) ⁇ n the flow of connected speech.
- the method includes:- analysing the word/s and speech in accordance with the first and second orders of signification
- the vanable indicators include the pronunciation of phonemes, syllables and words in the speech
- the syllables are preferably categonsed as being either free syllables, protected syllables or restricted syllables
- the expression "protected syllable' means the syllable that customarily carries the mam stress in a polysyllabic word but in connected speech may assume any value of stress so long as it is pronounced distinctly
- the expression "free syllable” means the syllable that customarily carries main secondary or tertiary stress in a polysyllabic word and also means all monosyllabic words In words in connected speech the free syllable may assume any value of stress, however prominent or reduced
- the expression “restricted syllable” refers to the syllable in a polysyllabic word that does not carry main stress, or main secondary or tertiary stress In words in connected speech the restricted syllable may assume a value of stress equal to or less than the free and protected syllables in that word
- variable indicators include features of speech such as variations in pitch, tone, harmonic content, volume, duration, rhythm, tempo and the rate of syllables spoken per second. It is also preferred that the variable indicators include other suprasegmental or prosodic features of speech such as variations in the speed of delivery, variations in enunciation, variations in pausing, va ⁇ ations in phrasing and va ⁇ ations in word linking.
- variable indicators include those grammatical, linguistic and syntactical forms, functions and structures (hereafter called 'variable forms, functions and structures' or 'variable indicators') which are communicated by the speaker by way of variable sound imagery in speech.
- variable indicators include the facts of the immediate context pertaining to the words and utterances in the flow of connected speech
- the method further includes - recording speech spoken by a speaker; indicating to the speaker the meanings of the va ⁇ able indicators of the recorded speech, and designating or affirming the meanings of the variable indicators indicated to the speaker.
- the method also includes storing data representative of analysed words for which the meanings of the variable indicators have been designated or affirmed
- this invention resides broadly in a method of recognising speech consisting of words having syllables and phonemes, the method including.- assigning first and second orders of signification to words and language; wherein the first order of signification includes words and language having standardised indicators having agreed meanings and forms, functions and structures independent of the speaker, and the second order of signification includes words and language possessing va ⁇ able indicators signifying va ⁇ able meanings and forms, functions and structures which are generated by the speaker and which are dependent on the context of the words and utterance/s in the flow of connected speech
- the second order of signification is communicated by way of variable sound imagery in speech.
- this invention resides broadly in a system for recognising speech consisting of words having syllables and phonemes, the system including - recording means for recording speech spoken by a speaker; means for assigning a first order of signification to a word, the first order of signification including standardised indicators having agreed meanings independent of the speaker; means for assigning a second order of signification to a word, the second order of signification including variable indicators having meanings which are generated by the speaker and are dependent on the context of the word in the flow of connected speech, indicating means for indicating to a speaker the meanings of the variable indicators of the recorded speech, and designation means whereby a speaker designates or affirms the meanings of the variable indicators indicated by the indicating means
- this invention resides broadly in a system for recognising speech consisting of words having syllables and phonemes, the system including - recording means for recording speech spoken by a speaker, means for assigning a first order of signification to words and language, the first order of signification including standard
- the system also includes analysing means for analysing the words and speech in accordance with the first and second orders of signification It is further preferred that the system includes storage means for storing data representative of analysed words for which the meanings, and forms, functions and structures of the va ⁇ able indicators have been designated or affirmed
- this invention resides broadly in a method of teaching how to speak a language, the method including - assigning first and second orders of signification to a word, the word having syllables and phonemes, the first order of signification including standardised indicators having agreed meanings independent of the speaker and the second order of signification including variable indicators having meanings which are generated by the speaker and are dependent on the context of the word(s) in the flow of connected speech, and practicing speaking using different variable indicators in the second order of signification It is preferred that the method includes - assigning first and second orders of signification to language, the first order of signification including forms, functions and structures independent of the speaker and the second order of signification including forms, functions and structures which are generated by the speaker and are dependent on the context of the word(s) in the flow of connected speech It is preferred that the method also includes practising speaking in order to acquire the preferred respiratory, cognitive and vocal skills, and the preferred skills of physical and mental co-ordination, in using variable indicators in the second order of signification
- the method may further include analysing connected speech that exhibits different variable indicators in the second order of signification for the purposes of recognising and evaluating the speech for more complete meaning
- the language is spoken English and that it is taught as a first language it is also preferred that the language is spoken English and that it is taught as a second language
- FIGS 1 A to 1 F diagrammatically illustrate some variable word stressings of the word “disappointing” and illustrate free, restricted and protected syllables in connected speech
- FIGS 2A to 2G diagrammatically illustrate seven commonly understood uses of pitch and tone in SE, providing various examples of their use and readily understood meanings,
- FIGS 2H to 2J diagrammatically illustrate the uses of variable pitch and tone in spoken phrases to compress additional meaning into speech in the second order of signification
- FIG 3 is a flow chart of a method of recognising speech in accordance with the invention
- FIG 4 is a schematic block diagram illustrating a system for recognising speech in accordance with the invention Description of Preferred Embodiments of Invention
- Modern German for example, is a synthetic tongue, as was Latin
- a synthetic language is one that possesses a complicated system of grammar dependent upon the use of inflections
- Inflections are word endings or affixes that denote things such as gender (inanimate objects having a sex), case, voice, verb tense and number in spoken German, the more complex an idea to be expressed, the more inflections are required thereby producing words of many syllables
- the modern Germanic tongues thus continue to use inflections as an integral part of their grammatical systems.
- Modern English is called a syncretic or analytic language (hereafter referred to as an analytical language or an analytical system)
- An analytical language is opposrtional to the synthetic languages in its core philosophy and drive A key feature of an analytical system is that it does not depend upon inflections for expressing complex ideas and meanings.
- the system of inflections was largely abandoned sometime during the period currently referred to as Middle English
- an analytical language follows the reductionist path in seeking to express more complex ideas and meanings with shorter words, through the use of simpler grammatical forms and structures, through the flexibility of the function of words that may assume various parts of speech, (a flexibility which also enables the constant creation of catch phrases, context-specific jargon, and new desc ⁇ ptive words, phrases, terms and expressions) and through expedient pronunciation habits and practices such as word linking..
- Stress timed language systems include spoken German, Russian, Arabic and Greek. (SE has also traditionally been regarded, incorrectly in the view of the inventor, as a stress timed language) These spoken language systems are governed by a different timing principle than syllable timed phonologies
- the main tenets of a stress timed language are that
- main stress is to give prominence to certain words, or even one word, within an utterance, main stress falling on the salient syllable of the stressed word
- Main stress beats fall at roughly regular intervals of time within connected speech with weaker stress beats falling on the words and syllables in between (In English Linguistics, the chunk of speech between two main stress beats is often called a foot, with feet said to be "about the same” )
- SE is not a stress timed language as are those Germanic tongues governed by a stress timed phonology
- SE is beneficial to consider SE as being represented by a new category of phonological system - the analytical phonology
- Another example of an analytical language system is written Chinese which uses ideograms and not words composed of characters from an alphabet
- the new category of the Analytical Phonology redefines the nature, general properties and general principles of the English language phonological system that apply where English is spoken as the sole mother tongue of the majority, le Australia, Canada (other than Quebec), New Zealand and the United States of America - countries which were colonised and populated by England - and in Great B ⁇ tain and Ireland.
- stress shall be taken to mean those prosodic features of speech that the speaker may use to give vocal prominence to sounds, phonemes syllables words and utterances in connected speech
- Specific prosodic features that can combine to constitute stress include, for example, volume, pitch, tone, harmonic content, timing, rhythm, clarity, and the duration of a sound, phoneme, syllable, word or utterance in order that it may stand out and gain prominence
- stress' is used within this document this meaning is to be implied
- the protected syllable and the restricted syllable the gradations of stress in speech are otherwise freely transferable between phonemes (particularly the vowel sounds), syllables and words within utterances
- the gradation and composition of stress that may attend sounds, phonemes syllables words and phrases are relative to the utterance having due regard for the immediate context of the utterance within its particular stream of connected speech It is on this basis that the listener amongst other considerations evaluates the gradations, composition and contrasts of stress audible within the speaker's speech and judges what is being made prominent by the speaker in terms of both sound and words. Stress, as defined above, is capable of signifying meaning or facilitating it.
- the speaker may use stress to make certain sounds, syllables , words and phrases prominent in sound and meaning While stressed words and speech may, potentially, achieve vocal prominence, mam stress is not the only method by which words may stand out in speech
- 'unstressed' or understated words and speech may also signify prominence if weakly stressed speech can stand out in the stream of spoken discourse (for example, a weakly stressed sound, syllable, word, or words, embedded within a passage of highly stressed speech can achieve prominence)
- Prominence may also be achieved by way of the other phonological and prosodic features of everyday connected speech.
- the speaker may wish, for example, to highlight certain words, place special emphasis and focus on certain words and parts of speech, or juxtapose, rank, contrast, infer, counterpoint or complement meanings and ideas embodied within and between utterances.
- stress in natural SE may be termed variable
- the phonology of SE is analytical, and vice-versa, making it a language system markedly different from both the syllable timed and stress timed languages.
- SE is thus approp ⁇ ately categorised independently as representative of the analytical phonology.
- variable Stress The basic phonological functions and suprasegme ⁇ tal features of connected English speech are such that the fundamental materials of variable sound and time with which the native English speaker may construct speech, are quite rich and manifold. These variable sound and timing va ⁇ ations in connected English speech follow from the inescapable fact that stress in the spoken English language is variable.
- variable stress and a 'variably timed' phonological system is rational and logical and is the consequence of the spoken language system being governed by no one fixed principle of timing.
- Variable stress can be conceptualised as a phonological freedom rather than an imposition or restriction, and which is granted rather than imposed from within
- the key phonological functions of SE dependent on variable stress include variable timing and duration, va ⁇ able volume, variable rhythm and tempo and variable pitch and variable harmonic content.
- Other suprasegmental and prosodic features of speech effected by variable stress include variable speed of delivery, variable word linking, variable enunciation, variable pausing and variable phrasing All of the above key phonological features and phonological functions and the other suprasegmental features of everyday connected English speech are inextricably linked to va ⁇ able stress 'Stress' is well understood to have a commanding role to perform in the organising functions of the phonological system
- stress in SE is va ⁇ able, the interconnected phonological functions are also va ⁇ able Because stress is va ⁇ able the role of the other suprasegmental features of speech becomes important
- the listener is constantly keeping track of the particular audible qualities of each phoneme, syllable, word or phrase and on a comparative scale of values is registering and measuring variables such as
- the listener follows the flow of speech in order to gauge other sound features that can produce variation, paying attention to things such as
- a fundamental axiom of the analytical phonology is that the native speaker is free to apply any of the many variable phonological functions and suprasegmental features in the pronunciation of phonemes, syllables and words at choice which are obtainable in speech for the purposes of creating further meaning provided that such variations do not negate the agreed-upo ⁇ meanings of the words nor nullify the standardised and readily understood forms functions and structures of speech
- further meaning can be generated when the phonemes and syllables that constitute the word - still an arbitrary symbol possessing a static agreed-upon meaning - are varied in sound and timing according to the speaker's pronunciation and in ways the listener hears and registers as meaningful Having regard to the speaker's manner and habits of pronunciation, the variation of sound and timing and the application of the other variable and optional suprasegmental features at the level of the phoneme, syllable and word, cannot but effect the structure, qualities and organisation of spoken phrases and larger passages of discourse as connected speech progresses As noted, sound
- the three word utterance "I love you” consisting of three monosyllabic words, can potentially obtain virtually unlimited variable sound images in speech according to such factors as the phrase's internal contrasts of variable stress, variable pitch, variable tone, variable timing and duration, variable volume, va ⁇ able speed of delivery, the va ⁇ able degrees of distinctness and clarity obtainable, how the words might or might not be emphasised, if they are linked or unlinked to each other and the surrounding utterances, and the duration and qualities of the pauses that delineate the words and phrase
- the legitimate va ⁇ ations and contrasts, or variable sound imagery, that can produce second order meanings not only create further meaning/s in the mind of the listener/s but may also create new meaning/s in the mind of the listener/s
- This system through which the production of second order meaning in SE occurs may be termed the second order of signification.
- the phonetic system of SE differs markedly from the phonetic systems of the non-analytical language systems in numerous ways including the following:-
- the phonetic system of SE has the ability to tolerate marked and sometimes radical sound and timing variations within individual phonemes which having no one fixed principle of timing the system can permit
- the phonetic system will indifferently accept legitimate variations without negating the static agreed-upon meaning of the word and without rendering the individually varied phoneme that constitutes the word incomprehensible to the listener
- This remarkable tolerance of the English language phonetic system is exemplified by the ability of all of the six written vowels a, e, i, o, u and y (when a vowel sound) to assume or be influenced by the reduced vowel sound Id/ in certain and numerous syllables and words and in liberal application, such as the short vowel sounds in free and restricted syllables
- the ability of the system to tolerate hybrid sounds and phonemes in standard words and blurred sounds, phonemes, glides etc., between linked words, and the many unpredictable phonemic effects that come when syllables and words are made prominent or are linked Many such sounds cannot necessarily be placed in
- the phonetic system of SE does not have a basic, fixed and limited stock of phonemes that are used to construct syllables and words. Instead the phonetic identity and the quantity of legitimately varied phonemes actually available for the purposes of constructing intelligible syllables and words in everyday SE are so numerous they cannot be reliably counted
- words as phonetically defined, have two values, (i) a standardised or fixed phonetic value and identity set by convention and as defined by the phonetic entries of individual words found in dictionaries using the IPA, and other systems of phonetic notation, and
- (n) a variable phonetic value and identity, in terms of the phoneme's time and sound qualities and composition, something that is defined by the individual speaker in the moment of utterance and which is relative to its standardised phonetic value as well as to the circumstances of the word's immediate "real life" context and its place within the flow of connected speech
- the standardised phonetic value of a particular phoneme is the necessary reference point by which the phoneme s second variable value may be recognised, evaluated and interpreted for the purposes of producing second order meanings
- the speaker may well be making that sound, syllable or word/s prominent in speech in order to signal second order meaning, or meanings, to the listener
- the second "word stressing" is a variable that is defined by the individual speaker in the moment of utterance and which is relative to the word's standardised stressing as well as to the circumstances of the word's immediate 'real life" context and its place within the flow of connected speech
- va ⁇ able word stressing operates within certain limits and parameters These limits are defined by the three categories of syllables a polysyllabic word may obtain within the flow of everyday connected speech The three categories of syllables are -
- This syllable can assume any gradation of stress within an utterance, from being the most reduced sound to the one carrying main vocal prominence and any point in between It is different from the protected syllable, as it is the syllable which dictionaries define as carrying secondary stress of one level or another In many cases within the context of the phrase it may carry more stress than the syllable/s that by normal definition should carry the main stress of the word When this occurs, or in instances when the free syllable is a reduced sound, it is usually because the speaker wishes to communicate a second order meaning of some kind It need be noted that virtually all monosyllabic words may enjoy any gradation of stress vocal prominence, or duration of time ODtainable within natural connected speech, the small function words (such as a, an, is, the, of, to, in etc) included, for the purposes of producing second order meanings Therefore monosyllabic words can generally be regarded as free syllables Inflections in polysyllabic words of
- the restricted syllable This is the syllable in a word that by normal definition is unable to support main, secondary or tertiary stress
- syllables carrying the reduced sound Id/, and inflections in polysyllabic words of two syllables are rest ⁇ cted syllables
- the rest ⁇ cted syllable will very rarely assume the only main stress within a polysyllabic word
- main stress it is to give the word a variable sound or timing value in order to generate a particular second order meaning for the purposes of, say, mimicry or sarcasm
- the stress gradation or vocal prominence of the restricted syllable in a word will normally never be greater than the protected and/or free syllables within that word and is most often of an appreciably weaker gradation This does not mean however that the stress gradation of a particular rest ⁇ cted syllable in one particular word
- FIGS 1 A to 1 F illustrates the potentially va ⁇ able word stressings of the word “disappointing" with reference to free, restricted and protected syllables in the analytical phonology
- FIG 1 A shows the standardised dictionary stress pattern for the polysyllabic word "disappointing" which consists of the four syllables dis ap point and mg
- the word is subject to much va ⁇ ation in the traffic of connected speech when placed in different phrases carrying different second order meanings
- the first syllable dis which dictionaries define as having secondary stress
- the last syllable is also a free syllable
- the second syllable ap carrying the reduced sound Id/
- the restricted syllable is the restricted syllable
- the third syllable point carrying main stress, is the protected syllable.
- a word will deviate from its standardised word stressing and assume a variable word stressing and variable gradations of stress and prominence in connected speech for the purposes of signifying second order meaning
- the standardised stressing of a particular word is the necessary reference point by which the word's second variable stressing may be recognised, evaluated and interpreted for the purposes of producing second order meanings.
- the speaker may well be making that word 'prominent' in speech in order to signal second order meaning, or meanings, to the listener.
- variable stress in SE enhances the use of pitch and tone in everyday speech which, by extension, is likewise tethered to no one dominating or fixed principle of timing
- variable pitch and tone are a means by which the speaker may produce second order meanings in speech through the melodic interpretation of phonemes, syllables, words and phrases.
- Va ⁇ able duration and timing which allow for the reduction of sounds will also permit the elongation of sounds.
- the individual is free to apply appreciable variations and contrasts of tone and harmonic content (hereafter called 'tone' or contrasts of tone'), and pitch in speech
- variable pitch and tone in SE is a means by which phonemes, syllables and words may gain prominence in meaning within connected speech even if these phonemes, syllables and words are unattended by main stress, or even secondary stress (that is, unattended by, for example, prominent volume, emphasis or duration).
- variable tone and pitch restricted to the end of phrases only.
- the speaker's use of variable tone and pitch adds to the totality of meanings a spoken phrase may simultaneously support
- FIGS 2A to 2G illustrate some commonly used and readily understood uses of tone and pitch in connected speech These serve as further standardised indicators of speech.
- FIG 2A shows the use of a rising pitch and tone, commonly understood to signify a yes/no question, a clarifying question, a request for repetition, and interested feedback
- rising pitch and tone at the end of phrases or words commonly signifies a sense of doubt, incompletion, or a need to know more on the part of the speaker
- FIG 2B shows the use of a low rising pitch and tone commonly employed by speakers when reading items from a list to signify that the list is not yet complete, and commonly to signify more neutral feedback or mild interest in what is being said
- FIG 2C shows the use of flat or level pitch and tone in speech, commonly employed to signify disinterest, boredom or sarcasm In general, level tones will also commonly attend routine or impersonal conversational exchanges
- FIGS 2D and 2E show the use of rising-falling and falling- ⁇ smg pitch and tones, respectively. Both tone patterns are commonly understood to signify greater emotional content and expression attending the speaker's speech, or to signify contrasting or competing meanings, or to signify a change in register, mood or conversation topic on the part of the speaker
- FIG 2F shows the use of the falling pitch and tone in speech, commonly understood to signify completion, such as when reading the final item in a long list.
- a falling pitch and tone commonly attends information or "wh-" questions (such as What, When, Where etc) which are asked in the expectation that the answer will be readily provided
- Falling pitch and tone will also commonly attend declaratives, statements of fact, and mild apologies the speaker is making In general, a falling pitch and tone will commonly signify completion, and an absence of doubt in regard to the speaker's utterance.
- FIG 2G shows the use of a sharp falling pitch and tone which commonly attends stronger apologies, imperatives, firm statements and declaratives
- a sharp falling pitch and tone commonly signify finality, certainty, completion and commonly attend utterances that signify there is no doubt at all in the speaker's mind about what is being said.
- va ⁇ able pitch and tone in connected speech by the fluent speaker enables compression of meaning to occur in utterances when the words of the first order of signification communicate one meaning while, at the same time, the appreciable variations and contrasts of pitch and tone within the second order of signification signify other meanings
- FIG 2F illustrates this point.
- the question Did you murder your wife? combines both a yes/no question, signified by the words and the grammatical form of the utterance - the phrase's first order of meaning - while at the same time, there is an underlying declarative "I'm certain you did" that is being implied by the prominent falling tone of the speaker's speech, the utterance's second order of meaning, which is signifying the speaker's certainty and not doubt as regards the answer to his or her own question.
- FIGS 2F and 2G Speaker A's utterance I'm going to stop drinking may express opposing ideas and meanings simultaneously
- the words themselves, the phrase's first order of meaning express an apparently self-confident resolution, particularly as the words 'going' and 'stop' are stressed
- a rising tone and pitch at the end of the phrase around the word 'drinking' could betray the speaker's own sense of doubt or commitment to his or her stated intention, particularly noticeable if the phrase is strongly stressed.
- the 'mid rising pitch' Another example of this is the Australian tendency to finish statements on a rising tone (called the 'mid rising pitch') which combines two meanings through both first and second orders of signification
- the speaker is telling the listener something, narrating some past event, or relating information, by way of the words and forms, functions and structures of the first order of signification, while the voice is producing second order meaning by way of variable sound imagery le, the mid ⁇ sing pitch and tone at the end of each phrase is embedding the declarative in an habitual yes/no question: signifying a kind of abiding doubt or tentativeness on the speaker's part or a need to constantly check with the listener that he or she understands and is engaged in the conversation.
- a fluent speaker may also express a pejorative idea, a criticism, reproach or complaint by exploiting the opportunities the second order of signification offers Rather than deliver an insult in actual words, the speaker may choose to signify the pejorative content through his or her voice in order to achieve the same effect without actually saying anything pejorative in actual words.
- the speaker may articulate by way of the first order of signification the utterance You look fabulous! which would seem a plain and simple compliment But were the pitch and tone variations to combine with a weak stress beat to create va ⁇ able sound imagery exhibiting a tepid, or prominently understated, mid-falling or flat tone around the prominent syllable in fabulous this could give the phrase a sarcastic meaning
- second order meaning expressed by the voice, is signifying You (do ⁇ t) look fabulous or You look threatened
- Va ⁇ able pitch, tone, duration, timing and stress may also be used as signrfiers of second order meaning by speakers within certain regional sub-varieties of SE and within certain idiolects of SE as a kind of ⁇ n-group' speech code for the purposes of identifying one member of a certain speech community or ' ⁇ n-group' with his or her peers This is particularly prevalent among younger speakers of SE, such as second generation migrant youth in Sydney, the so-called Valley Girls' of Los Angeles and young followers of the Australian TV soap opera 'Neighbours' in the United Kingdom, who have adopted the Australian tendency of the 'mid rising pitch' in natural speech, hitherto unknown in that part of the world
- subtextual content, emotion, irony, idiomatic codes, complementary moods and meanings can be compressed within the one spoken English phrase without need of the speaker formulating a new spoken phrase in order to express these further meanings
- various forms, functions, and structures may also be signified by way of the variable sound imagery of second order meaning.
- any word in the phrase "You are going'” may gain prominence or stand out in some fashion without negating the agreed upon meanings of any of the words in the phrase and without disturbing the standardised or readily understood forms, functions, and structures of the utterance.
- the speaker were to make a particular word in the phrase especially prominent or noticeable then the cumulative meaning of the utterance would immediately change This is because the word that gains prominence or stands out in the flow of speech can signify second order meaning.
- second order meanings may, in the first instance, also be signified according to the speaker's arrangement, composition and placement of stress and vocal prominence within the phrase.
- the flexibility of the phonetic and phonological systems of SE enables the variable sound imagery of individual phonemes, syllables and words to gain prominence in speech that signifies meaning
- the permissive nature of the sound system of SE empowers the individual speaker with the vocal means by which he or she can choose which particular sound fragments, words, parts of speech, segments and passages of speech gain prominence within and between utterances and in what fashion prominence is to be achieved
- This phonological freedom allows the individual speaker to productively signify second order meaning to the extent that the speaker's variable sound imagery obtained in the one spoken phrase may support several second order meanings all at once.
- the speaker is able to make any word, or words, within any utterance prominent through the use of variable sound imagery
- the everyday habit of word linking aids the speaker in this cause for several important reasons, amongst them the following
- Variable sound imagery enables the speaker to differentiate one word from another in a linked, or partly linked, phrase. This is particularly necessary as words within utterances are very frequently linked to each other in natural speech
- word linking occurs the ends of individual words are changed or no longer distinct, nor do they necessarily need to be distinct, as spoken English is not a language system dependent upon inflections to communicate grammatical meaning
- the phonetic composition of the beginnings of words linked to preceding words is often effected
- the phonetic content of linked English words may depart from their standard or readily understood phonetic definition - often radically -- at the boundaries between one linked word and the next
- word linking causes a reduction in the number of phonemes within utterances to occur, or in the replacement of the standard phonetic content of words with other phonemes (such as, for example, 'glides') which allow the linked words to be pronounced more easily and quickly by the speaker.
- word linking can be regarded as a pragmatic means of reducing the forms and structures of utterances in that it preserves the time and energy of the speaker, thus serving the underlying analytic logic of spoken English,
- word linking is a chief characteristic of natural English speech
- the speaker is thus obliged to use variable sound imagery to make particular sounds, syllables and/or words distinct or comprehensible in particular ways that will communicate the agreed upon meaning of the word/s and enable the listener to quickly apprehend the speaker's meaning
- the speaker depends upon variable sound imagery to highlight, distinguish, clarify and differentiate sounds, syllables, words and parts of speech from each other in linked and connected speech
- Variable sound imagery may also help the speaker to organise and sequence the structures and functions of extended discourse
- the listener depends upon the speaker using variable sound imagery in natural linked and connected speech, for without variable sound imagery the listener would be lost and unguided in a sea of undifferentiated verbiage, In employing variable sound imagery in natural speech for the practical necessity of accommodating word
- variable stress in SE a variably timed' phonology
- variable sound features of speech these engender, commission the speaker with an abundance of prosodic devices that may freely be used in speech for creating the variable sound imagery that signifies second order meaning
- the speaker may work with other factors to generate variable sound imagery possessing meaning
- second order meaning could be obtained by speakers varying the sound imagery of sounds and phonemes in the same words and phrases when repeated, or repeating back the same sound imagery using different words and phrases, varying the sound imagery of their own speech in order to create contrast, juxtaposition or counterpoint to meanings of the first or second order embedded within their own speech or with those of another speaker, using variable sound imagery to signify grammatical, linguistic and syntactical forms, functions, and structures without the need of verbal formulations, or with reduced verbal formulations, using sound and timing variation and contrast, however distinctive and subtle, to create 'sound metaphors' so as to express ideas, meanings and moods in conjunction with, independently of, or even oppositional to the lexical content of
- the Analytical Phonology and the Faculties of the Speaker and Listener in SE The listener can understand such meanings communicated by sound and timing variations because of the appreciable and audible contrasts they create within the stream of connected speech in ways that the fluent listener notices, registers, decodes and attempts to interpret for meaning. This is a subliminal process as the intention to signify, and the ability to interpret, meanings in the second order of signification need not be conscious.
- Listeners and observers also rely on their own knowledge of English words and grammar and their own knowledge of the standardised indicators of the spoken English language, dialect, va ⁇ ety or idiolect to help them interpret second order meanings.
- the analytical phonology of SE requires both speaker and listener- having the highly specialised mental and physical faculties to formulate and generate second order meanings, possessing the complex of sophisticated and acute comparative and relative analytical skills and sensibilities needed to hear, recognise, register, measure and graduate sound and timing variations - however subtle, intricate and concurrent these may be - and with the ability to then interpret variable sound imagery for specific meaning; possessing an acute and abiding awareness of their immediate context which is axiomatic to the functioning of the second order as this dimension of the linguistic system is context dependent as the immediate context gives second order meaning motive.
- Such faculties are among the fundamentals that the native English language speaker must first acquire in order for this to occur They also typify the kind of skills and faculties that speakers of languages other than English must learn to acquire in tandem with those they already possess, and which voice recognition technologies must simulate, if effective communication in SE is to eventuate.
- variable sound images of standard words are obtained in speech in a way that does not negate the first order signification but, moreover, systematically generates the signifiers of further or new meaning, or enables the speaker to express meaning using reduced forms, functions and structures, i ⁇ the second order of meaning.
- the basic signifiers in the production of meaning in speech are phonemes which construct spoken phrases which are the basic units of second order meaning.
- SE phrase in everyday connected speech is understood by the native speaker as being both a lexical-grammatical entity while simultaneously being a - potentially highly - variable sound entity Therefore, it can be said that words within the analytical phonology of SE possess two values in meaning.
- the first value as an arbitrary symbol possessing a static agreed to meaning but with the potential to expand to concurrently gain a second variable value in meaning that the word may obtain in speech as a subjective and relative symbol.
- the word's first value is capable of expanding to simultaneously support more than one variable value in meaning, this being executed in the word's moment of utterance
- a speaker may employ variable sound imagery in response to a persistent 'yes/no' question
- the speaker may reply 'Yes' to the question, but by way of variable sound imagery clearly signify 'No', while at the same time be signifying the additional idea 'And don't keep asking me this question all the time'
- the listener is presented with a one-word answer that supports three meanings simultaneously: one agreed upon meaning plus two second order meanings.
- a word's second variable value in meaning may be in semantic agreement with, complementary to, independent of, or in opposition to, its agreed upon value in meaning and/or different second order meanings the same word may obtain in speech.
- reductio ⁇ ism variable sound imagery may signify various grammatical, syntactical and linguistic forms, functions, and structures in natural speech, compactness achieved through the compression of meaning in the second order of signification, and other forms of reductionism obtainable in the first order (such as, for example, the use of contractions, ellipsis, slang etc); diversity exemplified by the language's copious 'multicultural' corpus, and the many varieties and idiolects of spoken English that the language engenders and invents, an expansionist drive seen in the language s capacity to acquire new loan words from other languages, a ravenous, on-going process that its phonological system readily accepts when exotic words come to be placed into connected speech Evinced, also, by the ever expanding parameters of legitimate sound variability tolerated in modern and popular varieties over which no official high arbiter of 'correct speech
- RP and other recognised stable genres of SE usually change only gradually - or, in the case of genres such as 'Network- Ame ⁇ can-E ⁇ glish' these can sometimes change more rapidly via mass communication - all providing the necessary standardised indicators and conventional modes of speech which furnish discourse with the stable linguistic constituents that make the internal tension, play and contrast, which engenders variable sound imagery, intelligible; an ethos of individualism as the system of second order signification is highly speaker-centred; an ethos of indifferent equality between its speakers, exemplified by the practical necessity for the uniquely close and co-operative relationship between interlocutors that exists, irrespective of differences in their age and status
- SE comfortably accommodates and proliferates informal and popular genres of speech; an uncommon poetics' of discourse, exemplified by the wealth of subjective, psychological and sub-textual meanings that may resonate through the variable sound imagery of ordinary words and phrases signifying second order meanings which realise no literal form; - a high degree of linguistic evolvement in that both systems of
- SE can be regarded as a liberal-democratic institution in the classical sense of the term.
- FIG 3 a flow chart of a method of recognising speech in accordance with the invention.
- the method of recognising natural English speech (which consists of words having syllables and phonemes) includes assigning to SE words and speech a first order of signification (12) which includes words having standardised indicators possessing agreed meanings, and speech possessing standardised or readily understood grammatical, syntactical and linguistic forms, functions, and structures independent of the speaker. It also includes designating the syllables in words as being protected, restricted or free syllables which assigns a potential variability to each syllable that may be obtained in connected speech.
- a second order of signification is also assigned to SE words and speech (13), this second order having words possessing va ⁇ able indicators which have meanings, and speech possessing grammatical, syntactical and linguistic forms, functions, and structures which are generated by the speaker's use of variable sound imagery and that are dependent on the context of the word/s and utterance/s in the flow of connected speech
- variable indicators include the pronunciation (14) of phonemes, syllables and words in the speech with the syllables categorised as being either free syllables (15), protected syllables (16) or restricted syllables (17) according to the syllables' variable indicators which include the key phonological functions of speech (18) such as pitch, volume, tone, duration, rhythm and tempo as well as including other suprasegmental features of speech (19) such as, speed of delivery, enunciation, pausing, phrasing and word linking
- the words are then analysed (20) in accordance with the first and second orders of sign
- FIG 4 is a schematic block diagram illustrating a system for recognising speech such as SE consisting of words having syllables and phonemes and speech possessing grammatical, syntactical and linguistic forms, functions, and structures
- the system has a recorder 31 for recording speech spoken by a speaker 35
- Assigning means 32 assigns a first order of signification to a word, the first order of signification includes words having standardised indicators having agreed meanings, and speech possessing standardised or readily understood grammatical, syntactical and linguistic forms
- Indicating means 34 indicates to speaker 35 the meanings of the variable indicators in the speech which has been recorded
- Designation means 36 are operable by speaker 35 to designate or affirm the meanings of the variable indicators which have been indicated by indicating means 34 for subsequent transformation by transforming means 39 to output means 40 such as, for example, a printer of WP text, a computer controlled human voice simulator etc
- Analysing means 37 analyses words or speech in accordance with the first and second orders of signification and data representative of the analysed words and speech, for which the meanings of the variable indicators have been designated or affirmed, is stored in storage means 38
- Assignment means 32 and 33, analysing means 37, storage means 38 and transforming means 39 are embodied in a suitably programmed computer 41 , the peripherals to which include recorder 31 such as a microphone, indicating means 34 (screen), designating means 36 (keyboard or mouse) and output means 40 (printer screen, speaker etc)
- the system is designed for application at the level of the individual speaker or the individual operator who will use the system
- the system first defines the standardised value of words according to their phonetic content and agreed-upon meaning as is defined by a particular community of native English language speakers
- the system first defines the standardised or readily understood grammatical, syntactical and linguistic forms, functions, and structures representative of the variety of SE understood by the operator
- the individual speaker has the opportunity for direct input into defining or editing what the standardised
- the system then defines the second order meanings of words and speech
- the system samples the speech of the individual speaker and operator at its most natural and spontaneous, and in long durations This is preferably done in software generated contexts such as games, conversations and particular scenarios with which the individual speaker and operator is familiar and orientated This allows the individual to produce second order meanings within a defined or known context in an unrehearsed and spontaneous sampling of his or her everyday connected speech, allowing the individual to demonstrate a full and natural range of his or her vocal and pronunciation styles, emotions and registers The individual's particular and authentic qualities and manner of speech may thus be recorded
- the system samples and records the speaker's manner and qualities of speech, it first measures and qualifies his or her specific parameters of sound and timing variability, paying particular attention to the specific factors outlined in the preferred embodiment above
- the system notes the individual s particular tendencies, habits and pattermngs of pronunciation and voice in natural spontaneous speech and then alerts the operator to sound variations and contrasts evident in the operators samplings of natural connected speech (as compared to the standardised values of words and speech already established)
- the system then allows the speaker to define the particular second order meanings that such variations and contrasts may signify For instance, do certain combinations of sound and timing variations (say the elongating or reducing of the vowel sound in the same word when repeated) mean something 9 Or do they signify second order meanings which the speaker had not consciously intended to generate but nonetheless now need to be consciously considered by him or her in light of the facts of the immediate context 9 Do clusters of contrasts noted by the sampling process in the operators natural speech and which cause individual phonemes, syllables and words to noticeably vary and deviate from the standardised norm, possess second order meaning, and if so what 9 An emotion, irony, a subtext of some kind 9 Do they signify a particular form, function, or structure 9 Often an individual speaker s peculiar habits and manner of pronunciation signify a personal meaning, mood or theme irrespective of what the actual words in the phrase might be, but are still relative to and dependent on the immediate context In these instances the system offers the operator the choice of identifying and
- second order meanings is preferably effected by systems of menus, sub-menus and options over which the trained operator has executive control. Individual operators are allowed to define what sound and timing variations and contrasts in their speech signify or mean
- the system preferably understands the grammatical systems and principles of the spoken word- for example, such things as word order, syntactical formulas, strategies of "reductivity” in the first order (such as ellipsis and contractions), grammatical categories etc, so as to divine the grammatical rationale behind the speaker's use of variation and contrast.
- the system multi-tasks in the sense of simultaneously being aware of the first order of signification and the processes of the second order of signification It is here that meanings are routinely signified by variations and contrasts in the individual speakers speech and the system requires reference back to the first order of signification, a knowledge of the context, and a knowledge of the individual speaker, in order that second order meanings can be properly and fully understood
- the system does what individual English language speakers constantly do in order to understand and appreciate the second order meanings of natural, speech which the variable sound imagery of everyday spoken English generates
- the system in accordance with the present invention can effect a number of desirable and advantageous outcomes including:-
- the present invention can also be used to teach how to speak a language
- this method includes - assigning first and second orders of signification to words and speech, the words having syllables and phonemes, the first order of signification including standardised indicators having agreed meanings, and speech possessing standardised or readily understood grammatical, syntactical and linguistic forms, functions, and structures independent of the speaker and the second order of signification including variable indicators having meanings, and speech possessing grammatical, syntactical and linguistic forms, functions, and structures which are generated by the speaker's use of variable sound imagery and that are dependent on the context of the word in the flow of connected speech, and practicing speaking using different variable indicators in the second order of signification
- ESL is similar to that above and much of what is taught to native English language speakers regarding the analytical nature of modern English is also taught to those learning English as a non-mother tongue
- One way this can be achieved is by conveying the information to the ESL learner in his or her own language to provide a grounding in the basic principles of the system before learning commences.
- SE is a "speaker-centred" language with enormous executive power delegated to the individual speaker in producing second order meanings according to the individualistic way they may vary the sound and timing qualities of words when used in everyday connected speech
- VRT package programs require the operator to painstakingly sample speech word by word This sees English words as purely arbitrary symbols with no regard to the words potential second relative or subjective value that is clearly obtainable in natural connected speech
- Existing VRT systems record the word s static agreed-upon meaning in the first order of signification where words as arbitrary symbols possess no more than this and generally have a standardised pronunciation Consequently for the computer in existing VRT packages to familiarise itself with the particular operator and recognise the operator's manner of speech, the onus falls heavily on the operator not to vary his or her pronunciation of the sampled words in any substantial way when the system is later in use, lest the machine be unable to recognise the words correctly
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU55155/00A AU763362B2 (en) | 1999-07-06 | 2000-07-06 | Speech recognition system and method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AUPQ1459 | 1999-07-06 | ||
AUPQ1459A AUPQ145999A0 (en) | 1999-07-06 | 1999-07-06 | Speech recognition system and method |
AUPQ3549A AUPQ354999A0 (en) | 1999-10-19 | 1999-10-19 | Speech recognition system and method |
AUPQ3549 | 1999-10-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2001003112A1 true WO2001003112A1 (en) | 2001-01-11 |
Family
ID=25646095
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2000/000817 WO2001003112A1 (en) | 1999-07-06 | 2000-07-06 | Speech recognition system and method |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2001003112A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100397438C (en) * | 2005-11-04 | 2008-06-25 | 黄中伟 | Method for computer assisting learning of deaf-dumb Chinese language pronunciation |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4802223A (en) * | 1983-11-03 | 1989-01-31 | Texas Instruments Incorporated | Low data rate speech encoding employing syllable pitch patterns |
US5475796A (en) * | 1991-12-20 | 1995-12-12 | Nec Corporation | Pitch pattern generation apparatus |
US5636325A (en) * | 1992-11-13 | 1997-06-03 | International Business Machines Corporation | Speech synthesis and analysis of dialects |
US5806033A (en) * | 1995-06-16 | 1998-09-08 | Telia Ab | Syllable duration and pitch variation to determine accents and stresses for speech recognition |
US6109923A (en) * | 1995-05-24 | 2000-08-29 | Syracuase Language Systems | Method and apparatus for teaching prosodic features of speech |
-
2000
- 2000-07-06 WO PCT/AU2000/000817 patent/WO2001003112A1/en active IP Right Grant
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4802223A (en) * | 1983-11-03 | 1989-01-31 | Texas Instruments Incorporated | Low data rate speech encoding employing syllable pitch patterns |
US5475796A (en) * | 1991-12-20 | 1995-12-12 | Nec Corporation | Pitch pattern generation apparatus |
US5636325A (en) * | 1992-11-13 | 1997-06-03 | International Business Machines Corporation | Speech synthesis and analysis of dialects |
US6109923A (en) * | 1995-05-24 | 2000-08-29 | Syracuase Language Systems | Method and apparatus for teaching prosodic features of speech |
US5806033A (en) * | 1995-06-16 | 1998-09-08 | Telia Ab | Syllable duration and pitch variation to determine accents and stresses for speech recognition |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100397438C (en) * | 2005-11-04 | 2008-06-25 | 黄中伟 | Method for computer assisting learning of deaf-dumb Chinese language pronunciation |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Malmberg | Structural linguistics and human communication: An introduction into the mechanism of language and the methodology of linguistics | |
Holmes | Speech synthesis and recognition | |
Sampson et al. | Corpus linguistics: Readings in a widening discipline | |
Mathesius | Functional linguistics | |
Ritchie | On The Explanation Of Phonic Interference 1 | |
Hallin et al. | A closer look at formulaic language: Prosodic characteristics of Swedish proverbs | |
US20030163316A1 (en) | Text to speech | |
Kohler | Pragmatic and attitudinal meanings of pitch patterns in German syntactically marked questions | |
Mattingly et al. | The speech code and the physiology of language | |
Munson | Levels of phonological abstraction and knowledge of socially motivated speech-sound variation: A review, a proposal, and a commentary on the papers by Clopper, Pierrehumbert, and Tamati, Drager, Foulkes, Mack, and Smith, Hall, and Munson | |
Umeda | Linguistic rules for text-to-speech synthesis | |
Levis | Reconsidering low‐rising intonation in American English | |
Moore | A study of Hindi intonation | |
Streeter | Applying speech synthesis to user interfaces | |
Warner | Reduced speech: All is variability | |
AU763362B2 (en) | Speech recognition system and method | |
AU710895B3 (en) | Speech recognition system and method | |
Mulyanto et al. | Adding an emotions filter to Javanese text-to-speech system | |
WO2001003112A1 (en) | Speech recognition system and method | |
Lieberman | Linguistic and Paralinguistic Interchange. | |
Ladd | An integrated view of phonetics, phonology, and prosody | |
Pham | Poetry Translation from a Tonal Language (Vietnamese) to a Non-Tonal Language | |
Brenner | The phonetics of Mandarin tones in conversation | |
Hall | R-dissimilation in English | |
Jamil | Islamic Scriptures and Voice Intonation: A Preliminary Survey in Arabic Linguistic Thought and Ḥadīth Interpretive Discourse. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 10019738 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 55155/00 Country of ref document: AU |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
122 | Ep: pct application non-entry in european phase | ||
WWG | Wipo information: grant in national office |
Ref document number: 55155/00 Country of ref document: AU |
|
NENP | Non-entry into the national phase |
Ref country code: JP |