Browse
 
Tools
Rss Categories

Tuning Wizard

1 About the Tuning Wizard

The Tuning Wizard, introduced in version 12.2 of the Speech Tuner, is an interactive tool that can identify and highlight issues with your speech application. To start the Wizard, simply click the magic wand icon on the toolbar: You can also click View >…

2 Confidence Threshold Tuning

Confidence threshold tuning is an often overlooked part of speech tuning. While new speech developers may focus purely on accuracy, understanding the performance of a speech application at a given confidence threshold is vital to understanding how the application…

3 Decode Failure Tuning

Decode failures are serious issues that indicate something went wrong. Unlike common and expected behavior such as out-of-grammar utterances or no-input events, decode failures mean there was some kind of severe misconfiguration or application error that…

4 No-Input Tuning

A no-input event is what happens when the ASR is asked to perform a recognition, but no audio is detected within the timeouts specified. The typical behavior of an application when faced with a no-input event is to prompt the user ("I'm sorry, but I didn't…

5 Out-of-Coverage Tuning

As described in our article on Out-of-Coverage Items, an OOC item is an utterance that does not contain viable, valid speech which is a candidate for inclusion in a speech grammar (those are Out-of-Grammar). The OOC Tuning Wizard will help point out when…

6 Out-of-Grammar Tuning

The Out-of-Grammar Tuning Wizard is a way to help identify issues related to users speaking out-of-grammar utterances. It differs from the Out-of-Coverage Tuning Wizard in that it focuses on utterances which contain phrases that might be valid, but are currently…

7 Slow Decode Tuning

Slow decodes refer to cases where the ASR took longer than expected to provide a result. Decode speed is measured in terms of real-time factor (RTF), which is the ratio of decode time to audio length. So an RTF of 0.5 indicates that 1 second of audio would…

8 Transcribing Wizard

In order to get the most effectiveness out of the Tuning Wizard, it is important to have a large quantity of transcripts. Transcripts are used by the Tuner to calculate accuracy, out-of-grammar utterances, out-of-coverage items, and to perform confidence…

9 Utterance Accuracy Tuning

Utterance accuracy refers to how frequently in-grammar utterances return the correct result from an ASR. Obviously, high accuracy is desirable, as it means that the ASR is returning the correct answer when users speak in-grammar utterances. It is defined…