Tuning in 3 Easy Steps

1. Import Data

   The basic process is simple. Converters import call log data into the Speech Tuner database. All information stored by the call log is available in the Speech Tuner.

2. Transcribe Speech

   Transcribers can type the text of the caller's speech directly into the Transcriber. Once the audio is transcribed, the Speech Tuner compares audio transcripts with the Speech Engine results to determine accuracy, greatly reducing errors associated with manual evaluations. The transcripts are evaluated using the actual decode grammar, producing measurements such as word-error-rate, in and out-of-grammar rates, and semantic error rates.

3. Test Immediately

   Selecting an interaction in the Call Log automatically loads the associated audio and grammar into the Tester. The grammar can be edited, Speech Engine parameters set, and individual recognition tests generated. The Speech Tuner natively supports industry standard SRGS grammars. Once a set of possible changes is identified, users can batch test audio to evaluate performance, using those changes.

In addition, the Tuner stores all transcripts and evaluations within the call log. As transcripts are entered into the Speech Tuner, they are automatically evaluated against the decode grammar.

This transcript, and any notes or additional information, are stored directly into the database. Individual scores -- such as word error rate, semantic error rate, and in and out-of-grammar measurements -- are stored along with their alignments, as well as information about how the scores were reached. Users can generate a variety of reports from these results, including error rate by grammar or dialog, confusion matrices, transcription progress, and confidence thresholds for confirmation or rejection settings.

Grammar Evaluation

Speech can be evaluated against grammar sets, as they are sent to the Speech Engine. The grammar can be adjusted and re-tested and re-scored to see if the changes improved performance. Therefore, you can determine instantly whether adding a new phrase to the grammar will improve your speech recognition accuracy.

Performance Rate

The Speech Tuner rates performance against commonly accepted measures like WER (Word Error Rate). This helps to give an accurate picture of details such as average confidence scores, correct versus incorrect responses, and in-grammar versus out-of-grammar performance.

Parameter Evaluation

Setting parameters optimizes the Speech Engine performance, further improving the caller's experience. Traditionally, changing Engine parameters is a difficult and time-consuming task, often requiring long delays between changing a parameter, and evaluating its effects on performance. Our Speech Tuner changes this.

The dynamic test capability of the Speech Tuner allows the user to shorten this delay. Now, Speech Engine parameters such as search optimizations, speech end-pointing, and NBest result processing can be easily adjusted, and immediately re-tested and re-scored from within the testing component.

Transcription Entry

The Transcriber is used to write down every word in a call. The Grammar Tester uses these transcripts in evaluating how well a Speech Engine is interpreting what users are saying.

Transcription Log

The Transcription Log allows for a detailed view of every single transcript during a transcription session. Interaction number, name and transcription description are all fields that the Log tracks.