Using Multiple Time Scales in the Framework of Multi-Stream Speech Recognition
| Type of publication: | Conference paper |
| Citation: | astrid-00-22b |
| Booktitle: | ICSLP |
| Year: | 2000 |
| Note: | IDIAP-RR 00-22 |
| Crossref: | astrid-00-22a: |
| Abstract: | In this paper, we present a new approach to incorporating multiple time scale information as independent streams in multi-stream processing. To illustrate the procedure, we take two different sets of multiple time scale features. In the first system, these are features extracted over variable sized windows of three and five times the original window size. In the second system, we take as separate input streams the commonly used difference features, i.e. the first and second order derivatives of the instantaneous features. In the same way, any other kinds of multiple time scale features could be employed. The approach is embedded in the recently introduced ``full combination'' approach to multi-stream processing in which, the phoneme probabilities from all possible combinations of streams are combined in a weighted sum. As an extension of this approach we have found that replacing the sum of probabilities by their product, in the same ``all wise'' context, can result in higher robustness. Capturing different information in each stream, and with the longer time scale features being more robust to noise, the multiple time scale multi-stream system gained a significant performance improvement in both clean speech and in real-environmental noise. |
| Userfields: | ipdmembership={speech}, language={English}, |
| Keywords: | difference features, full combination, HMM/ANN-Hybrid, multi-stream, multiple time scales |
| Projects |
Idiap |
| Authors | |
| Added by: | [UNK] |
| Total mark: | 0 |
|
Attachments
|
|
|
|
|
Notes
|
|
|
|
|
