CONTENTS

 1     Scope 
 2     References 
 3     Abbreviations   
 4     Introduction      
        4.1     Tasks and components of a spoken dialogue system           
        4.2     Telephone interaction with a spoken dialogue system          
        4.3     Quality aspects and influencing factors        
        4.4     Subjective evaluation methods        
 5     Spoken dialogue system characterization  
        5.1     Agent factors         
        5.2     Task factors          
        5.3     User factors           
        5.4     Environmental factors         
        5.5     Contextual factors  
 6     Experimental set-up         
        6.1     System set-up and Wizard-of-Oz simulation           
        6.2     Test scenarios        
        6.3     Test subjects         
 7     Questionnaires  
        7.1     Questions related to the user's background 
        7.2     Questions related to the individual interaction          
        7.3     Questions related to the user's overall impression of the system       
 8     Usability evaluation          
 9     Analysis and interpretation of collected information           
Appendix I – Scenario examples    
BIBLIOGRAPHY