Computer Science 482: Human–Computer Interaction

Study Guide: Unit 4

Evaluation and User Support

This unit addresses post-implementation issues. Section 1 introduces evaluation methods. Section 2 addresses post-implementation issues for HCI.


Section 1: Evaluation

In this section you learn some techniques for evaluating a human–computer interface.

Learning Objective 1

Define evaluation.

Required Reading
  1. Read page 319 of HCI.
  2. Read pages 495 to 507 of Interaction.
Exercise

You may want to use the Online Workspace to answer the following question. Answer in 100 words or less.

  • What is the ideal situation for evaluation of interactive systems? (p. 319 of HCI)

Learning Objective 2

Describe the goals of evaluation.

Required Reading
  1. Read pages 319 to 320 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are the three main goals of evaluation? (pp. 319 to 320 of HCI)

Learning Objective 3

Describe the approaches of evaluation through expert analysis.

Required Reading
  1. Read pages 320 to 327 of HCI.
Exercise

You may want to use the Online Workspace to answer the following questions:

  • What are the four requirements for performing a cognitive walkthrough and what are the four questions to ask? (pp. 321 to 322 of HCI)
  • What are the ten evaluation heuristics developed by Nielsen and Molich? (pp. 324 to 326 of HCI)

Learning Objective 4

Define evaluation through user participation and outline common styles of evaluation.

Required Reading
  1. Read pages 327 to 329 of HCI.
  2. Read pages 507 to 521 of Interaction.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are the distinctive features of each of the two main styles of evaluation? (pp. 327 to 329 of HCI)

Learning Objective 5

Outline major factors in experimental evaluation design.

Required Reading
  1. Read pages 329 to 343 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are three critical questions for assessing the results of an experimental design? (p. 334 of HCI)

Learning Objective 6

Outline observational techniques.

Required Reading
  1. Read pages 343 to 347 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • Briefly describe methods for recording user actions. (pp. 344 to 345 of HCI)

Learning Objective 7

Discuss query techniques.

Required Reading
  1. Read pages 348 to 352 of HCI.
  2. Read pages 398 to 407 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • Briefly describe the types of questions that can be used in a questionnaire. (pp. 349 to 350 of HCI)

Learning Objective 8

Discuss evaluation through physiological responses.

Required Reading
  1. Read pages 352 to 357 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What is the potential benefit of evaluation through monitoring physiological responses? (p. 352 of HCI)

Learning Objective 9

Explain the process of choosing an evaluation technique.

Required Reading
  1. Read pages 357 to 362 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are the factors to consider in choosing evaluation techniques? (pp. 357 to 360 of HCI)

Learning Objective 10

Provide a summary of approaches to evaluation.

Required Reading
  1. Read page 362 of HCI.
Review Exercise

You may want to use the Online Workspace to answer the following questions:

  • Do exercises 9.1, 9.2, 9.3, 9.4, and 9.5 on page 363 of HCI.

Section 2: User Support

In this section you will examine post-implementation issues for HCI.

Learning Objective 1

Discuss the purpose of post-implementation user support.

Required Reading
  1. Read pages 396 to 397 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are the four main types of assistance users require? (p. 396 of HCI)

Learning Objective 2

Describe the requirements of a user support system.

Required Reading
  1. Read pages 397 to 399 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are six characteristics of good user support? (pp. 397 to 399 of HCI)

Learning Objective 3

Outline the various approaches to user support.

Required Reading
  1. Read pages 399 to 404 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are five approaches to user support? (pp. 399 to 404 of HCI)
  • List some simple guidelines for online documentation. (p. 402 of HCI)

Learning Objective 4

Describe how adaptive help systems operate.

Required Reading
  1. Read pages 404 to 411 of HCI.
Exercise

You may want to use the Online Workspace to answer the following questions:

  • What are three approaches to user modeling? (pp. 405 to 407 of HCI)
  • Outline two problems associated with knowledge representation and modeling in adaptive help systems. (pp. 410 to 411 of HCI)

Learning Objective 5

Outline presentation and implementation issues in designing user support systems.

Required Reading
  1. Read pages 412 to 414 of HCI.
Exercise

You may want to use the Online Workspace to answer the following question:

  • What are two questions that must be addressed in the presentation of help? (pp. 412 to 413 of HCI)

Learning Objective 6

Summarize the importance of user help functions.

Required Reading
  1. Read page 414 of HCI.
Review Exercise

You may want to use the Online Workspace to answer the following questions:

  • Do exercises 11.2, 11.3, and 11.4 on page 415 of HCI.