View  Edit  Attributes  History  Attach  Print  Search
Site / Calendar

The following calendar is subject to change.

  • TA office hours:
  • Carman's office hours:
Week Lecture Studio Lab Deadlines
Sept 8, Week 1:
Introduction: overview of course, assignments, and textbooks. Overview of evaluation:
  • Evaluation frameworks
  • Why evaluate?
  • Analytic vs. participative evaluation methods
  • Objective vs. subjective evaluation methods
  • Formative vs. summative methods
  • Quantitative vs. qualitative methods

Lecture Materials:

Readings:

  • Chapter 2: What Is Usability Testing?, in Rubin, J. Handbook of Usability Testing, Wiley Publishing (2008).
  • Chapter 3: When Should You Test?, in Rubin, J. Handbook of Usability Testing, Wiley Publishing (2008).
Intro to labs:
  • How labs work
  • How team assignments work
Sept 15, Week 2:

Heuristic Evaluation:

  • Analytical methods
  • History
  • Types
  • Pros and cons
  • Process of applying

Lecture Materials:

Readings:

Assignment 1: Heuristic Evaluation
  • Introduce Assignment 1
  • Exercise: heuristic evaluation of an application

Readings for Assignment 1:

Sept 22, Week 3:

Usability Testing I:

  • What is usability?
  • Usability test plans
  • 3 Methods: silent, think aloud, constructive interaction
  • Usability metrics, data & measurement
  • Test setup & test materials
  • Ethics of working with human subjects

Lecture Materials:

Readings:

  • Part II: The Process for Conducting a Test, in Rubin, J. Handbook of Usability Testing, Wiley Publishing (2008).

Assignment 2: Usability Testing

  • Example usability studies: one think aloud study and one constructive interaction study

Materials for the usability study exercise:

Assignment 1 due at the start of class.
Sept 29, Week 4:

Usability Testing II: Query Methods

  • Interviews
  • Surveys
  • Questionnaires

Lecture Materials:

Readings:

  • Part II: The Process for Conducting a Test, in Rubin, J. Handbook of Usability Testing, Wiley Publishing (2008).

Lab Activities

You should start the TCPS 2 Tutorial Course on Research Ethics outside of class and complete it this week. You must attach your completion certificate to your assignment 2.

Oct 6, Week 5:

Usability Testing III: Analysis & Writing

  • Qualitative data analysis
  • Graphing quantitative data
  • Report Writing

Lecture Materials:

Readings:

  • Part II: The Process for Conducting a Test, in Rubin, J. Handbook of Usability Testing, Wiley Publishing (2008).
  • Survey Research (pg. 212-226), Chapter 10 in Martin, D. Doing Psychology Experiments, Wadsworth (2004).

Lab Activities

Oct 13, Week 6:

Usability through Controlled Lab Experiments:

  • Scientific Method
  • Hypothesis testing explained
  • Independent & dependent variables

Lecture Materials:

Readings:

  • Chapters 1, 2, 7, and 8 in Martin, D. Doing Psychology Experiments, Wadsworth (2004).

Assignment 3: Controlled Experiment:

Assignment 2 at the start of class.

Complete team member evaluations here.

Oct 20, Week 7:

Reliability & Validity:

  • Reliability, consistency, repeatability
  • Confounding variables
  • Face validity, construct validity, internal validity, external validity

Lecture Materials:

Readings:

  • Chapters 7, 8, 12, and 13 in Martin, D. Doing Psychology Experiments, Wadsworth (2004).

Assignment 3 continued:

Oct 27, Week 8:

Controlled Experiments & Statistics:

  • Statistics for designers
  • Descriptive statistics
  • Basic Inferential tests
  • Graphing basics

Lecture Materials:

Readings:

  • Chapters 1, 2, 7, 8, 12 and 13 in Martin, D. Doing Psychology Experiments, Wadsworth (2004).
Assignment 3 continued: The first portion of Assignment 3 is due. You must submit your write-up and include everything up to your results section. This means documenting your Introduction and Methodology (hypotheses, pre-test, post-test, tasks, etc) sections of your report.

We will discuss these in class and provide you with a modified experimental design to use when you actually run the study. The goal is to test your ability to design experimental hypotheses and tasks.

Nov 3, Week 9:
Field Studies, Emotion & Affect:
  • Conducting field studies
  • Measuring affect and emotion
  • Theories of emotion
  • Quantifying qualitative codes

Lecture Materials:

Readings:

Assignment 4: Affective Evaluation of Gaming:

  • Overview of assignment 4
  • Conduct an example study of gameplay and collect IMI questionnaire data and cued debrief recall data

Readings:

  • Qualitative Designs (pg 14-19) in Martin, D. Doing Psychology Experiments, Wadsworth (2004).
Assignment 3 due before class.

You need to revise your Introduction and Methodology sections based on feedback in class so they match the study design that was actually used.

Nov 10, Week 10:
Interface Criticism and Aesthetics:
  • Moving beyond usability
  • Theories of aesthetics

Lecture Materials:

Readings:

Nov 17, Week 11:
TBD
Nov 24, Week 12:
Usability Evaluation Considered Harmful (Some of the time)

(.ppt):

  • Challenges in usability evaluation
  • Applicability of usability evaluation

Saul's full talk is available online on this page in the Table of Contents.

Readings:

Dec 1, Week 13:
Exam Review: review of possible exam questions. Review of course material. Assignment 4 due before class.