Using focus groups to evaluate artefacts in design research

Evaluation in design research continues to be ad hoc and poorly performed. It is one of the single biggest weaknesses in existing design research. Part of the problem is undoubtedly disagreement around the nature of design research and the highly complex process around evaluating its scientific claims. These issues demand our collective attention. This paper proposes that evaluation in design research must answer two key questions regarding the artefact under consideration-'does the artefact work' and 'why does it work'. This paper moves beyond the traditional approach to evaluation of artefacts and instead describes an interactionist approach. Focus groups are proposed as an appropriate method for answering the above questions. Guidelines for the use of focus groups as an interactionist approach to evaluation are provided. Up to now the use of focus group methods to evaluate and refine design artefacts has remained relatively new to the IS field.