early stage tools and techniques for iterative evaluation

1
early stage tools and techniques for iterative
evaluation
the application development paradox
scott davidoff, scott carter jennifer mankoff
2
example paradox eldermail
(davidoff, bloomberg, li, mankoff fussell 2005)

• challenge
• strategy

create a walk-up-and-use cmc system for
seniors provide benefits of email wrapped in
familiar objects
option 1
letter-writing-to-email bridge
how could we know which to build and test
option 2
voice-to-email bridge
3
the application development paradox

• field-deployable research requires knowledge that
  researchers do not yet have

4
current tools techniques
build
design
test
gtgt
5
current tools techniques
toolkits
interface builders
build
design
test
gtgt
formative evaluation
summative evaluation
6
current tools techniques
toolkits
interface builders
build
simulation
paper prototyping
iterative evaluation
design
test
gtgt
formative evaluation
summative evaluation
7
current tools techniques
toolkits
interface builders
build
paper prototyping
iterative evaluation
bootstrap simulation
design
test
gtgt
formative evaluation
summative evaluation
8
bootstrapping location awareness momento
(carter mankoff 2005)
9
comparing multiple approaches
where is the sweet spot?
high
low
overhead
high
low
intrusiveness
easy
hard
development cost
momento
bluetooth
java
10
future work

• support application development process from
  design to testing
• support multiple prototype iterations, and
  seamless switching between them
• low-cost channels to capture and visualize data
  from a variety of protocols