Title: Designing%20Effective%20Step-By-Step%20Assembly%20Instructions%20%20Maneesh%20Agrawala,%20Doantam%20Phan,%20Julie%20Heiser,%20John%20Haymaker,%20Jeff%20Klingner,%20Pat%20Hanrahan%20and%20Barbara%20Tversky%20%20Microsoft%20Research%20and%20Stanford%20University
1Designing Effective Step-By-Step Assembly
InstructionsManeesh Agrawala, Doantam Phan,
Julie Heiser, John Haymaker, Jeff Klingner, Pat
Hanrahan and Barbara TverskyMicrosoft Research
and Stanford University
2(No Transcript)
3(No Transcript)
4Designing Instructions
- Planning
- Choose sequence of assembly operations
- Robotics / AI / Mechanical EngineeringWolter
89, de Mello 91, Wilson 92, Romney 95 - Presentation
- Visually convey assembly operations
- Visualization / Computer Graphics Seligmann
91, Rist 94, Butz 97, Strothotte 98
We jointly optimize plan and presentation
5Geometric Analysis Romney 95
B blocked by A
both parts free to move
A blocked by B
Input Parts
Blocking Graph
6Geometric Assembly Planning
7Many Geometrically Valid Sequences
8Our Approach
- Identify cognitive design principles
- How people conceive of 3D assemblies
- How people comprehend visual instructions
- Encode principles as constraints within automated
design system
9Identifying Design Principles
- Experiment 1 Assemble and draw instructions
- Experiment 2 Rate effectiveness
- Experiment 3 Validate effectiveness
10Sequence the Assembly Operations
Single exploded view diagram
Step-by-step diagrams
- Step-by-step instructions preferable
11Illustrate the Assembly Operations
Structural diagrams
Action diagrams
- Action diagrams preferable
12Ensure Visibility of Parts
- Essential
- Parts being attached
- Context (show earlier parts)
- Less important
- All parts in a symmetric group
- Repetitive operations
13Automated Instruction Design
- Step-by-Step
- Action diagrams
- Good visibility
TV stand instructions generated by our system
14Input
required optional
- Geometry
- Parts in assembled positions
- Orientations
- Default viewpoint / orientation
- Preferred orientation for each part
- Groupings
- fasteners, significant parts, symmetry,similar-ac
tions - Ordering constraints
- Force one part to attach before another
15TV Stand Input
required optional
- Geometry Parts in assembled positions
- Orientations Default viewpoint / orientation
- Groupings fasteners, significant parts, symmetry
16All parts
Search
Leftover parts
Best subset of parts
Sequence Parts
Reorientation
Sequence of assembly steps
17All parts
Search
Leftover parts
Best subset of parts
Sequence Parts
Reorientation
Sequence of assembly steps
18All parts
Search
Leftover parts
Best subset of parts
19All parts
Search
Choose part subset
Search
Interference
Leftover parts
Best subset of parts
Attachment
Ordering
Grouping
Visibility
20Computing Visibility
Area(P) red pixels
Area(P,Q) red pixels
Area of top not occluded by sides
Area of top alone
Vis(P,Q) Area(P,Q) / Area(P)
pixels that remain visible
21Visibility Constraint
- Current parts R min ( Vis(r, R-r)
) - Check that each part in current subset is
visible - Attached parts A Vis(A, R)
- Check that context is visible
- Unattached parts U min ( Vis(u, R) )
- Check that future parts will be visible
r Î R
u Î U
22Lego Car
23Bookcase
Input model
24- Add significant parts one by one
- Visibility
- Distance to viewer
- Add all remaining parts
- Omit repetitive operations
- Skip if 2 similar-action parts already added
Best subset of parts
Sequence Parts
25Bookcase After Sequencing
26Bookcase Omitting Repetition
27- Set preferred orientation for significant parts
- If visibility of current parts is low try
alternate oblique views
28Bookcase With Reorientation
29All parts
Search
Leftover parts
Best subset of parts
Sequence Parts
Reorientation
Sequence of assembly steps
30Sequence of assembly diagrams
31Building Stacks
- Stack set of parts that
- Share separation direction
- Lie on a stabbing line
- Are in sequential contact
32Building Stacks
- Stack set of parts that
- Share separation direction
- Lie on a stabbing line
- Are in sequential contact
33Placing Guidelines
- Expand stacks
- Form lines between stack parts
34Placing Guidelines
- Expand stacks
- Form lines between stack parts
35Bookcase
36Table
37Test Object
38Exploded View
39Future Work
- Experiment 4 Evaluation
- Time/errors as they use our instructions
- Assemblies with more subparts
- Take advantage of hierarchy
- Apply system recursively
- Physical and functional constraints
- Part size and mass
- Gravitational stability
40Summary
- Cognitive design principles
- Step-by-step
- Action diagrams
- Good visibility
- Automated instruction design system
- Integrate planning and presentation
41Acknowledgements
- Boris Yamrom
- Christina Vincent
- ONR grants N000140210534, N000140110717 and
N000140010649