???? : ???????????? Pattern Recognition : Theoretical Basis of Our Unique Creativity Theory

1
???? ???????????? Pattern Recognition
Theoretical Basis of Our Unique Creativity Theory
?????? ???? ??98?10?30?

• ??? Felix T. Hong, M.D., Ph.D.
• Dept of Physiology Wayne State University,
  Detroit, Michigan 48201 USA
• fhong_at_med.wayne.edu
• ??????????
• Creativity, Innovation and Entrepreneurship
  Center
• National Cheng Kung University, Tainan 701, Taiwan

2
??? (?????)Knowing and Recognizing

• ???????????????,???????????
• Discovery consists of seeing what everybody has
  seen and thinking what nobody has thought.
• Albert Szent-Györgi

3
Henri Poincarés 1908 Introspection

• French mathematician Henri Poincarés reported
  his introspection of mathematical discoveries.
• (Original French version, published in Paris,
  1908)

The Centennial Anniversary of the Publication of
The Foundations of Science
4
Henri Poincarés 1908 Introspection

• Just at this time I left Caen, where I was then
  living, to go on a geologic excursion under the
  auspices of the school of mines.
• ?????????Caen (????),????????????????????????

5
Henri Poincarés 1908 Introspection

• The changes of travel made me forget my
  mathematical work. Having reached Coutances, we
  entered an omnibus to go some place or other.
• ???????????????????????????Coutances?,??????,????
  ????

6
Henri Poincarés 1908 Introspection

• At the moment when I put my foot on the step the
  idea came to me, without anything in my former
  thoughts seeming to have paved the way for it,
  that the transformations I had used to define the
  Fuchsian functions were identical with those of
  non-Euclidean geometry.
• ????????????,??????,???????????????????,??Fuchsia
  n functions ?non-Euclidean Geometry
  (????)?transformation??????,????????

7
Henri Poincarés 1908 Introspection

• I did not verify the idea I should not have had
  time, as, upon taking my seat in the omnibus, I
  went on with a conversation already commenced,
  but I felt a perfect certainty. On my return to
  Caen, for conscience sake I verified the result
  at my leisure.
• ????????,?????????,????????????,????????????????C
  aen??,???????,??????????????????

8
Henri Poincarés 1908 Introspection

• He referred to the period of incubation prior to
  illumination as long, unconscious prior work.
• ????????????? ??????????

9
Henri Poincarés 1908 Introspection

• He also referred to the unconscious mind as the
  subliminal self, which was capable of
  discernment (pattern recognition).
• ???????????? ???????????? (???????)?

10
Henri Poincarés 1908 Introspection

• He suspected that the subliminal self knows
  better how to divine than the conscious self,
  since it succeeds where that has failed.
• ??????????????????????????,????????????????????

11
Henri Poincarés 1908 Introspection

• He raised the question is not the subliminal
  self superior to the conscious self?
• ??????? ?????????????????????

12
Wallas Four Phase Model

• ??? Preparation
• ??? Incubation
• ??? Illumination (??Eureka!)
• ??? Verification

13
The Chance-Configuration Modelof Dean Simonton

• Blind Search
• ????
• Selection
• ??
• Retention
• ????

14
The Chance-Configuration Modelof Dean Simonton

• Random Mutation
• ????
• Natural Selection
• ????
• Reproduction
• ????

• Blind Search
• ????
• Selection
• ??
• Retention
• ????

15
???????? Problem Solving as Pattern Recognition

• ?? Pattern Lock (?)
• ????? Templates Keys (??)
• ?? Problem solving Pattern Recognition (????)
• ??? ???????
• In the course of my attempts to decipher the
  enigma of creativity, I realized that a problem
  can be regarded as a pattern, and problem solving
  is finding a template that can fit the pattern.
• The key to the answer distinguishing two types
  of pattern recognition.

16
The Chance-Configuration Modelof Dean Simonton

• Search-and-Match Phase
• ???????
• Verification-Retention Phase
• ???????

17
Defining the Search Space

• Blind Search
• ????
• Heuristic Search
• ?????
• Dogmatism
• (self-imposed constraint)
• ????(????)

• Too large
• ??
• Acceptable
• ???
• Too small
• ??

18
What is So Special About Pattern Recognition?

• Rule-based pattern recognition
• keyword matching
• Objective criteria do not tolerable ambiguity or
  imprecision.
• Picture-based pattern recognition
• matching by images
• matching by analogy
• Subjective criteria allow for an enormous
  latitude of ambiguity and imprecision.

19
??????Two Types of Pattern Recognition

• ???????
• Rule-based (digital) pattern recognition
• ???????
• Picture-based (analog) pattern recognition

20
How Did Dumb High-Achiever at WSU Solve a Problem?

• They recognized only pre-existing, well defined
  patterns. They got lost when patterns were
  distorted or did not fit any known ones.
• I called that rule-based reasoning ?????
• (also known as verbal thinking ?????
• in the literature).
• Dumb high-achievers practiced digital pattern
  recognition ???????.

21
How did geniuses solve a problem?

• Geniuses transformed a problem into a picture,
  and looked at the entire picture as a whole
  (Gestalt psychology).
• Geniuses did not stick to rigid rules, and could
  recognize distorted patterns in accordance with
  their gut feeling.
• I called that picture-based reasoning????? (also
  known as visual thinking ?????in the literature).
• Geniuses practiced analog pattern recognition
  ???????.

22
??????????????? Two Types of Pattern
Recognition1. Digital (Rule-Based) Pattern
Recognition

• ?????
• ??????????????? (?????? )
• ?????????????
• ?????
• ??????
• Keyword matching
• Analogy by words
• Black-and-white dichotomy no sense of grayscales
• Objective criteria do not tolerable ambiguity.
• Fault-intolerant

23
????????Digital Pattern Recognition

• Recognition of email addresses (??????) or
  telephone numbers (????)
• DNA typing (DNA ??)

24
????????Digital Pattern Recognition
25
????????Digital Pattern Recognition
26
????????Digital Pattern Recognition
27
????????Digital Pattern Recognition
28
??????????????? Two Types of Pattern
Recognition2. Analog (picture-Based) Pattern
Recognition

• ???????
• ???? (????? )
• ??????????????
• ?????
• ?????
• Matching by images
• Analogy by pictures
• Sense of grayscales
• Subjective criteria allow for an enormous
  latitude of ambiguity and imprecision
• Fault-tolerant

29
????????Analog Pattern Recognition

• Female figure ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

30
????????Analog Pattern Recognition

• Female figure ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

31
????????Analog Pattern Recognition

• Female figure ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

32
????????Analog Pattern Recognition

• Female figure ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

33
????????Analog Pattern Recognition

• Female figure ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

34
????????Analog Pattern Recognition

• ?
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

35
????????Analog Pattern Recognition

• Mans face ????? ?
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

36
????????Analog Pattern Recognition

• Mans face ?????
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

37
????????Analog Pattern Recognition

• Mans face ?????
• The interpretation is objective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

38
????????Analog Pattern Recognition

• Mans face ?????
• The interpretation is still objective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

39
????????Analog Pattern Recognition

• Mans face ?????
• The interpretation is somewhat objective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

40
????????Analog Pattern Recognition

• Mans face ????? ?
• or Female figure ?????? ?
• The choice is somewhat subjective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

41
????????Analog Pattern Recognition

• Mans face ?????
• or Female figure ??????
• The choice is less subjective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

42
????????Analog Pattern Recognition

• A gender change?
• The choice is much less subjective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

43
????????Analog Pattern Recognition

• Female figure ?????
• The choice is somewhat objective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

44
????????Analog Pattern Recognition

• Female figure ?????
• The choice is objective.
• From P. B. Andersen, Genres as self-organizing
  systems, in Downward Causation
• edited by P. B. Andersen, C. Emmeche, N. O.
  Finnemann and P. V. Christiansen, Aarhus
  University Press, 2000.

45
????Molecular Recognition

• Molecular recognition is accomplished by
  matching a finite number of recognition sites.

46
????Molecular Recognition

• Molecular recognition is accomplished by
  matching a finite number of recognition sites.

47
????Molecular Recognition

• Molecular recognition is accomplished by
  matching a finite number of recognition sites.

48
????Molecular Recognition

• Molecular recognition is accomplished by
  matching a finite number of recognition sites.

49
Incompatibility of Sequential Algorithm and
Pattern Recognition

• Linear sequential reasoning
• vs.
• Gestalt (holistic) synthesis

50
Pattern Recognition asA Holistic (Parallel)
Process

• The portrait of American inventor Thomas A.
  Edison was constructed with a sequential array of
  product names from JAMECOs catalogue.
• The alphabets, constituting the product names,
  vary in size, brightness and 3 colors.
• Edison appeared to stare in the left lower
  direction.

51
Pattern Recognition asA Holistic (Parallel)
Process

• At this level of magnification, the eyes, the
  nose and the mouth are still discernible.
• The effect of Edisons gaze was primarily due to
  the large sizes of letters O and IC,
  portraying the right and the left pupils of
  Edisons eyes.

52
Pattern Recognition as A Holistic (Parallel)
Process

• At this level of magnification, the stare can
  be identified with two product names
  MOTHERBOARDS ROBOTICS.
• With prior knowledge, the eye sockets and the
  stare are still discernible.

53
Pattern Recognition asA Holistic (Parallel)
Process

• At the same level of magnification but with the
  additional landmarks clipped off, the stare
  is no longer discernible, even with prior
  knowledge of its existence.

54
Pattern Recognition asA Holistic (Parallel)
Process

• How about this?

55
Pattern Recognition asA Holistic (Parallel)
Process

• And this?
• (The gray scale was eliminated.)

56
????Parallel Processing
57
The Chance-Configuration Modelof Dean Simonton

• Search-and-Match Phase
• Verification-Retention Phase

58
Interpretation ofHenri Poincaré Remark

• ... it is by logic that we prove.
• It is by intuition that we discover.
• ????????? , ????????
• 
  Henri Poincaré

59
Interpretation ofHenri Poincaré Remark

• ... it is by logic that we prove.
• It is by intuition that we discover.
• ????????? , ????????
• 
  Henri Poincaré
• Interpretation
• Identify intuition with the search-and-match
  phase.
• Identify logic with the verification phase.

60
????????

• ?? Intuition
• ?? Inspiration
• ?? Insight
• ????????? Primary-Process Thinking
• ????? Picture-based reasoning

61
????????

• ?? Logic
• ?????????
• Secondary-Process Thinking
• ????? Rule-based reasoning

62
Other Equivalent Models

• Poincaré intuitive and logical approaches
• Freud primary-process and secondary-process
  thinking
• Kris inspirational and elaborative phases
• Newell, Shaw and Simon solution-generating and
  solution-verifying processes.
• Bastick visual-ability and verbal-ability modes
• Boden parallel-intuitive and sequential-deliberat
  ive thinking.

63
Robert Rosens Classification of Natural Processes

• Unformalizable process
• Non-algorithmic process
• Semantic process

• Formalizable process
• Algorithmic process
• Syntactic process

64
Syntactic ???

• ????????

65
Semantic ???

• ????????
• ??????????

66
Semantic ???

• Were it not out of respect for the Office of the
  U.S.President, I would have called George W. Bush
  a son-of-a-bitch.
• ??????????????????,?????????????
• ???????????????????

67
Semantic ???

• Why a son-of-a-bitch is such a derogatory term?
• A son of a bitch is an offspring of a female dog.
  That is, a little puppy. But little puppy is
  adorable.
• But English-speaking people also call a
  prostitute a bitch.
• ?????????????
• ?????,?????????!
• ????????????????
• ???????????????

68
Semantic ???

• ?????????,???????????????????
• ???????????????
• ??(??)???????????????
• Tough Luck Too bad
• Oh Ya? ????

69
Computer-based Translation ????

• Out of sight out of mind.
• ???,????
• Invisible idiot.
• ??(?????)????
• Out of sight ???
• Out of mind ?????????????
• Idiot ??

70
Computer-based Translation ????

• ??????????????????
• ???? syntax ??? semantic?
• ??????????????????????????
• ???????,???????????? ?????.

71
Word Replacement Game

• Solution-generating
• Intuitive
• Inspirational
• Parallel-intuitive
• Visual
• Picture- (pattern-)based
• Non-formalizable
• Semantic process
• Non-verbalizable
• Primary process

• Solution-verifying
• Logical
• Elaborative
• Sequential-deliberative
• Verbal
• Rule-based
• Formalizable
• Syntatic process
• Verbalizable
• Secondary process

72
What Is Intuition?Psychologists Answer

• ?????????,???????????????
• What we need most in the study of insight are
  some new insights!
• R. J. Sternberg and J. E. Davidson
• Insight, in Encyclopedia of Creativity, Vol. 2,
  pp. 57-69, (M. A. Runco and S. R. Pritzker,
  Eds.), Academic Press, San Diego, London, Boston,
  New York, Sydney, Tokyo and Toronto, 1999.

73
What Is Intuition?Psychologists Answer

• ?????????,???????????????
• What we need most in the study of insight are
  some new insights!
• No syntactic content.
• Only semantic content
• Therefore, insight is a semantic process.

74
Obscenity Defined Implicitly

• ??????,???????
• I know it when I see it!
• Potter Stewart
• U.S. Supreme Court ex-associate justice

75
What Is Intuition?Carl Friedrich Gauss
Description

•   ?????,???????????????,????????????,???????,????
  ???????????????????,????,???????????
• In referring to a long-standing problem which he
  had just solved, Gauss said,
• Like a sudden flash of lightning, the riddle
  happened to be solved.
• I myself cannot say what was the conducting
  thread which connected what I previously knew
  with what made my success possible.

76
What Is Intuition?Nikola Teslas Description

• ????????,???????????????,????????
• As I uttered these inspiring words the idea came
  like a flash of lightning and in an instant the
  truth was revealed.

77
What Is Intuition?Albert Einsteins Description

• In responding to Hadamards questionnaire,
  Einstein indicated,
• His initial thought process is largely visual.
  The words or the language do not seem to play any
  role in his mechanism of thought.
• Conventional words or other signs have to be
  sought for laboriously only in a secondary stage.

78
What Is Gut Feeling?A 911 Survivors
Introspection

• In his hour-long descent from the 72nd floor of
  one of the Twin Towers of the World Trade Center,
  Cary Shieh stated in an widely distributed email
• There was no smoke at all in the stairwell, but
  there was a strange peculiar smell,
• which I later remembered it smelling like how it
  does when one boards an aircraft.
• I later found out that this was jetfuel.

79
What Is Intuition?Its Parallel Processing

• The mystery of insight, intuition, and what
  Sigmund Freud referred to as primary-process
  thinking can be elucidated by identifying these
  process with parallel processes.
• Parallel processes are difficult to articulate
  (verbalize) explicitly.

80
Advantages of Rule-Based Reasoning

• Speed.
• Less effort and mental strain.
• Highly objective.
• Optimized for standardized tests and simple essay
  tests that require only regurgitation (e.g.,
  simple definitions, or descriptions of processes).

81
Disadvantages of Rule-Based Reasoning

• Handicapped at the search phase.
• Handicapped at the match phase.
• Possible misuse or abuse of rules at the
  verification phase.
• Incapable of generating new rules.
• Unsuitable for most essay tests that require
  reorganization of knowledge or novel arguments.
• Short retention time.
• Not conducive to creativity.

82
????????????????Rule-Based Reasoning Fosters A
False Sense of Safety
83
A Dye Laser

• A dye laser with the chassis closed for normal
  operation (left). The chassis is opened to expose
  the capacitor and the flash lamp.

84
Dye Laser with a high-voltage condenser
(capacitor)

• The dye laser and its high-voltage (12,000 volts)
  capacitor (condenser). Normally, the stored
  electricity discharges, upon triggering, through
  the flash lamp to stimulate the dye to generate
  laser light.

85
Safety Interlock
Unlatch the safety interlock allows electricity
to be discharge through the resistor to the
ground so the no lethal amount of electricity is
present upon opening the chassis.
86
The Resistors in the Protective Circuitry

• The resistors in the protective circuitry are
  occasionally burnt out, thus preventing the
  normal function of the safety interlock.
• ????,?????

87
Rule-Based Reasoning Could Kill

• If the resistors are blown, the safety interlock
  circuitry no longer protects the operator from
  the lethal high voltage.
• Rule-based reasoning failed to take into account
  the circumstance of malfunctioning of the
  protective circuitry when the resistors burnt out.

88
?????????

• ??????????,????????????????????????
• ????????????

89
??????Tragic Accident at Mt. Everest

• The pros and cons of rule-based versus
  picture-based reasoning were vividly described in
  Anatoli Boukreev and G. Weston DeWalt's book The
  Climb, which chronicled the May 10, 1996, tragic
  accident in the Death Zone of Mt. Everest (pp.
  134-135)
• ??????????????,?Anatoli Boukreev?G. Weston
  DeWalt??The Climb????????????1996?5?10?,???????De
  ath Zone?????(pp. 134-135) .

90
??????Tragic Accident at Mt. Everest

• There was a tragic mountaineering accident in the
  Death Zone of Mt. Everest on May 10, 1996.
• Rob Hall, the leader of Adventure Consultants
• legalist philosophy ?????
• Scott Fischer, the leader of Mountain Madness
• situationist philosophy ????

91
??????Tragic Accident at Mt. Everest

• The differences between Rob Hall's and Scott
  Fischer's philosophies of guiding high-altitude
  mountaineering tours were emblematic of an
  ongoing debate between practitioners in the
  adventure travel industry. The camps of belief
  can be roughly divided between the
  situationalists and the legalists.
• Rob Hall?Scott Fischer ???????
  ??????????,?????????????????????????????? ????
  ? ??????

92
??????Tragic Accident at Mt. Everest

• The situationalists argue that in leading a risky
  adventure no system of rules can adequately cover
  every situation that might arise, and they argue
  that rules on some occasions should be
  subordinated to unique demands that present
  themselves.
• ??????,????????,??????????????????????????????????
  ??????,??????????????

93
??????Tragic Accident at Mt. Everest

• The legalist, believing that rules can
  substantially reduce the possibility of bad
  decisions being made, ask that personal freedom
  take a backseat.
• ???????????????????,???????????????????????????

94
??????Tragic Accident at Mt. Everest

• Critics of the legalist philosophy argue that an
  omniscient, rule-based position that minimizes
  independent action is being promulgated largely
  out of fear of bad publicity or lawsuits that
  might result from a lack of demonstrable
  responsibility.
• ????????????,??????????????????????????,??????????
  ?????,??????????????????????????????,???????????

95
??????Tragic Accident at Mt. Everest

• These critics find it confoundingly odd that an
  industry that promotes the values of personal
  freedom and initiative would expound a philosophy
  that minimizes the pursuit of these very values.
• ??????????????????????????????????,??????????????
  ???

96
What Is Intuition?Aha! Phenomenon

• Suddenness of occurrence
• A snapping action tantamount to bursting into
  laughter or a sigh of relief
• Feeling of certainty before verification
• Complete ignorance of why and how it happens
• All these features point to parallel processing.

97
What Is Intuition?Our Present Interpretation

• the ability to correctly prune off unproductive
  search paths from the search tree, while
  correctly preserving productive search paths that
  are not obvious, so as to arrive at an optimal
  search space (heuristic search ??????).
• the uncanny ability to recognize a subtle match
  where average people fail.
• In brief, having a good intuition means being
  good at both searching and matching.

98
Re-interpretation of Freuds Concept of the
Unconscious

• Segmentation of working memory into two regions
• focal attention vs. peripheral attention
• Defocusing of selective attention expands the
  search space.
• The notion of the edge of attention

99
????????????????? Three Litmus Tests of
Creativity Theories

• ???????????? (??)???????
• ???????????????,???????????????
• ?????????
• Explain what intuition, insight, or the source of
  inspiration is.
• Explain why the creator often had no awareness of
  how a discovery had been made, even after the
  fact.
• Explain why a discovery often occurred suddenly
  Eureka! Aha phenomenon.

100
AI Interpretation of Simontons Model

• Search-and-Match Phase (two options)
• Picture-based reasoning
• parallel processing
• with random access
• subjective judgment required
• Rule-based reasoning
• sequential processing
• with sequential access
• objective judgment required

101
AI Interpretation of Simontons Model

• Verification phase (only one option)
• Strictly rule-based reasoning
• sequential processing
• strictly objective judgment required

102
Francis Bacon (??) The New Organon ????Idols of
the Marketplace ???????????

• And therefore the ill choice of words
  wonderfully obstructs the understanding.
• Nor do the definitions or explanations wherewith
  in some things learned men are wont to guard and
  defend themselves, by any means set the matter
  right.
• But words plainly force and overrule the
  understanding, and throw all into confusion, and
  lead men away into numberless empty controversies
  and idle fancies.
• ??,???????????,?????????
• ??????,????????????????,?????????????,???????????
  ?
• ?????????????????,??????,??????????????????????

103
Hemispheric LateralizationNovelty-Routinization
Scheme

• Left Cerebral Hemisphere
• ????
• Speech and language function ???????
• Linear sequential thought ????
• Routinized cognitive strategies ??????
• Sequential processing ?????

104
Hemispheric LateralizationNovelty-Routinization
Scheme

• Right Cerebral Hemisphere
• ????
• Nonverbal and spatio-visual function ?????????
• Gestalt (holistic) synthesis ??????????
• Pattern recognition ????
• Exploratory and novel cognitive strategies
  ????????
• Parallel processing ????