?????%20?.%20????????%20?%20College%20of%20Staten%20Island%20?%20CUNY

1
????????????????? ?????? ? ????????????????

• ????? ?. ???????? ? College of Staten Island ?
  CUNY
• Sekerina_at_mail.csi.cuny.edu
• ?????????? ??????? ?? ??????????? ?????
• 28 ?????? 2005

2
????

• ??????????? ????? ? ????????????????
• ?????????? ? ???????????
• ??????????? ? ????????????????
• ????????? ??? ??????? ??????????? ?
  ????????????????
• ????????????????? ??????
• ?????????????? ? ???????????????? ??????
• ?????? ???????? ????
• ???????????? ? ????? ??????

3
????

• ????? ????? ?????? ???????? ???? (?????????????)
  Visual world paradigm
• ??????? ??? ?????? ???????? ???? (ISCAN ETL-500)
• ???????????????? ????
• 1. ?????? ??????????? ? ???????? ?????????
  (?????????? ? ???????)
• 2. ???????? ? ???????? (???????)

4
??????????? ????? ? ????????????????
?????????? ???????????????? ???????????
?????????????? ??????????? ???????????? ?????
???????????????? ??????????? ??????????
??????????? ?????
5
???????????????? ? ??????? ??????

• ???????????????? ??? ????????????????? ?????,
  ??????? ?????? ????? ??????? ?????? ?????????
• ??? ???? (? ????????) ????????? ????
• ??? ??? ?????????? ?????? ????????? ?
  ????????????
• ?????? ????????????? ??????????? ????? (???? ?
  ????).

6
???????????????? ? ??????? ??????

• (1) ????????? ? ???????????? ???? ?????????
  ?????????? ?????
• ???? ???? ? ?????? ?????
• ???????? ??? ?????????? ? ???????? ????????
• (2) ???????? ?????
• ???????? ??????? ????? ??????
• ???????? ??????? ????? ????????? (? ??????)
• (3) (1) ? (2) ? ?????????????? ???????
  ??????????? ??????????
• (4) ???????????? ????
• ?????? ? ???????? ? ????????????? ???? (?????,
  ????????)
• ?????????? ???????????? ????

7
???????????????? ? ????? ??????

• ???????????????? ? ????? ??????
• ?????????? ????????? ????, ??? ??????????
  ???????? ?????????? ? ???????? ???? (? ????),
  ????????? ??? ????? ????????????????? ??????,
  ???????????????? ?? ??????????? ??????????.

8
??????????? ? ????????????????
???????????
????????????????
Psycholinguistics
?????????
????????????
????????
?????????
?????????? ????
??????? ??????
?????????? ????. ?????????
?????????? ????????
?????? ???????????
?????????/ ??????????
?????????
?????????
9
?????????? ? ???????????

• (1) ???????????? ??????????? ???????
• ?????????? ???????????
• ????????? ?????????? ????????? ?????
• ?????? ??????? ?????
• ???????? ???????? ?????
• ???? ?????????????

10
?????????? ? ???????????

• (2) ?????????? ???????? ??? ?????????? ??????
• (3) ???? ?????? ? ????? ???????? ??????? ???
  ??????
• (4) ????????????? ?????????? ???????????

11
?????????

• ????? ??????? ??? ??????? ?????? ???????? ????,
  ??????? ?? ??????, ??? ???????????, ??????? ??
  ???????
• ??? ?? ????????? ?? ????????????? ?????, ?????
  ?????????? ??????? ????????? ???????
  ?????????????
• ???????? ????????? ??????? ?????? ?????????
  ???????????????, ?????? ?????????????.

12
????????? ????

• ?????????????/????????????? ????
• ??????????? ?????? ? ????????? ?????? ?
  ?????????? ?????????
• ?????????????? ?????? ??????????? ? ????????
  ?????????.

13
????????????????? ??????

• 1. ?????????????? ?????? (off-line)
• ????????? ??????? ????????? ????? ????, ??? ??
  ??? ??????????
• ?? ??????? ? ??????? ??????? ???????, ???????
  ?????? ?? ??????? ????????? (???????????? ??????
  ???????????)
• ?????? ???????? ???????? ?? ??????? ?????????.

14
2. ????????????????? ??????

• 2. ???????????????? ??????, ??? ????????????
  ?????? (on-line)
• ????????? ??????? ????????? ?? ???? ????, ??? ??
  ??????????
• ???????????? ????? ??????? (??????? ???????
  ?????? ? ??????????? ?? ??????)
• ????? ???????? ???????? ?? ??????? ?????????.

15
?????????????? ??????

• ?????? ???? ?????????? ????
• ??????????? ?????? ????????? ? ??????
• (click detection)
• ????? ?????????? ?????? ???????????
• (gating)
• ???????????? ??????????

16
???????????????? ??????

• ?????? ???? ?????????? ????
• ??????????
• -- ?????? ?????? ? ??????????????
• -- ????? ????????
• -- ????? ??????????? ???????
• ?????????? ?????? ???????? ????
• ???? (???????????? ???????)
• ?????-????????? ????????
• ?????? ???????? ????

17
??? ??????? ??????

• ??????? ????????????????
• ??????????? ????????
• ???????????? ??????? ????????
• ???????????? ???????????

18
??????????? ? ????????????????
???????????
????????????????
Psycholinguistics
?????????
????????????
????????
?????????
?????????? ????
??????? ??????
?????????? ????. ?????????
?????????? ????????
?????? ???????????
?????????/ ??????????
?????????
?????????
19
?????? ???????? ????

• ???????????? ?????
• ???????????? ? 1970-? ??.
• ???????????? ??? ??????
• ?????????? ????????? ????????????? ??????
  ???????????
• ????? ?????
• ???????????? ? 1995 ????
• ???????????? ? ?????? ?????
• ????????????? ???????? ?????? ?? ??????????

20
??? ???????????

• ?????????????? ???????? ????
• ??????? ???????? ???? (30-50 ????)
• ????? ????????? ????? ??????????????? ????????
  (200-300 ????)
• ????????? ??????????
• ????? ??????
• ???????????? ????????
• ???????????? ???? ????????
• ???????????? ???????

21
???????????? ?????

• Rayner, K. (1998). Eye Movements in Reading and
  Information Processing 20 Years of Research.
  Psychological Bulletin, 124(3), 372-422.

22
????? ????? ISCAN ETL-500

• Tanenhaus, M. K., Spivey-Knowlton, M. J.
  (1996). Eye-Tracking. Language and Cognitive
  Processes, 11(6), 583-588.

23
?????-??????????
Borg Technologies, Inc.
24
ISCAN ETL-500

• ???????????? ?????? ? ??????? ??????? ????????

25
??????? ?????????????? ??????

• ????????????? ????? ?????? ???????? ???? ????
  ??????? ?????????????? ? ???????????????? ? 1995
  ?.
• ?????? ???????????? ???????????? ??????? ??????
  ?????????? ? ??? ????????? (??????????? ?.
  ?????????, ???? ???-????).

26
???????????

• Rochester University (M. Tanenhaus)
• University of Pennsylvania (J. Trueswell)
• University of York (G. Altmann)
• Brown University (J. Sedivy)
• Cornell University (M. Spivey)
• Michigan State University (F. Ferreira)
• Harvard University (J. Snedeker)

27
???????????????? ???? (1)

1. ?????? ??????????? ? ???????? ?????????
   ????????????? ?????????? ??????
2. ????????? ? ????????????? ??????????????
3. ???????? ? ???????? (?????)
4. ????????????? ????? ? ?????? ????
5. ?????????? ? ????????? ??????????? ????
6. ????????? ? ?????????? ????????

28
1. ?????? ???????????

• Tanenhaus, M. K., Spivey-Knowlton, M. J.,
  Eberhard, K. M., Sedivy, J. C. (1995).
  Integration of Visual and Linguistic Information
  in Spoken Language Comprehension. Science,
  268(5217), 1632-1634.
• ?????????????? ?????????????? ????????? ?
  ??????????? ????????? ? ???????? ???????
  ????????? (????????) ???????????? ???????????

29
??????? ??????? ??? ?????????

• ? ???????? ????????/?????? ???? ?? ???? ?????
  ???????????, ????? ?????? ??? ????????
• ????????????? ??????????? ??????????????
  ????????, ?? ????? ??????
• ??? ???? ?? ????????? ???????? ??????? ????????
  ????? ?? ????? ?? ???????.

30
??????????? ??????????????

• ??????????
• ???? ????? ????.
• ?????? ??????????? ???????????? ?? ???????.
• ???? ???????? ??????.
• ? ??????????? ?????? ???? ?????? ???????????.
• ???? ?????????? ??? ????????? ?? ?????
  ??????????.

31
??????????? ??????????????

• ?????????

???? ????? ??????? ? ... ...
?????. ... ??????. ?????
???????????... ... ???? ????????????.
...???????? ??????? ?????????.
32
??????????? ???????????

• Garden-Path (to lead down the garden path)

???? ????? ??????? ? ... ....?????. ...????
??. (??????????? ???????????)
????? ???????????... ...????
????????????. ....???????? ???????
?????????. (???????????
???????????)
33
????????????? ?????????? ??????

• ???????? ??????? ?? ?????????.
• ???????? ??????? ?? ????????? ? ?????.

• ????????????? ??1 ?? ????????? ????????
  ???????????
• ??? ???????? ????? ??? ??????? ????????
• ??? ??????????? ???????????????? ???????

34
????????????? ?????????? ??????

• ???????? ??????? ?? ?????????...
• -- ???????????? ???????? ???????? ?????.
• ???????? ??????? ?? ????????? ? ?????.
• -- ????????? ?????????????? ?????????, ?
  ?????????? ??????? ?? ????????????? ????? ?
  ????????????? ???????????.

35
??????
36
?????????????? ??????? (1)
?????????? ???????? 1 ???????? 2 ?????????
37
??????????

• ????????????????? ?????? (2)
• ???????? ???????????? ?????????
• ???????? ??????? ?? ????????? ? ?????.
• ?????????????? ?????????
• ???????? ???????,??????? ?? ?????????, ? ?????.
• ????????? ??????????
• ???????? ???????????? ?????????? ()
• ???????? ????
• ?????, ? ??????? ???? ???????? ???? ?? ??????
  ????????? ()
• ????????? ?????????? ???????? ????, ????

38
???????? 1-????????
4
1
2
3
39
???????? 2-????????
2
1
40
???????? ? ?????
41
2-????????, ??????????????
42
2-????????, ????????????
43
1-????????, ??????????????
44
1-????????, ????????????
45
??????? ???????
46
3 ?????? ?????????

• ???????????????
• ???????? ???????? ??????? ??? (?????? 2003 ?.),
  ??????? ??????? 20.7 ???
• ???? 4-6 ???, ?.????????? (???? 2003 ?.)
• ?????????? ???????? ???????? ??????????
  ???????????? ???-?????

47
3 ?????? ?????????

• ?????, ??????????????
• ???????? ??????? ?? ????????? ? ? ???????.
• ???????? ??????? ?? ??????? ? ? ???????.
• ?????, ????????????
• ???????? ??????? ?? ????????? ? ???????.
• ???????? ??????? ?? ??????? ? ???????.

48
??????

• ???????? ?????????? ???????? ???????? ?? ????????
  (??????????).
• ????? ????? ?????????????? ??????????????
  ????????? ? ??????????? ????????? ? ????????
  ????????? (????????) ???????????? ???????????.
  ????? ???????? ????????????? ??????? ???????????
  ???????????.
• ?????? ???????? ???????? ??????? ???????????.

49
??????????????? ??????????????
SEDIVY ET AL. (1999)
Touch the pink comb
????????? ????? ??????? Now touch the yellow
bowl. ??????? ????? ??????? Now touch the
yellow comb.
?? SEDIVY (2003) ?? ??????? ????????? ??????????.
????????????? ?????????? ????????? ????????? ???
???????? ?????????????? ?? ???????? ????????????.
?????????????? ?????????? ????? ??????? ???????
????????? ???????? ??????????????, ???? ???????
???????? ??????? ? ???????? ??????????????? ????
?????? ????? ? ?????????? ?????.
50
??????????????? ? ????????
????? ?? ??????? (??? ???????) ??????? ?????????
??? ?????? ??????????? ??????????????? ???????,
????????, ?????????
?? SEDIVY ET AL. (1999)
??????????? ???????? ?? ????? ?????? Now touch
the YELLOW comb Now touch the yellow comb.
51
??????? ???? ? ??????? ?????

• ????? ??????? ?????????????? ??????? ?????????
  ??? ???????? ??????????????, ????? ??????????
  ????????? ???????????? ?????????????? ???????????
  ? ????????? ? ????????????? ?????????.
• ?????? ??????? ????
• ???????? ??????? ?????????
• SPLIT WORD ORDER
• ??????? ???????? ?????????
• ?????????? ??????????? ?????????.
• ??????????? ??????? ???????????? ???????? ??
  ????? ?? 2?? ??????????? ?? ?? ??? ??
  ??????????????.

52
??????? ???????????

• ??????????
• 24 ???????? ??????? ?????
• ???????
• ?????????? ? ????????? ?????????? ?? ???????????
  ???????? ?? ?????
• ??????
• ?????????? ???????? ? ????????

53
?????????? ????????
1-???????? 2-???????? ???????????
????????? ????????????? ???? ????????????? ????
54
??????
1-???????? 2-????????
???????? ??????? ???????? ????????? ? ??????? 4.
?????? ??????? ???????? ????????? ? ???????
4. ???????
55
??????????? ??????????????
??????????????? ????????? ? ?????? ???????
??????????? ??????????????, ????????? ??? ???
???????? ????? ? ???????? ????.
???????
?????????
??????
56
???? ??????? ????????

• ?????????? ?????? ??????? ??????? ??????????
  ???????? ? ...
• ?????????? ????????? ? 1 ??????????, ??? ? 2
  ???????????

• ??????? ?????? ???????? ?? ?????????????? ??????
  ??????? ???? ??????.

57
????????? ? ??????
?????????? ?????????? ?? ?????. ???????
???????? ????????? ? ??????? 4. ?????? ????????
??????? ??????? ? ??????? 3. 3 ???? ???
??????? ???????? ????
????????. ?????? ?????????. ???????
???????? ?????????
58
???????? ???? ???????? - ??????
2-????????, ??? ???? ????????
1 2
1 2
????? ????? ????????????????
???????? ?????????????? ? ?????????
??????? ???????? ?????????
59
???????? ???? ???????? - ??????
1-????????, ??? ???? ????????
1 2
1 2
???????????? ????????? ?????????????? ?
????????? ? ??????. 2
??????? ???????? ?????????
60
1-????????, ?????? ????????
1 2
1 2
???????????? ?????????
??????? ???????? ?????????
61
1-????????, ??????? ????????
1 2
1 2
???????????? ????????? ???
??????? ???????? ?????????
62
Discussion
How do pragmatic and prosodic constraints
interact in resolving referential ambiguity
during on-line processing of contrastive
constituents in RUSSIAN? Both pragmatic
properties of the visual context and prosodic
characteristics of spoken instructions rapidly
affect referential ambiguity resolution.
63
Contrastive Prosody

• ENGLISH vs. RUSSIAN
• The effect of contrastive prosody is not
  consistent in English it was found in some
  studies but not others.
• Our Russian experiment demonstrated a strong
  effect of contrastive prosody that emerged much
  earlier than in those English studies that did
  find contrastive color effects (Sedivy, 2003).
• In English, identification of the target referent
  was shown to happen at 300 ms AFTER the onset of
  the NOUN.
• In Russian, the target could be identified 500 ms
  BEFORE the NOUN.

64
The Power of Russian
Why did some of English experiments fail to find
the effect of contrastive prosody in referential
ambiguity resolution compared to the Russian
experiment? The critical difference must lie in
linguistic instantiation of contrastiveness
between the two languages Contrast can be marked
grammatically in Russian, adding to effects of
context and prosody.
65
Contrastiveness in English and Russian
CONTRASTIVENESS was instantiated by the following
means
ENGLISH
RUSSIAN

• Pragmatics Visual context
• Prosody Contrastive stress

• Pragmatics Visual context
• Prosody Contrastive stress
• Grammar Split word order construction

66
Referential Functions of Structure
IMPORTANT POINT Our rapid effects of reference
and interpretation occur in a non-canonical
structure Split Word Order A complex structure
is much easier to process when the context
supports its referential function. Similar
conclusions were drawn regarding non-canonical
structures in Finnish, where word-order conveys
informational status (Kaiser Trueswell, in
press) SO Non-canonical word orders serve
specific pragmatic and referential functions that
can be deployed in real-time.
67
???????????????? ???? (1)

1. ?????? ??????????? ? ???????? ?????????
   ????????????? ?????????? ??????
2. ????????? ? ????????????? ?????????????? ?
   ???????????
3. ???????? ? ???????? (?????)
4. ????????????? ????? ? ?????? ????
5. ?????????? ? ????????? ??????????? ????
6. ????????? ? ?????????? ????????

68
???????????????? ???? (2)

• ??????????? ?????? ??????????
• ???? (The kindergarten-path effect Studying
  on-line sentence processing in young
  children. Trueswell, J. C. Sekerina, I. ?.
  Hill, N. M. Cognition, 73(2), 1999. pp. 89-134.)
• ??????? (Visual fixation patterns during viewing
  of naturalistic social situations as predictors
  of social competence in individuals with autism.
  Klin, A., Jones, W., Schultz, R., Volkmar, F.,
  Cohen, D. Archives of General Psychiatry, 59,
  2002. pp. 809-816.)
• ?????????? ???????? ? ????????, ???????????
  ?????? ????.

69

• ??????? ?? ????????!
• ?????????? ??????????? ?????
• sekerina_at_mail.csi.cuny.edu