ICML????? (????) ???? ? ????? ????? ?????: Discriminative Unsupervised Learning of Structured Predictors Linli Xu (U. Waterloo) ,

1
ICML????? (????)???? ? ????? ??????????
Discriminative Unsupervised Learning of
Structured PredictorsLinli Xu (U. Waterloo) ,
, Dale Schuurmans (U. Alberta), In proceeding
of ICML2006
2
??????????????????????????????????????

• ???????????
• ?????????????????????????? ????????????
• ?????????????????????!?
• ???????
• ?? ????????????
• ???? ????????????????
• ????? ?????SVM?????????????

3
??????????????????????????????????????????????

• ????
• ?????????????
• ????
• ???????????????

4
?????????????????????????????

• ????????????????????????????????????????

?? X ?? Y
2????? ?? ??? 1, -1
?????? ?? ??? 1,...,K
??????? ?? ??? ?? ???
5
??????????????????????????????????????????
??????
??? lt
??? lt
2???????
????????
?????????
??
??
??
??? lt
??? lt
???? 2??????
???????????
????????????
NIPS04
AAAI05
ICML06
?????
6
??????????????????????????
??????
??? lt
??? lt
2???????
????????
?????????
??
??
??
??? lt
??? lt
???? 2??????
???????????
????????????
NIPS04
AAAI05
ICML06
?????
7
????2??????? ???SVM???????????????????????????????
?????????????

• ??????????????????????????????????????
• ???????????????????(???????)???????

??????????????
1
1
-1
1
????
-1
-1
-1
8
???????????? ???SVM???????????????????????????????
??????????????????

• ??????????????????????????????????????????????????
  ????
• ????????????????????(???????)???????

??
??????????????????

?
?
???
?
?
????
?

9
????????????? ???SVM?????????????????????????????
??????????????????????

• ??????????????????????????????????????????????????
  ????
• ????????????????????(???????)???????

??

????????????????????
?
?
?
?
????
?
???

10
????????????????????????????????????????
??????
??? lt
??? lt
2???????
????????
?????????
??
??
??
??? lt
??? lt
???? 2??????
???????????
????????????
NIPS04
AAAI05
ICML06
?????
11
????????????????????????????????????????
??????
??? lt
??? lt
2???????
????????
?????????
??
??
??
??? lt
??? lt
???? 2??????
???????????
????????????
NIPS04
AAAI05
ICML06
?????
12
????2??????? ???SVM???????????????????????????????
?????????????

• ??????????????????????????

??????????????
1
1
-1
1
-1
-1
-1
13
???????????? ???SVM???????????????????????????????
???????????????

• ??????????? 1/(????) ????????????

???????
??????????????????

????????

14
??????????? ???SVM????????????????????????????????
??????????????

• ????????????????????????????

???????

????????????????????
?
?
?
?
?
????????

15
????SVM?2???????????????SVM???????(SDP)?????

• 2???????????
• ????? w ??????y??????????
• ??????????????????
• SDP????

primal
dual
dual
primal
16
??????????????????????

• ??????????????!? ???????????!
• synthetic 2??2??HMM????8????10?
• protein ??10???????10?

?? ??
?? ??
??????????
17
???????????????????????????????????????

• ???????????
• ?????????????????????????? ????????????
• ?????????????????????!?
• ???????
• ?? ????????????
• ???? ????????????????
• ????? ?????SVM?????????????

18
?????? ??? ????????????????

• SVM (2???) ?? ? ??????? (???????)?????
• SDP??? ? ??????????????????????????