Stanford Events Crawler

1
Stanford Events Crawler

• Zoe Chu
• Michael Tung

2
(No Transcript)
3
Crawling/Classification

• Event pages
• Index and detail pages
• 10 events/sec

4
Extraction/Normalization

• LR Wrappers
• Segmentation for email decision tree classifier
• Hand written rules for field extraction
• Date Time Normalization
• Building Normalization
• Edit distance against a lexicon of Stanford
  building names
• Free text search - Lucene

5
Which fields?

• Title
• Date
• Time
• Location
• Category
• Sponsor
• Contact info
• Admission/fees
• Speaker
• Food
• Description
• Building
• X,Y physical coordinates
• Picture of building
• Map
• Nearby buildings