Lyric alignment in popular songs

1
Lyric alignment in popular songs

• Luong Minh Thang
• WING group meeting 12 Oct, 2007

2
Outline

• Recap
• Repetition
• Global alignment
• Local alignment
• Song model Segmentation

3
Recap

• Given
• textual transcription of lyrics
• acoustic musical signal
• of a song
• Purpose find the timestamps for the beginning
  and ending points for each line of the song.

4
Recap (cont.)
Chroma self-similarity matrix
Lyric self-similarity matrix
j
How to generate lyric-chroma similarity matrix?
i
Lyric-chroma similarity matrix
5
Repetition
Linear sequence v1, v2, .., vm
2 units I, j will have vi, vj approximately
equal count how many times vi are repeated
count how many times vi vi1 ..vik are repeated
average across length
self-similarity matrix
Repetition sequence r1, r2, .., rm
6
Repetition (cont.)

• Chroma repetition contains noise
• Need to be improved here

7
Local alignment
Chorus 1
Chorus 2 vs. Chorus 1
Chorus 2
Chorus 3
Chorus 4

• Use non-overlapped local alignment

8
Global alignment

• Scoring matrix to restrict skip on lyric side
• Free-end versions

9
Local alignment (cont.)

• Looking at a specific window
• Use local alignment to detect other segments

10
Some figures
11
Song model

• Divide dataset into 2 categories I-V1-C1-V2-C2-O
  I-V1-C1-v2-C2-V3-C3-O
• Model for each category to tell the estimated
  positions of a particular

12
Segmentation

• Align the same segments in lyric and chroma
  together.
• Use perfect knowledge to set an aim

13
Some figures
14
To be done

• Incorporate segmentation on chroma side
• Continue writing thesis
• Improving repetition values

15

• Thank you !