Real music libraries in the virtual future: for an integrated view of music and music information

1
Real music libraries in the virtual future for
an integrated view of music and music information

• Michael FingerhutIrcam Centre PompidouParis,
  France

2
The new challenges facing librariesand their
users

• Need to organize and provide access to
• Collections and archives
• Physical, ephemeral and virtual objects
• Local and remote
• Audiovisual, symbolic and textual data
• Data and metadata (and metametadata,
  metametametadata)

• Approach
• Domain-specific (music information)
• Share resources
• Provide structured and efficient search and
  navigation tools
• In collections
• In objects
• Provide appropriation tools (remember, analyze,
  explain)

3
A (simplified) map of music information
user
rights owner
cognitive, social
taste, mood
DRM
annotation
interaction
musicology
playlists
analysis
similarity
metadata
synchronization, summarization
theory
genre
indexation
pattern extraction, form recognition
semantic
information
motives
structure
features
feature extraction,identification
musicalacoustical
characteristics
concept ? sign ? signal ? sign ?
concept

symbolic
fingerprint
pitch, voice extraction
data
metadata
automatic
textual
sound
text
score
stored data
about
lyrics
symbolic
digital
OCR
paper
physical
performance (live, recorded)
publications
music
librarian
work
abstract
performer
author
composer
4
Federating internal contents and information
sources
Common search point
OAI protocol (name, title, instrumentation, date,
place)
Library catalogue
Calendarof concerts
Audio concertarchives
Biographies,articles
Concertnotes
Read
Read
Where
When, where
Listen
5
Federating contents and information sources of
distinct organizations
Common search point
OAI protocol (name, title, instrumentation, date,
place)
Organization1
Organization3
Organization2
6
Technical information

• Characteristics
• Distributed catalog vs. directory
• Domain-specific search vs. googling
• Sharing metadata
• Distributed search
• Z39.50, ZING
• Real-time
• Harvest metadata
• OAI (Open Archive Initiative)
• Light
• How to share data (full-content search)
• Share the indexes

• Underlying software SDX
• Open source search engine and publishing
  framework for XML documents
• Includes OAI
• Browse, search, thesauri
• http//adnx.org/sdx/
• Current projects
• Sharing contemporary music resources within and
  across institutions
• Sharing ethnomusicological collections across
  institutions

7
Example ethnomusicological portal
8
Displaying musical structure and navigating
within a document
9
Displaying semantic structure of a sound
recording and navigating within it
10
Annotating multimedia documents for analysis and
comparison

• Arbitrary multipage background
• Arbitrary shapes, images and text
• Layers (overlays) allowing selective display at
  play time
• Timed events
• Automatic synchronization with different audio
  files using cue points
• Cursor (forward, backward)
• Play same annotation with distinct audio (video)
  files
• Multiwindow
• (Automatic tools)

11
Efficiency (and rights) produce music excerpts
via automatic summarization
1. Find which parts sound like other parts
(timbre similarity, e.g.)
2. Extract segments
6 5 4 3 2 1
0m0s
5m25s
3. Produce summaries
all 14735 A small bit of each segment
each 01482 One segment of each type
longest 00325 Longest segment
most freq. 00325 Most frequent segment
0m0s
5m25s
similarity matrix The warmer the color (red
warmest), the more similar
Courtesy of Geoffroy Peeters, Ircam
12
The new librarian

• Less hard-core cataloguing
• Automatized procedures
• Not just google collecting
• Collection building
• Selection of documents
• Validation

• Valorization
• Virtual works
• Virtual collections
• Physicaland virtualmediation
• VRML, etc.
• Informationspecialist