An introduction to Google Big Table

1
Google Big Table

• What is it ?
• How does it work ?
• Why is it important ?
• Related products
• Big Data

www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
2
Big Table What is it ?

• NoSql database developed by Google
• In-house database for very large data sets
• Has influenced the NoSql db market place
• Highly distributed
• Client based validation
• Row / column / timestamp indexing
• No Joins available
• Based on assumption of write once read many

www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
3
Big Table Use with MegaStore
www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
4
Big Table How does it work ?

• Uses Google file system and Chubby Lock service
• Storage and versioning based upon time stamps
• Data sorted by youngest first
• No validation, validation left to client
• Allows for hardware and system failure via
  redundancy
• Arbitrary row columns
• Arbitrary column data types
• Very high data throughput

www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
5
Big Table Architecture
www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
6
Big Table How does it work ?

• Table columns grouped into families
• Column families named
• Access granted at the family level
• Family members grouped in compression
• No column datatype constraint
• Integrated with MapReduce
• I/O data streaming

www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
7
Big Table Related Products
www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
8
Big Table Why is it important ?

• Google leads the way in terms of functionality
• Their market needs drive their systems and
  offerings
• What they have done to date will
• Affect the rest of the big data market
• In the future
• Via cross pollination of ideas
• Via emulation of their success

www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
9
Big Data and Analytics
www.semtech-solutions.co.nz info_at_semtech-solutions
.co.nz
10
Contact Us

• Feel free to contact us at
• www.semtech-solutions.co.nz
• info_at_semtech-solutions.co.nz
• We offer IT project consultancy
• We are happy to hear about your problems
• You can just pay for those hours that you need
• To solve your problems