Streaming views over Streaming Data

1
Streaming views over Streaming Data

• Sirish Chandrasekaran

2
Query Engine Features

• Scale along
• data streams
• frequency of data arrival
• queries
• Wave-indices, chronicles dont quite make the
  cut.
• Dont sacrifice query expressiveness.
• XFilter, NiagaraCQ, ContQEddy are only filters.
• new queries cant process old data

3
General outline of a solution - 1

• Insight! treat data and views the same
• probe data with streaming views
• probe views with streaming data
• Select, Join symmetric join of data and
  predicates.

4
General outline of a solution - 2

• Scalar Aggregates
• grid files ranked trees for one-pass scalar
  aggs.
• count, sum, avg., min, max, median, percentile
• Iceberg cubes? pathological case Cube
• Store most restrictive cube and compute the rest??