The StreamGlobe Project

Motivation

New data-intensive applications where the data is not modeled as persistent relations but rather as transient data streams become more and more important. Examples of such applications are monitoring financial, network, or telecommunications data, processing of data delivered by sensor networks, and others. New techniques are needed for these applications as the data stream model is incompatible with many traditional query processing techniques because of the possibly unbounded size and read-once nature of data streams.

Research topics

• XML data streams
• Semantics of data streams and new data stream operators
• Application of traditional query operators on data streams
• Efficient dissemination of data streams
• Continuous queries on data streams and routing of data streams
• Query optimization and execution in the presence of data streams
• Architecture of distributed data stream processing systems
• Peer-to-Peer technologies in data stream systems

Current status

We are currently implementing a first distributed data stream management system. It will serve as the research platform for future and current research directions mentioned above.

Documents

• Overview of the StreamGlobe Architecture

• StreamGlobe Overview Poster

• StreamGlobe Demo Poster (presented at D-Grid All-Hands-Meeting)

• StreamGlobe: Grid-based Data Stream Management (presented at GES 2007)

• Richard Kuntschke and Alfons Kemper
  Matching and Evaluation of Disjunctive Predicates for Data Stream Sharing
  Proceedings of the 15th ACM Conference on Information and Knowledge Management (CIKM 2006),
  November 6 - 11, 2006, Arlington, VA, USA, pp. 832-833
  Poster: [PDF (A0)] · [PDF (A1)]
  Presentation: [PowerPoint] · [PDF]

• Richard Kuntschke and Alfons Kemper
  Data Stream Sharing
  Current Trends in Database Technology - EDBT 2006
  EDBT 2006 Workshop PhD, DataX, IIDB, IIHA, ICSNW, QLQP, PIM, PaRMa, and Reactivity on the Web, Munich, Germany, March 26-31, 2006, Revised Selected Papers
  Lecture Notes in Computer Science (LNCS), Vol. 4254, pp. 769-788

• Richard Kuntschke and Alfons Kemper
  Matching and Evaluation of Disjunctive Predicates for Data Stream Sharing
  Technical Report TUM-I0615, Technische Universität München, August 2006

• Richard Kuntschke and Alfons Kemper
  Data Stream Sharing
  Proceedings of the 2nd International Workshop on Pervasive Information Management (PIM 2006),
  March 30, 2006, Munich, Germany
  Presentation: [PowerPoint] · [PDF]

• Richard Kuntschke, Bernhard Stegmaier, Alfons Kemper, and Angelika Reiser
  StreamGlobe: Processing and Sharing Data Streams in Grid-Based P2P Infrastructures
  Proceedings of the 31st International Conference on Very Large Data Bases (VLDB 2005),
  August 30 - September 2, 2005, Trondheim, Norway, pp. 1259-1262
  Presentation: [PowerPoint] · [PDF]
  Poster 1: [PDF]
  Poster 2: [PDF]

• Richard Kuntschke, Bernhard Stegmaier, and Alfons Kemper
  Data Stream Sharing
  Technical Report TUM-I0504, Technische Universität München, April 2005

• Richard Kuntschke, Bernhard Stegmaier, Franz Häuslschmid, Angelika Reiser, Alfons Kemper, Hans-Martin Adorf, Harry Enke, Gerard Lemson and Wolfgang Voges
  Datenstrom-Management für e-Science mit StreamGlobe
  Datenbank-Spektrum, Vol. 4, No. 11, November 2004, pp. 14-22

• Bernhard Stegmaier and Richard Kuntschke
  StreamGlobe: Adaptive Anfragebearbeitung und Optimierung auf Datenströmen
  Workshop Dynamische Informationsfusion, 34. Jahrestagung der Gesellschaft für Informatik (Informatik 2004),
  September 21, 2004, Ulm, Germany, pp. 367-372
  Presentation: [PowerPoint] · [PDF]

• Christoph Koch, Stefanie Scherzinger, Nicole Schweikardt, and Bernhard Stegmaier
  FluXQuery: An Optimizing XQuery Processor for Streaming XML Data
  Demonstration at the 30th International Conference on Very Large Data Bases (VLDB 2004),
  August 30 - September 3, 2004, Toronto, Canada, pp. 1309-1312
  Poster: [PDF]

• Christoph Koch, Stefanie Scherzinger, Nicole Schweikardt, and Bernhard Stegmaier
  Schema-based Scheduling of Event Processors and Buffer Minimization for Queries on Structured Data Streams
  Proceedings of the 30th International Conference on Very Large Data Bases (VLDB 2004),
  August 30 - September 3, 2004, Toronto, Canada, pp. 228-239
  Extended version: [CoRR]
  Errata: [TXT]
  Presentation: [PowerPoint]

• Bernhard Stegmaier, Richard Kuntschke, and Alfons Kemper
  StreamGlobe: Adaptive Query Processing and Optimization in Streaming P2P Environments
  Proceedings of the 1st International Workshop on Data Management for Sensor Networks (DMSN 2004),
  August 30, 2004, Toronto, Canada, pp. 88-97
  Presentation: [PowerPoint] · [PDF]

• Alfons Kemper and Bernhard Stegmaier
  Evaluating Bestmatch-Joins on Streaming Data
  Technical Report MIP-0204, Universität Passau, 2002

Current projects

• Efficient dissemination of data streams in a distributed Publish&Subscribe architecture
• Processing and optimizing queries on structured data streams

Past projects

• BestmatchJoin on data streams
• Implementation, refinement, and evaluation of punctuation semantics for data streams

Related projects

• StarGlobe

People

Staff:

Benjamin Gufler

Prof. Alfons Kemper, Ph.D.

Richard Kuntschke

Dr. Angelika Reiser

Tobias Scholl

Students:

• Atanas Gegov
• Valentin Georgiev Shopov

Cooperation Partners:

• Dr. Christoph Koch
  (Universität des Saarlandes)
• Dr. Vassily Lyutsarev
  (MSRC)
• Stefanie Scherzinger
  (Universität des Saarlandes)
• Dr. Nicole Schweikardt
  (HU Berlin)

Former Staff Members:

• Dr. Bernhard Stegmaier

Former Student Members:

• Markus Ast
• Thomas Bachmann
• Pawel Brzakala
• Bo Feng
• Andreas Fuchs
• Markus Gerstel
• Franz Häuslschmid
• René Pfeuffer
• Stefan Puchner
• Alfons Ruch
• Michael Seibold