This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision | Next revision Both sides next revision | ||
|
teaching:mfe:is [2018/04/30 11:11] svsummer [Co-locating Big Spatial Data Stored in HDFS] |
teaching:mfe:is [2018/04/30 11:11] svsummer [Complex Event Processing in Apache Spark and Apache Storm] |
||
|---|---|---|---|
| Line 106: | Line 106: | ||
| **Status**: available | **Status**: available | ||
| - | ===== Complex Event Processing in Apache Spark and Apache Storm ===== | ||
| - | |||
| - | The master thesis is put forward in the context of the SPICES "Scalable Processing and mIning of Complex Events for Security-analytics" research project, funded by Innoviris. | ||
| - | |||
| - | Within this project, our lab is developping a declarative language for Complex Event Processing (CEP for short). The goal in Complex Event Processing is to derive pre-defined patterns in a stream of raw events. Raw events are typically sensor readings (such as "password incorrect for user X trying to log in on machine Y" or "file transfer from machine X to machine Y"). The goal of CEP is then to correlate these events into complex events. For example, repeated failed login attempts by X to Y should trigger a complex event "password cracking warning" that refers to all failed login attempts. | ||
| - | |||
| - | The objective of this master thesis is to build an interpreter/compiler for this declarative CEP language that targets the distributed computing frameworks Apache Spark and/or Apache Storm as backends. Getting aquaintend with these technologies is part of the master thesis objective. | ||
| - | |||
| - | **Validation of the approach** Validation of the proposed interpreter/compiler should be done on two levels: | ||
| - | * a theoretical level; by comparing the generated Spark/Storm processors to a processor based on "Incremental computation" that is being developped at the lab | ||
| - | * an experimental level; by proposing a benchmark collection of CEP queries that can be used to test the obtained interpreter/compiler, and report on the experimentally observed performance on this benchmark. | ||
| - | |||
| - | **Deliverables** of the master thesis project | ||
| - | * An overview of the processing models of Spark and Storm | ||
| - | * A definition of the declarative CEP language under consideration | ||
| - | * A description of the interpretation/compilation algorithm | ||
| - | * A theoretical comparison of this algorithm wrt an incremental evaluation algorithm. | ||
| - | * The interpreter/compiler itself (software artifact) | ||
| - | * A benchmark set of CEP queries and associated data sets for the experimental validation | ||
| - | * An experimental validation of the compiler, and analysis of the results. | ||
| - | |||
| - | **Interested?** | ||
| - | * Contact : //Stijn Vansummeren// | ||
| - | |||
| - | **Status**: available | ||
| ===== Complex Event Processing in Apache Spark and Apache Storm ===== | ===== Complex Event Processing in Apache Spark and Apache Storm ===== | ||