Differences

This shows you the differences between two versions of the page.

--- teaching:mfe:is [2016/04/13 17:27]
msakr [Assessing Existing Communication Protocols In The Context Of DaaS]
+++ teaching:mfe:is [2019/02/18 15:39]
svsummer
@@ Line 1: / Line 1: @@
-====== MFE 2016-2017 : Web and Information Systems ======
+====== MFE 2019-2020 : Web and Information Systems ======
 ===== Introduction =====
@@ Line 18: / Line 18: @@
 ===== Master Thesis in Collaboration with Euranova =====
-Our laboratory performs collaborative research with Euranova R&D (http://euranova.eu/). The list of subjects proposed for this year by Euranova can be found
+Our laboratory performs collaborative research with Euranova R&D (http://euranova.eu/). The list of subjects proposed for this year by Euranova can be found {{:teaching:mfe:euranova_masterthesis_2017.pdf|here}}.
-{{:teaching:mfe:master_thesis_euranova_2015.pdf|here}}
 These subject include topics on distributed graph processing, processing big data using Map/Reduce, cloud computing, and social networks.
@@ Line 25: / Line 25: @@
   * Contact : [[ezimanyi@ulb.ac.be|Esteban Zimanyi]]
-===== Complex Event Processing in Apache Spark and Apache Storm =====
-The master thesis is put forward in the context of the SPICES "Scalable Processing and mIning of Complex Events for Security-analytics" research project, funded by Innoviris.
-Within this project, our lab is developping a declarative language for Complex Event Processing (CEP for short). The goal in Complex Event Processing is to derive pre-defined patterns in a stream of raw events. Raw events are typically sensor readings (such as "password incorrect for user X trying to log in on machine Y" or "file transfer from machine X to machine Y"). The goal of CEP is then to correlate these events into complex events. For example, repeated failed login attempts by X to Y should trigger a complex event "password cracking warning" that refers to all failed login attempts.
+===== Dynamic Query Processing on GPU Accelerators =====
-The objective of this master thesis is to build an interpreter/compiler for this declarative CEP language that targets the distributed computing frameworks Apache Spark and/or Apache Storm as backends. Getting aquaintend with these technologies is part of the master thesis objective.
+This master thesis is put forward in the context of the DFAQ Research Project: "Dyanmic Processing of Frequently Asked Queries", funded by the Wiener-Anspach foundation.
-**Validation of the approach** Validation of the proposed interpreter/compiler should be done on two levels:
+Within this project, our lab is hence developing novel ways for processing "fast Big Data", i.e., processing of analytical queries where the underlying data is constantly being updated. The analytics problems envisioned cover wide areas of computer science and include database aggregate queries, probabilistic inference, matrix chain computation, and building statistical models.
-  * a theoretical level; by comparing the generated Spark/Storm processors to a processor based on "Incremental computation" that is being developped at the lab
-  * an experimental level; by proposing a benchmark collection of CEP queries that can be used to test the obtained interpreter/compiler, and report on the experimentally observed performance on this benchmark.
-**Deliverables** of the master thesis project
+The objective of this master thesis is to build upon the novel dynamic processing algorithms being developed in the lab, and complement these algorithms by proposing dynamic evaluation algorithms that execute on modern GPU architectures, thereby exploiting their massive parallel processing capabilities.
-  * An overview of the processing models of Spark and Storm
-  * A definition of the declarative CEP language under consideration
-  * A description of the interpretation/compilation algorithm
-  * A theoretical comparison of this algorithm wrt an incremental evaluation algorithm.
-  * The interpreter/compiler itself (software artifact)
-  * A benchmark set of CEP queries and associated data sets for the experimental validation
-  * An experimental validation of the compiler, and analysis of the results.
-**Interested?**
+Since our current development is done in the Scala programming language, prospective students should either know Scala, or being willing to learn it within the context of the master thesis.
-  * Contact : [[stijn.vansummeren@ulb.ac.be|Stijn Vansummeren]]
-**Status**: available
+**Validation of the approach** Validation of master thesis' work should be done on two levels:
+  * a theoretical level; by proposing and discussing alternative ways to do incremental computation on GPU architectures, and comparing these from a theoretical complexity viewpoint
+  * an experimental level; by proposing a benchmark collection of CEP queries that can be used to test the obtained versions of the interpreter/compiler, and report on the experimentally observed performance on this benchmark.
-===== Graph Indexing for Fast Subgraph Isomorphism Testing =====
-There is an increasing amount of scientific data, mostly from the bio-medical sciences, that can be represented as collections of graphs (chemical molecules, gene interaction networks, ...). A crucial operation when searching in this data is that of subgraph    isomorphism testing: given a pattern P that one is interested in (also a graph) in and a collection D of graphs (e.g., chemical molecules), find all graphs in G that have P as a   subgraph. Unfortunately, the subgraph isomorphism problem is computationally intractable. In ongoing research, to enable tractable processing of this problem, we aim to reduce the number of candidate graphs in D to which a subgraph isomorphism test needs   to be executed. Specifically, we index the graphs in the collection D by means of decomposing them into graphs for which subgraph   isomorphism *is* tractable. An associated algorithm that filters graphs that certainly cannot match P can then formulated based on ideas from information retrieval.
+**Deliverables** of the master thesis project
+  * An overview of query processing on GPUs
+  * A definition of the analytics queries under consideration
+  * A description of different possible dynamic evaluation algorithms for the analytical queries on GPU architectures.
+  * A theoretical comparison of these possibilities
+  * The implementaiton of the evaluation algorithm(s) (as an interpreter/compiler)
+  * A benchmark set of queries and associated data sets for the experimental validation
+  * An experimental validation of the compiler, and analysis of the results.
-In this master thesis project, the student will emperically validate on real-world datasets the extent to which graphs can be decomposed into graphs for which subgraph isomorphism is tractable, and run experiments to validate the effectiveness of the proposed method in terms of filtering power.
-**Interested?** Contact : [[stijn.vansummeren@ulb.ac.be|Stijn Vansummeren]]
+**Interested?** Contact :  [[svsummer@ulb.ac.be|Stijn Vansummeren]]
 **Status**: available
-===== A Scala-based runtime and compiler for Distributed Datalog =====
+===== Multi-query Optimization in Spark =====
-Datalog is a fundamental query language in datamanagement based on logic programming. It essentially extends select-from-where SQL queries with recursion. There is a recent trend in data management research to use datalog to specify distributed applications, most notably on the web, as well as do inference on the semantic web. The goal of this thesis is to engineer a basic **distributed datalog system**, i.e., a system that is capable of compiling & running distributed datalog queries. The system should be implemented in the Scala programming language. Learning Scala is part of the master thesis project.
+Distributed computing platforms such as Hadoop and Spark focus on addressing the following challenges in large systems: (1) latency, (2) scalability, and (3) fault tolerance. Dedicating computing resources for each application executed by Spark can lead to a waste of resources. Unified distributed file systems such as Alluxio has provided a platform for computing results among simultaneously running applications. However, it is up to the developers to decide on what to share.
-The system should:
+The objective of this master thesis is to optimize various applications running on a Spark platform, optimize their execution plans by autonomously finding sharing opportunities, namely finding the RDDs that can be shared among these applications, and computing these shared plans once instead of multiple times for each query.
-  * incorporate recently proposed worst-case join algorithms (i.e., the [[http://arxiv.org/abs/1210.0481|leapfrog trie join]])
-  * employ known local datalog optimizations (such as magic sets and QSQ)
-**Validation of the approach** The thesis should propose a benchmark collection of datalog queries and associated data workloads that be used to test the obtained system, and measure key performance characteristics (elasticity of the system; memory frootprint; overall running time, ...)
+**Deliverables** of the master thesis project
+  * An overview of the Apache Spark architecture.
+  * Develop a performance model for queries executed by Spark.
+  * An implementation that optimizes queries executed by Spark and identify sharing opportunities.
+  * An experimental validation of the developed system.
-**Required reading**:
+**Interested?** Contact :  [[svsummer@ulb.ac.be|Stijn Vansummeren]]
-  * Datalog and Recursive Query Processing - Foundations and trends in query processing.
-  * LogicBlox, Platform and Language: A Tutorial (Todd J. Green, Molham Aref, and Grigoris Karvounarakis)
-  * Dedalus: Datalog in Time and Space (Peter Alvaro, William R. Marczak, Neil Conway, Joseph M. Hellerstein, David Maier, and Russell Sears)
-  * Declarative Networking (Loo et al). For the distributed evaluation strategy.
-  * Parallel processing of recursive queries in distributed architectures (VLDB 1989)
-  * Evaluating recursive queries in distributed databases (IEEE trans knowledge and data engieneering, 1993)
-**Deliverables**:
-  * Semantics of datalog; overview of known optimization strategies (document)
-  * Description of the leapfrog trie join (document)
-  * Datalog system (software artifact)
-  * Experimental analysis of developped system on a number of use cases (document)
-**Interested?**
-  * Contact : [[stijn.vansummeren@ulb.ac.be|Stijn Vansummeren]]
 **Status**: available
+===== Graph Indexing for Fast Subgraph Isomorphism Testing =====
+There is an increasing amount of scientific data, mostly from the bio-medical sciences, that can be represented as collections of graphs (chemical molecules, gene interaction networks, ...). A crucial operation when searching in this data is that of subgraph    isomorphism testing: given a pattern P that one is interested in (also a graph) in and a collection D of graphs (e.g., chemical molecules), find all graphs in G that have P as a   subgraph. Unfortunately, the subgraph isomorphism problem is computationally intractable. In ongoing research, to enable tractable processing of this problem, we aim to reduce the number of candidate graphs in D to which a subgraph isomorphism test needs   to be executed. Specifically, we index the graphs in the collection D by means of decomposing them into graphs for which subgraph   isomorphism *is* tractable. An associated algorithm that filters graphs that certainly cannot match P can then formulated based on ideas from information retrieval.
-=====Publishing and Using Spatio-temporal Data on the Semantic Web=====
+In this master thesis project, the student will emperically validate on real-world datasets the extent to which graphs can be decomposed into graphs for which subgraph isomorphism is tractable, and run experiments to validate the effectiveness of the proposed method in terms of filtering power.
+**Interested?** Contact : [[stijn.vansummeren@ulb.ac.be|Stijn Vansummeren]]
-[[http://www.w3c.org/|RDF]] is the [[http://www.w3c.org/|W3C]] proposed framework for representing information
+**Status**: available
-in the Web. Basically, information in RDF is represented as a set of triples of the form (subject,predicate,object).  RDF syntax is based on directed labeled graphs, where URIs are used as node labels and edge labels. The [[http://linkeddata.org/|Linked Open Data]] (LOD) initiative is aimed at extending the Web  by means of publishing various open datasets as RDF,  setting RDF links between data items from different data sources.  Many companies  and government agencies are moving towards publishing data following the LOD initiative.
-In order to do this, the original data must be transformed into Linked Open Data. Although most of these data are alphanumerical, most of the time they contained  a spatial or spatio-temporal component, that must also be transformed. This can be exploited
-by application providers, that can build attractive and useful applications, in particular, for devices like mobile phones, tablets, etc.
-The goals of this thesis are: (1) study the existing proposals for mapping spatio-temporal data into LOD; (2) apply this mapping to a real-world case study (as was the case for the [[http://www.oscb.be/|Open Semantic Cloud for Brussels]] project; (3) Based on the produced mapping, and using existing applications like the [[http://linkedgeodata.org/|Linked Geo Data project]], build applications that make use of LOD for example, to find out which cultural events are taking place at a given time at a given location.
-    * Contact: [[ezimanyi@ulb.ac.be|Esteban Zimányi]]
 =====Extending SPARQL for Spatio-temporal Data Support=====
@@ Line 116: / Line 95: @@
    * Contact: [[ezimanyi@ulb.ac.be|Esteban Zimányi]]
-=====Efficient Management of (Sub-)structure  Similarity Search Over Large Graph Databases. =====
-The problem of (sub-)structure similarity search over graph data has recently drawn significant research interest due to its importance in many application areas such as in Bio-informatics, Chem-informatics, Social Network, Software Engineering, World Wide Web, Pattern Recognition, etc.  Consider, for example, the area of drug design, efficient techniques are required to query and analyze huge data sets of chemical molecules thus shortening the discovery cycle in drug design and other scientific activities.
-Graph edit distance is widely accepted as a similarity measure of labeled graphs due to its ability to cope with any kind of graph structures and labeling schemes.  Today, graph edit similarity plays a significant role in managing graph data , and is employed in a variety of analysis tasks such as graph classification and clustering, object recognition in computer vision, etc.
-In this master thesis project,  due to the hardness of graph edit distance (computing graph edit distance is known to be NP-hard problem), the student  will investigate the current approaches that deals with problem complexity while searching for similar (sub-)structures.  At the end, the student should be able to empirically analyze and contrast some of the interesting approaches.
 =====A Generic Similarity Measure For Symbolic Trajectories=====
@@ Line 149: / Line 121: @@
 **Status**: available
-=====Assessing Existing Communication Protocols In The Context Of DaaS =====
-Data-as-a-Service (DaaS) is an emerging cloud model. The main offering of DaaS is to allow data producers/owners to publish data services on the cloud. The idea of publishing data via a service interface is not new. SOA protocols have enabled this long ago. Yet, these protocols were not developed with the cloud and the big data in mind. This is probably why the term DaaS has emerged. It marks the need for protocols and tools that enable big data exchange.
-DaaS services need to exchange large amounts of data. Large here refers to large message size, large message count, or a combination of both. RESTful services, for instance, communicate over HTTP, which is not a good choice for communicating large messages/files. SOAP services are not bound to HTTP, but they introduce another overhead of requiring messages to be strictly formatted in XML. This is why researchers started to reconsider older protocols like the BitTorrent, and suggesting extension to existing protocols like the SOAP with Attachments.
-The topic of this thesis is to perform a comprehensive survey on the protocols data exchange, and assess their suitability for DaaS. A quantitative comparison of protocols need to be done, considering at least these two dimensions: (1) the protocol: SOAP, REST, BitTorrent, etc, and (2) the message: short inline, long inline, file. The assessment should be in terms of reliability, performance, and security.
-**Deliverables** of the master thesis project
-  * A report that reviews the state of art communication protocols.
-  * Propose a tool for DaaS developers to choose the best protocol/s based on their application needs. Such a tool might also provide means of automatically switching between protocols on certain thresholds.
-  * Experiments to assess the suitability of protocols for DaaS, and to compare between them. These experiments need to be repeatable, so that others can use them on their own datasets and configurations.
-**Interested?**
-  * Contact : [[ezimanyi@ulb.ac.be|Esteban Zimanyi]]
-**Status**: available