NotaQL - The Cross-System Data-Transformation Language

 

NoSQL databases are a popular alternative to relational database systems. They offer new access methods, data models and are made for "Big Data". Typically, access methods in these systems are very simple, and complex queries with aggregations and joins are not supported. That is why frameworks like Hadoop MapReduce, Spark or Flink are called into action. But using these frameworks involve a lot of coding effort, and they are not usable for people without coding experience.

 

The language NotaQL has three aims:

 

  • An easy-to-learn concise language to define data transformations in a few lines of code. These also include transformations on flexible schemas and complex data types.
  • NotaQL allows for cross-system transformations by supporting input and output engines for various database systems, file formats, and services with different data models.
  • Transformations in NotaQL can be executed in different ways. Classical approaches iterate over the whole input data, transform, aggregate and store the result into the target system. Incremental approaches can reuse the result of a former computation and only process the changed data.

 

NotaQL can be used for different applications like data integration, migration, polyglot persistence, and data analytics. A transformation platform allows for a distributed execution of NotaQL transformation in different incremental and non-incremental ways.

 

 

Publications

2017

pdf
Florian Haubold, Johannes Schildgen, Stefanie Scherzinger and Stefan Deßloch
ControVol Flex: Flexible Schema Evolution for NoSQL Application Development
In: Proc. BTW (Demo Paper)
2017
pdf
Johannes Schildgen, Yannick Krück and Stefan Deßloch
Transformations on Graph Databases for Polyglot Persistence with NotaQL
In: Proc. BTW
2017
pdf
Johannes Schildgen
Datentransformationen in NoSQL-Datenbanken
Ph.D. Thesis, Technische Universität Kaiserslautern, 2017

2016

default
Johannes Schildgen, Thomas Lottermann and Stefan Deßloch
Cross-System NoSQL Data Transformations with NotaQL
In: Proc. SIGMOD Workshop "Algorithms and Systems for MapReduce and Beyond (BeyondMR)", San Francisco
July 2016
default
Johannes Schildgen and Stefan Deßloch
Heterogenität überwinden mit der Datentransformationssprache NotaQL
Datenbank-Spektrum
Springer Verlag, 2016

2015

pdf
Stefan Braun, Johannes Schildgen and Stefan Deßloch
Visualisierung von NoSQL-Transformationen unter der Verwendung von Sampling-Techniken
Herbsttreffen der Fachgruppe Datenbanken@LWA 2015
October 2015
default
Johannes Schildgen and Stefan Deßloch
NotaQL Is Not a Query Language! It's for Data Transformation on Wide-Column Stores
In: Proc. British International Conference on Databases - BICOD 2015
default
Johannes Schildgen and Stefan Deßloch
Incremental Data Transformations on Wide-Column Stores with NotaQL
In: Proc. 9th Symposium and Summer School On Service-Oriented Computing (SummerSoc), Crete, Greece
June 2015
Export as:
BibTeX, XML

External Links

 

 

 

Contact