NotaQL - The Cross-System Data-Transformation Language


NoSQL databases are a popular alternative to relational database systems. They offer new access methods, data models and are made for "Big Data". Typically, access methods in these systems are very simple, and complex queries with aggregations and joins are not supported. That is why frameworks like Hadoop MapReduce, Spark or Flink are called into action. But using these frameworks involve a lot of coding effort, and they are not usable for people without coding experience.


The language NotaQL has three aims:


  • An easy-to-learn concise language to define data transformations in a few lines of code. These also include transformations on flexible schemas and complex data types.
  • NotaQL allows for cross-system transformations by supporting input and output engines for various database systems, file formats, and services with different data models.
  • Transformations in NotaQL can be executed in different ways. Classical approaches iterate over the whole input data, transform, aggregate and store the result into the target system. Incremental approaches can reuse the result of a former computation and only process the changed data.


NotaQL can be used for different applications like data integration, migration, polyglot persistence, and data analytics. A transformation platform allows for a distributed execution of NotaQL transformation in different incremental and non-incremental ways.





Florian Haubold, Johannes Schildgen, Stefanie Scherzinger and Stefan Deßloch
ControVol Flex: Flexible Schema Evolution for NoSQL Application Development
In: Proc. BTW (Demo Paper)
Johannes Schildgen, Yannick Krück and Stefan Deßloch
Transformations on Graph Databases for Polyglot Persistence with NotaQL
In: Proc. BTW
Johannes Schildgen
Datentransformationen in NoSQL-Datenbanken
Ph.D. Thesis, Technische Universität Kaiserslautern, 2017


Johannes Schildgen, Thomas Lottermann and Stefan Deßloch
Cross-System NoSQL Data Transformations with NotaQL
In: Proc. SIGMOD Workshop "Algorithms and Systems for MapReduce and Beyond (BeyondMR)", San Francisco
July 2016
Johannes Schildgen and Stefan Deßloch
Heterogenität überwinden mit der Datentransformationssprache NotaQL
Springer Verlag, 2016


Stefan Braun, Johannes Schildgen and Stefan Deßloch
Visualisierung von NoSQL-Transformationen unter der Verwendung von Sampling-Techniken
Herbsttreffen der Fachgruppe Datenbanken@LWA 2015
October 2015
Johannes Schildgen and Stefan Deßloch
NotaQL Is Not a Query Language! It's for Data Transformation on Wide-Column Stores
In: Proc. British International Conference on Databases - BICOD 2015
Johannes Schildgen and Stefan Deßloch
Incremental Data Transformations on Wide-Column Stores with NotaQL
In: Proc. 9th Symposium and Summer School On Service-Oriented Computing (SummerSoc), Crete, Greece
June 2015
Export as:

External Links