Data Engineering

We help turn data into a reliable and usable source of information. We design data models, build data pipelines and integrations, and ensure data processing with an emphasis on performance, consistency and scalability. We build on proven Free and Open Source technologies.

// what we do

i-01

Data model & warehouse design

Design of relational and analytical data models and data warehouses with an emphasis on consistency, performance and long-term maintainability.

i-02

ETL / ELT pipelines

Building reliable data pipelines for the extraction, transformation and loading of data, including schema versioning with Flyway.

i-03

Data integrations & streaming

Connecting systems and processing data in real time using Apache Kafka and RabbitMQ.

i-04

DB performance optimization

Tuning queries, indexes and database configuration for high performance over large data volumes, primarily on PostgreSQL.

i-05

Fulltext & search

Design and operation of fulltext search and data indexing with Elasticsearch, OpenSearch and Redis.

i-06

Analytics & reporting

Visualization and accessibility of data through tools such as Redash, Grafana, eCharts and Highcharts.