Data Hub Release - April 03 2022 - v-0.6.240-stable

The latest release can be found at: https://github.com/mimiro-io/datahub/releases/tag/v-0.6.240-stable

There are a number of fixes and new features.

Highlights

Job scheduler

It is now possible to configure the maximum jobs the data hub runs in parallel via

Data Hub Security

It is now possible to activate a built in security provider in data hub.

Along with built in jwt authentication, operators can configure access levels using a simple but powerful url based ACL module.

External jwt providers and OPA authorization remain supported.

Read the documentation

Proxy Datasets

Data hub enables the creation of proxy datasets. A proxy dataset does not store data in data hub, but forwards all API requests to a data layer or another data hub instance.

LatestOnly dataset sources in jobs

Dataset sources configured with a LatestOnly flag will only emit the latest, current state of each entity in a job run. Also in fullsync runs. This is especially useful for jobs which enrich a dataset using queries, where enriching every historic version of an entity produces unwanted noise.

The full set of releases can be seen here.

To get started with the MIMIRO data hub check out the github repository readme and the user documentation. If you have questions about best practice and use of the data hub then please get in contact.