Topic Integrator Open Metadata Integration Service (OMIS)

The Topic Integrator OMIS supports the exchange of topic-based assets and the open metadata ecosystem. Typically these topics are managed by an event broker such as Apache Kafka.

It supports a type of integration connector that are able to create Topic assets along with descriptions of the structures of events that pass through the topic. Optionally, this metadata can be tied to an EventBroker.

Figure 1 shows the types of metadata that integrators connectors can create with this integration service.

Figure 1

Figure 1: Topic metadata supported by the Topic Integrator OMIS

The structure of an event is called an EventType. The details of this structure such as the data fields in the event are described using SchemaAttributes and SchemaTypes.

Figure 2 shows the open metadata types used to represent the metadata created through this service.

Figure 2

Figure 2: Topic open metadata types supported by the Topic Integrator OMIS

If an EventBroker is defined, any topic created is automatically linked to it using the ServerAssetUse relationship. When an event type is created for the topic, the service automatically inserts the AssetSchemaType relationship, EventTypeList entity and SchemaTypeOption relationship in between the topic and the event type.

Any schema attributes created through this interface will use the EventSchemaAttribute subtype to allow for find requests that only return schema information for events. The schema attributes also use the TypeEmbeddedAttribute classification method for defining the schema type.

Module Implementation

The modules are as follows:

This integration service is paired with the Data Manager Open Metadata Access Service (OMAS).

Return to the Integration Services

License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.