Developer Platform Functional Detail

Egeria’s Developer Platform contains the core Egeria implementation and provides support for:

• Integrating third party technology into the open metadata ecosystem;
• Extending Egeria to run in different environments or to use different infrastructure services.

Below is a summary of the capabilities it includes. These capabilities support the Integration Platform and the Governance Solutions. Its use is described in the Developer’s Guide.

Access Services

The Access Services provide specialist APIs/Events for different types of tools. They work with the pre-defined open metadata types described below and use the repository services to access metadata.

There are access services for data catalogs and curation tools; glossary tools; data platforms and engines; data science/AI workbenches, Business Intelligence (BI) and reporting platforms; dev-ops pipelines and tools; digital service management; software development tools, governance, privacy and security tools; design modeling tools, IT infrastructure management, automated metadata discovery tools, stewardship and workflow tools.

The access services run in the following types of cohort members: Metadata Access Point, Metadata Server and Repository Proxy.

Governance Services

The governance services provide support for automatic exchange of metadata with third party tools as well as supporting metadata management for governance solutions. The governance services each form the principle subsystem of a governance server.

View Services

The view services provide the services used by UIs. They are typically fine-grained services and they run in the view server.

Open Metadata Types

The open metadata types provide common definitions for the different types of metadata needed by an organization. The open metadata type system is extendable. However, by providing a comprehensive starter set, and encouraging tools to use them, then Egeria ensures metadata can be seamlessly shared amongst them.

The predefined types are organized as follows: IT Infrastructure (Area 0); Collaboration (Area 1); Assets (Area 2); Glossary (Area 3); Governance (Area 4); Schemas, Reference Data, Models (Area 5); Automatic Metadata Discovery (Area 6); Lineage (Area 7).

Repository Services

The Open Metadata Repository Services (OMRS) provide the basic ability to share metadata between metadata repositories. The metadata repositories are organized into open metadata repository cohorts. These cohorts define the scope of the metadata sharing. There are two complementary mechanisms that are operating together to ensure metadata is available to all consumers in the cohort. The first is the ability for any member of a cohort to issue a federated query that includes all other members of the cohort. There is also optional metadata replication occurring across the cohort allowing a repository to selectively cache metadata from other members.

The repository services implementation includes the Type Definitions and Instance Structures that are used to support the open metadata types described above; Event Payloads for the asynchronous exchange of metadata between repositories in a cohort; Repository connector APIs to allow third party tools to “plug in” to open metadata and repository implementations to expand the metadata storage capability; Cohort Registration and Membership that broadcasts details of new members to automatically configure the repository services in other members of the cohort; Federated queries through the enterprise repository services; a Repository Conformance Workbench to test the ability of a cohort member to operate correctly in the cohort; Open Metadata Archives for managing metadata import/export as well as content packs of standard definitions; Audit Log Implementation with routing to multiple destinations as needed by the operations teams.

OMAG Server Platform

The Open Metadata and Governance (OMAG) Server Platform provides a multi-tenant runtime platform for OMAG Servers. Each OMAG Server hosts the connectors along with the Egeria services to integrate third party technology.

Specifically the OMAG Server Platform provides support for the configuration document store connector and the connector that is responsible for authorization of platform services requests; Platform Services; Multi-tenancy; Metadata Security; Administration Services for configuring and operating the OMAG Platform and Servers.

Open Metadata Frameworks for plug-in components

The open metadata frameworks define the interfaces implemented by components that “plug-in” to Egeria, either to integrate calls to third party technology or extend the function of Egeria. The frameworks are as follows:

• Open Connector Framework (OCF) - base framework for all types of plug-in components called connectors.
• Open Discovery Framework (ODF) - specialized connectors called discovery services that support automated metadata discovery,
• Governance Action Framework (GAF) -
• Audit Log Framework (ALF) - extensions for all types of connectors to enable natural language diagnostics such as exceptions and audit log messages.

Return to Status Overview

License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.