Area 6 Models - Metadata Discovery

Area 6 provides structures for recording the results of automated metadata discovery as annotations to associated assets in the metadata repository.

Metadata discovery requires different types of analysis. This analysis may run just once, say when the asset is created, on demand or based on an event or schedule.

A particular type of analysis is implemented in a discovery service. Within the discovery service are one to many discovery steps. Each step performs some sort of analysis that may result in an annotation for one or more assets.

The annotations from a particular run of a discovery service are grouped together into a discovery analysis report. The annotations may be reviewed and approved by a steward. The steward may convert the annotation to a harden metadata type, or they may flag the annotation as invalid. When the discovery service is rerun, the new annotations can be matched to the annotations from the previous run. The steward’s actions will impact how the new annotations are processed.

• 0601 Open Discovery Engines
• 0602 Open Discovery Services
• 0603 Open Discovery Pipelines
• 0604 Asset Discovery Services
• 0605 Discovery Analysis Report
• 0610 Annotation
• 0611 Annotation Reviews
• 0615 Schema Extraction
• 0617 Data Field Analysis
• 0620 Data Profiling
• 0625 Data Class Discovery
• 0630 Semantic Discovery
• 0635 Classification Discovery
• 0640 Quality Scores
• 0650 Relationship Discovery
• 0655 Asset Deduplication
• 0660 Measurements
• 0690 Request for Action

Egeria’s Open Discovery Framework (ODF) that supports the development and execution of discovery services. The ODF runs in an open metadata discovery server. ODF discovery services use connectors from the Open Connector Framework (OCF) to connect to the data assets and access the known metadata about them.

Return to Overview.

License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.