Open Metadata Conformance Performance Workbench

The open metadata conformance performance workbench is responsible for testing the performance of various APIs supported by an Open Metadata and Governance (OMAG) Server Repository.

Note that the workbench is focused purely on measuring performance, and will not extensively test for correctness of results across a variety of edge cases, etc. For that, use the normal Repository Workbench.

This workbench runs the following profiles, in the following order:

  1. Entity Creation tests the performance of addEntity and saveEntityReferenceCopy methods
  2. Entity Search tests the performance of findEntities, findEntitiesByProperty and findEntitiesByPropertyValue methods
  3. Relationship Creation tests the performance of addRelationship and saveRelationshipReferenceCopy methods
  4. Relationship Search tests the performance of findRelationships, findRelationshipsByProperty and findRelationshipsByPropertyValue methods
  5. Entity Classification tests the performance of classifyEntity and saveClassificationReferenceCopy methods
  6. Classification Search tests the performance of findEntitiesByClassification method
  7. Entity Update tests the performance of updateEntityProperties method
  8. Relationship Update tests the performance of updateRelationshipProperties method
  9. Classification Update tests the performance of updateEntityClassification method
  10. Entity Undo tests the performance of undoEntityUpdate method
  11. Relationship Undo tests the performance of undoRelationshipUpdate method
  12. Entity Retrieval tests the performance of isEntityKnown, getEntitySummary and getEntityDetail methods
  13. Entity History Retrieval tests the performance of getEntityDetail (with non-null asOfTime) and getEntityDetailHistory methods
  14. Relationship Retrieval tests the performance of isRelationshipKnown and getRelationship methods
  15. Relationship History Retrieval tests the performance of getRelationship (with non-null asOfTime) and getRelationshipHistory methods
  16. Entity History Search tests the performance of the same search operations as Entity Search, but in each case with a non-null asOfTime
  17. Relationship History Search tests the performance of the same search operations as Relationship Search, but in each case with a non-null asOfTime
  18. Graph Queries tests the performance of getRelationshipsForEntity, getEntityNeighborhood, getRelatedEntities and getLinkingEntities methods
  19. Graph History Queries tests the performance of the same operations as Graph Queries, but in each case with a non-null asOfTime
  20. Entity Re-Home tests the performance of reHomeEntity method
  21. Relationship Re-Home tests the performance of reHomeRelationship method
  22. Entity Declassify tests the performance of declassifyEntity and purgeClassificationReferenceCopy methods
  23. Entity Re-Type tests the performance of reTypeEntity method
  24. Relationship Re-Type tests the performance of reTypeRelationship method
  25. Entity Re-Identify tests the performance of reIdentifyEntity method
  26. Relationship Re-Identify tests the performance of reIdentifyRelationship method
  27. Relationship Delete tests the performance of deleteRelationship method
  28. Entity Delete tests the performance of deleteEntity method
  29. Entity Restore tests the performance of restoreEntity method
  30. Relationship Restore tests the performance of restoreRelationship method
  31. Relationship Purge tests the performance of purgeRelationship and purgeRelationshipReferenceCopy methods
  32. Entity Purge tests the performance of purgeEntity and purgeEntityReferenceCopy methods
  33. Environment does not actually perform any tests, but rather gives statistics about the environment in which the tests were performed (instance counts, etc)

In each profile, the methods being tested will be executed a number of times and the elapsed time of each execution captured. These elapsed times are available through the detailed profile results of the Conformance Test Suite reports, and can be extracted to calculate more detailed statistics (min, max, median, mean, etc).

Configuration of the performance test can be done through the properties passed in to the admin services prior to executing it:


License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.