Skip to main content

Computational Governance Platform Configuration

The Computational Governance Platform (CGP) configuration is stored in the application.conf file of the governance-core module. It contains all the values that are required in order to make it work properly.

A typical configuration file looks like the following one:

computational-governance-platform {
cue-config = {
cue-process-path = "cue"
}

events = {
events-backend-base-url = "http://localhost:7007/api/events"
}

notification = {
mode = "witboost"
enabled = true
url = "http://localhost:7007/api/notifications"
failure-event = "ScheduledPolicyFail"
new-policy-event = "NewPolicy"
new-metric-event = "NewMetric
secret = ""
}

previous-vs-current = {
previous-resource-reference = "original"
current-resource-reference = "current"
}

resource-types = [
{
name = "dataproduct"
configuration = {
resource-name = "id"
resource-filter = "version"
}
resolver-configuration = {
url = "http://localhost:8088/datamesh.provisioningcoordinator"
path = "v1/resolve"
}
}
]

platform-services = {
base-url = "http://localhost:7007"
http-secret = ""

environments = {
environments-path = "/api/environment"
environments-fetch-retries = 5
}
}

evaluation = {
enable-on-publish = true
}

database {
schema = "cgp"
driver = "org.postgresql.Driver"
url = "jdbc:postgresql://localhost:5432/postgres"
username = "postgres"
password = "password"
name = "provisioning_coordinator"
host = "localhost"
port = 5432
migrate-on-start = true
repair-on-start = false
thread-pool-size = 4
connection-timeout = 10 seconds
max-lifetime = 10 minutes
leak-detection-threshold = 10 seconds
}

cron-policies {
reload-on-start = true
}
}

Please note that all values that are critical from a security standpoint (e.g. db credentials) must be kept private and the related variables only referenced inside this file.

The following sections will describe each part of the configuration file shown above.

Cue configuration

The cue-config section contains all the information related to the cue policy execution.

Property NameTypeMeaning
cue-process-pathstringThe path where the cue executable is located.

Events configuration

The events section contains all configuration properties needed by the Computational Governance Platform to send events to the witboost events plugin.

Property NameTypeMeaning
enabledbooleanIf true enables the events generation from the Computational Governance Platform
events-backend-base-urlstringIt is the base URL of the events backend service that is installed on the witboost events plugin. This is a combination of the UI module base URL and '/api/events'
runtime-policy-failed-topicstringThe topic unique identifier where the runtime policy failed event will be published

Notification configuration

The notification section contains all the information related to the Backstage notification service. This is used to send notifications to users of a certain Backstage group that a new policy has been created or there has been some errors during the policy creation. This is a mandatory configuration that needs to be set. You can disable this functionality by putting the enabled field to false.

Property NameTypeMeaning
modestringIt is the service that will sent the notifications. For example "witboost"
enabledbooleanIf true enables the notification service
urlstringIt contains the url of the service to call in order to send the notification. If you are using the Witboost notification service this must contain a string in the form http(s)://{host}/api/notifications
failure-eventstringIt contains the name of the event to call in case of a failed policy creation
new-policy-eventstringIt contains the name of the event to call in case of a succeeded policy creation
new-metric-eventstringIt contains the name of the event to call in case of a succeeded metric creation
secretstringIt contains the authorization token to insert in the request. If you are using the Witboost notification service you can find this info in the app-config.yaml file of the UI project, under the path backend.auth.keys['secret']

Breaking change configuration

The breaking-change section is related to breaking change policies. It contains all the information about the references used when creating the aggregated descriptor to perform the comparison between the currently deployed version (if present) and the version you are trying to validate/deploy.

Property NameTypeMeaning
previous-resource-referencestringString that will be used as reference name to wrap the descriptor of the currently deployed version of the resource inside the aggregated descriptor.
current-resource-referencestringString that will be used as reference name to wrap the descriptor of the resource version you want to validate/deploy inside the aggregated descriptor.

Resource type configuration

note

The suggested way to register a new resource type is through a POST request to the /v1/computational-governance/resource-types CGP endpoint (refer to the API reference section of the documentation). A resource type defined by configuration will be loaded at startup and will overwrite any previously registered resource type with the same name

The resource-types section of the configuration is specified as an array of objects, each one containing the following fields:

Property NameTypeMeaning
namestringUnique resource type name and identifier.
display-namestringResource type display name. It defaults to name if not provided.
configurationobjectSubsection containing resource type settings.
resolver-configurationobjectSubsection containing the resolver configuration.

Configuration subsection

In order to work properly, you need to specify a resource type configuration in the configuration subsection. The resource type configuration requires the following fields:

Property NameTypeMeaning
resource-namestringField inside the resource descriptor that contains its unique identifier.
resource-display-namestringList of fields in the resource descriptor to be used to generate a display name.
resource-filterstringField inside the resource descriptor used to differentiate evaluation results for the same resource.
batch-sizestringMaximum number of resources requested to the perimeter resolver per request (page size).

Example:

    ...
name = "dataproduct"
configuration = {
resource-name = "id"
resource-filter = "version"
}
...

This example means that for the resource type called dataproduct you will use the field id of the resource content (e.g. the data product descriptor) as resource name, and since it could be not enough to uniquely identify the resource, you are using the field version of the resource content as resource filter.

Resolver configuration subsection

This section contains the information related to the resolver endpoint to contact to retrieve the resource data, specified as follows:

Property NameTypeMeaning
urlstringBase url of the service to contact to retrieve the resource data.
pathstringPath of the specific endpoint to contact to retrieve the resource data.

Platform services configuration

The platform-services section contains all the information related to the platform services.

Property NameTypeMeaning
base-urlstringBase url of the service to contact to retrieve the resource data. This must contain a string in the form http(s)://{host}
http-secretstringSecret used to authenticate the HTTP requests.
environmentsobjectSubsection containing the environments configuration.

Environments configuration subsection

The environments configuration section consist of an object containing the following fields:

Property NameTypeMeaning
environments-pathstringThe path to the endpoint that returns the list of environments.
environments-fetch-retriesintThe number of retries to fetch the environments with exponential backoff.

Environments will be pulled at cgp startup and will be used to evaluate policies against the resources.

Evaluation configuration

The evaluation configuration section consists of an object containing a boolean field called enable-on-publish. If the above field is true, whenever a user publish a policy (so the status of a policy changes from whatever to enabled), CGP runs an async evaluation for that policy against all the resources and all the environments. This is done in order to update the report (and related results) for that policy.

If enable-on-publish is false, it skips the evaluation phase on publish.

This configuration is optional since you can avoid insert it and obtain the default behaviour (always run the evaluation on publish).

Property NameTypeMeaning
enable-on-publishboolIf true it starts an evaluation when a policy is published.

Database configuration

The CGP needs to store persistent data inside a database. The database section of the configuration is required to specify all the information to successfully connect to the database instance:

Property NameDefaultTypeMeaning
schemacgpstringThe database schema name that will be used.
driverorg.postgresql.DriverstringThe driver used to access to the database.
url(none)stringThe url used to access to the database.
username(none)stringThe username used to access to the database.
password(none)stringThe password used to access to the database.
nameprovisioning_coordinatorstringThe database name to connect to.
host(none)stringThe host in which the database is deployed.
port5432intThe port used to locate the database.
migrate-on-starttrueboolIf true, the database will be initialized with the content of the migration file.
repair-on-startfalseboolIf true, it overwrites the current database structure with a new one.
thread-pool-size(none)intThe number of threads that can be reused.
connection-timeout(none)stringThe amount of time after which the connection will be closed.
max-lifetime(none)stringThe maximum possible lifetime of a connection in the pool.
leak-detection-threshold(none)stringThe amount of time that a connection can be out of the pool before a message is logged indicating a possible connection leak.

Cron policies configuration

The cron-policies section refers, as the name suggests, to the configuration related to cron policies. A cron policy is a particular type of runtime policy that has been scheduled to be executed with a given frequency, specified by a cron expression, associated to it.

Property NameTypeMeaning
reload-on-startboolIf true, at each start of the service, it will identify all the enabled and executable cron policies and schedule them based on their cron expression. Otherwise, the scheduler will only work with pre-existent cron policies, already scheduled before the last service start.