Healthchecks for vRealize Automation 7.x
Updated: Jun 11, 2020
List of health URL's which can be used during vRealize Automation troubleshooting
Horizon System Health
URL:
https://<<vra-va-fqdn>/SAAS/API/1.0/REST/system/health RESULT:
{"AnalyticsUrl":"http://localhost:8080","EhCacheClusterPeers":"","AuditPollInterval":"1000","EncryptionServiceVersion":"unknown","AnalyticsConnectionOk":"true","EncryptionServiceVerified":"Master Keystore verified","FederationBrokerStatus":"ok","ServiceReadOnlyMode":"false","AuditWorkerThreadAlive":"true","BuildVersion":"3.1.0.0 Build 12694081","AuditQueueSize":"0","DatabaseStatus":"connection successful","HostName":"sevenvra.prem.com","EncryptionStatus":"connected","FederationBrokerOk":"true","EncryptionConnectionOk":"true","EncryptionServiceImpl":"Encryption Service DB","ClusterId":"add760d8-b9cd-453d-a476-abf323758b59","EhCacheClusterDiagnostics":"","DatabaseConnectionOk":"true","StatusDate":"2020-06-11 14:19:14 UTC","ClockSyncOk":"true","MaintenanceMode":"false","MessagingConnectionOk":"true","fipsModeEnabled":"false","ServiceVersion":"3.1.0","IpAddress":"10.109.46.59","AuditDisabled":"false","AllOk":"true"}As shown above, the "AllOk" tag should be true
Horizon Cluster Instances
URL:
https://<<vra-va-fqdn>>/API/1.0/REST/system/clusterInstances
RESULT:
[{"version":"3.1.0.0 Build 12694081","uuid":"5d22e506-0529-3111-b8ca-beb20b620da8","status":"Active","lastUpdated":1591885520764,"hostname":"sevenvra.prem.com","datacenterId":0,"ipaddress":"10.109.46.59"}]ElasticSearch Health
URL:
ssh to vRA appliance and then execute
curl -kv http://localhost:9200/_cluster/health?pretty=trueRESULT:
{
"cluster_name" : "horizon",
"status" : "green",
"timed_out" : false,
"number_of_nodes" : 1,
"number_of_data_nodes" : 1,
"active_primary_shards" : 15,
"active_shards" : 15,
"relocating_shards" : 0,
"initializing_shards" : 0,
"unassigned_shards" : 0,
"delayed_unassigned_shards" : 0,
"number_of_pending_tasks" : 0,
"number_of_in_flight_fetch" : 0
}vRA Service status
URL:
https://va-fqdn/vcac/services/api/statusRESULT:
<serviceRegistryStatus>
<initialized>true</initialized>
<serviceInitializationStatus>REGISTERED</serviceInitializationStatus>
<serviceName>shell-ui-app</serviceName>
<solutionUser>cafe-7efxBfzyew</solutionUser>
<startedTime>2020-05-28T01:34:51.230Z</startedTime>
<serviceRegistrationId>d823b6f9-688e-4819-acf7-e773060a1e64</serviceRegistrationId>
<sslCertificateInfo> <identityCertificateExists>true</identityCertificateExists> <issuerName>CN=sevenvra.prem.com,OU=PREM,O=PREM,C=SG</issuerName> <notValidAfter>2025-04-27T08:16:10Z</notValidAfter> <notValidBefore>2020-04-28T08:16:10Z</notValidBefore> <principalName>CN=sevenvra.prem.com,OU=PREM,O=PREM,C=SG</principalName> <thumbprint>8E:68:E8:F0:EE:BC:12:2B:2D:78:89:C5:F9:37:5E:7C:25:38:C0:32</thumbprint>
</sslCertificateInfo>
</serviceRegistryStatus>
vRA Component Registry
URL:
https://vra-fqdn/component-registry/services/status/current?limit=200RESULT:
One would information on all services in the vRA appliance. As shown below
notAvailable should always be false and serviceInitializationStatus should be REGISTERED
<serviceStatus serviceId="ca11071c-f0aa-4407-bcc9-980102c2a239" serviceName="composition-service" serviceTypeId="com.vmware.csp.component.cafe.composition" notAvailable="false" unregisterDenied="true">
<lastUpdated>2020-05-28T01:39:25.430Z</lastUpdated> <statusEndPointUrl>https://sevenvra.prem.com/composition-service/api/status</statusEndPointUrl> <serviceStatus> <initialized>true</initialized> <serviceInitializationStatus>REGISTERED</serviceInitializationStatus>
<serviceName>composition-service</serviceName> <solutionUser>cafe-7efxBfzyew</solutionUser> <startedTime>2020-05-28T01:39:29.284Z</startedTime> <defaultServiceEndpointType>com.vmware.csp.component.cafe.composition.api</defaultServiceEndpointType> <serviceRegistrationId>ca11071c-f0aa-4407-bcc9-980102c2a239</serviceRegistrationId> <sslCertificateInfo>
<identityCertificateExists>true</identityCertificateExists> <issuerName>CN=sevenvra.prem.com,OU=PREM,O=PREM,C=SG</issuerName> <notValidAfter>2025-04-27T08:16:10Z</notValidAfter> <notValidBefore>2020-04-28T08:16:10Z</notValidBefore> <principalName>CN=sevenvra.prem.com,OU=PREM,O=PREM,C=SG</principalName> <thumbprint>8E:68:E8:F0:EE:BC:12:2B:2D:78:89:C5:F9:37:5E:7C:25:38:C0:32</thumbprint> </sslCertificateInfo> </serviceStatus>
</serviceStatus>
Another way to check is from VAMI as shown below
Also through ssh by executing the command
CURL Command
curl --insecure -f -s -H "Content-Type: application/json" "https://$HOSTNAME/component-registry/services/status/current?limit=200" | sed "s/}/\n/g" | grep -E -o ".serviceName.*serviceInitializationStatus.[^,]*" | sed "s/\"serviceTypeId.*,//g" | sed -e "s/\"//g" -e "s/:/=/g" -e "s/,/, /" | sed -e "s/serviceName\|serviceInitializationStatus\|=\|,\|null//g" | column -t | sort | cat -n[master] sevenvra:~ # curl --insecure -f -s -H "Content-Type: application/json" "https://$HOSTNAME/component-registry/services/status/current?limit=200" | sed "s/}/\n/g" | grep -E -o ".serviceName.*serviceInitializationStatus.[^,]*" | sed "s/\"serviceTypeId.*,//g" | sed -e "s/\"//g" -e "s/:/=/g" -e "s/,/, /" | sed -e "s/serviceName\|serviceInitializationStatus\|=\|,\|null//g" | column -t | sort | cat -n
1 advanced-designer-service REGISTERED
2 approval-service REGISTERED
3 authentication REGISTERED
4 authorization REGISTERED
5 branding-service REGISTERED
6 catalog-service REGISTERED
7 component-registry REGISTERED
8 composition-service REGISTERED
9 config-management-service REGISTERED
10 console-proxy-service REGISTERED
11 container-service REGISTERED
12 content-management REGISTERED
13 endpoint-configuration-service REGISTERED
14 event-broker-service REGISTERED
15 eventlog-service REGISTERED
16 fabric-service REGISTERED
17 forms-service REGISTERED
18 healthbroker-proxy-server REGISTERED
19 iaas-proxy-provider REGISTERED
20 iaas-service REGISTERED
21 identity REGISTERED
22 ipam-service REGISTERED
23 licensing-service REGISTERED
24 management-service REGISTERED
25 network-service REGISTERED
26 notification-service REGISTERED
27 o11n-gateway-service REGISTERED
28 placement-service REGISTERED
29 plugin-service REGISTERED
30 portal-service REGISTERED
31 properties-service REGISTERED
32 provisioning-service REGISTERED
33 reservation-service REGISTERED
34 shell-ui-app REGISTERED
35 software-se