Release Qualification Test

This dashboard shows results of release qualification pipeline

To view the monitor/alert definition, checkout PrometheusRule list

Test result for 1.7-dev-2020093017

Test Info
ProjectID ClusterName Branch/SHA/Tag PrometheusLink GrafanaLink
istio-testing release-qual-17 1.7-dev http://prom.release-qual-17.qualistio.org http://grafana.release-qual-17.qualistio.org

Monitor Status
Monitor Status UpdatedTime FiredTimes LastFiredTime Description
HTTP5xxRateHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 The HTTP 5xx errors rate higher than 0.05 in 5 mins
Ingress200RateLow ALERTING 2020-11-29 06:41:44.242041104 +0000 UTC 2103 2020-11-29T06:41:44.242041104Z The expected rate is 100 per ns, the limit is set based on 15ns
IstiodContainerCPUUsageHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 Isitod Container CPU usage is above 80%
IstiodContainerNotReady HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 1 container: discovery not running
IstiodMemoryUsageHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 Istiod Container Memory usage is above 80%
IstiodUnavailableReplica HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 Istiod unavailable replica > 0
IstiodxdsPushErrorsHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 istiod push error rate is higher than 0.05
IstiodxdsRejectHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 istiod rejects rate is higher than 0.05
LatencyHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 150 The workload request latency > 40s
ProxyContainerCPUUsageHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 Proxy Container CPU usage is above 80%
ProxyContainerMemoryUsageHigh HEALTHY 2020-11-29 06:41:44.242041104 +0000 UTC 0 Proxy Container Memory usage is above 80%

Test result for 1.8.0-alpha.3-2020110913

Test Info
ProjectID ClusterName Branch/SHA/Tag PrometheusLink GrafanaLink
istio-testing release-qual-18 1.8-rc.1 http://prom.release-qual-18.qualistio.org http://grafana.release-qual-18.qualistio.org

Monitor Status
Monitor Status UpdatedTime FiredTimes LastFiredTime Description
HTTP5xxRateHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 The HTTP 5xx errors rate higher than 0.05 in 5 mins
Ingress200RateLow HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 The expected rate is 100 per ns, the limit is set based on 15ns
IngressLatencyP99High PENDING 2020-11-29 06:33:25.394695401 +0000 UTC 1 The ingress latency P99 > 250ms
IngressMemoryUsageIncreaseRateHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Ingress proxy Memory Usage increases more than 200 Bytes/sec
IngressTrafficMissing HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 ingress gateway traffic missing, check client logs
IstiodContainerCPUUsageHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Isitod Container CPU usage is above 80%
IstiodContainerNotReady HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 container: discovery not running
IstiodMemoryUsageHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Istiod Container Memory usage is above 80%
IstiodMemoryUsageIncreaseRateHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Istiod Container Memory usage increases more than 1k Bytes/sec
IstiodUnavailableReplica HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Istiod unavailable replica > 0
IstiodxdsPushErrorsHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 istiod push error rate is higher than 0.05
IstiodxdsRejectHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 istiod rejects rate is higher than 0.05
ProxyContainerCPUUsageHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Proxy Container CPU usage is above 80%
ProxyContainerMemoryUsageHigh HEALTHY 2020-11-29 06:33:25.394695401 +0000 UTC 0 Proxy Container Memory usage is above 80%
WorkloadLatencyP99High PENDING 2020-11-29 06:33:25.394695401 +0000 UTC 0 The workload request latency P99 > 160ms

Test result for master-20200921

Test Info
ProjectID ClusterName Branch/SHA/Tag PrometheusLink GrafanaLink
istio-testing release-qual master-2 http://prom. http://grafana.

Monitor Status
Monitor Status UpdatedTime FiredTimes LastFiredTime Description
HTTP5xxRateHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 The HTTP 5xx errors rate higher than 0.05 in 5 mins
Ingress200RateLow ALERTING 2020-11-29 06:37:33.799070649 +0000 UTC 738 2020-11-29T06:37:33.799070649Z The expected rate is 100 per ns, the limit is set based on 15ns
IstiodContainerCPUUsageHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 Isitod Container CPU usage is above 80%
IstiodContainerNotReady HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 container: discovery not running
IstiodMemoryUsageHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 Istiod Container Memory usage is above 80%
IstiodUnavailableReplica HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 Istiod unavailable replica > 0
IstiodxdsPushErrorsHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 istiod push error rate is higher than 0.05
IstiodxdsRejectHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 istiod rejects rate is higher than 0.05
LatencyHigh PENDING 2020-11-29 06:37:33.799070649 +0000 UTC 0 The workload request latency > 30s
ProxyContainerCPUUsageHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 Proxy Container CPU usage is above 80%
ProxyContainerMemoryUsageHigh HEALTHY 2020-11-29 06:37:33.799070649 +0000 UTC 0 Proxy Container Memory usage is above 80%