Up alert thresholds logs_elasticsearch disk time
Up alert thresholds logs_elasticsearch disk time

Raise the alert thresholds for disk time on logs_elasticsearch machines.

The increase, seen since April, looks like normal behaviour. We may be
seeing increased disk time because of changes made to the underlying
storage on the IaaS platform, or because we've seen a significant
increase in traffic since January, which would explain an increase in
web server logs generated and our logging infrastructure was partially
broken from mid January until the end of March.

https://graphite.production.alphagov.co.uk/render?from=09%3A00_20140824&until=17%3A00_20150624&width=1200&height=800&target=movingMedian(sum(logs-elasticsearch-1_management_production.disk-sd%3F.disk_time.*)%2C30)&target=alias(dashed(constantLine(100))%2C%22warning%22)&target=alias(dashed(constantLine(200))%2C%22critical%22)&_uniq=0.9659334965981543
https://graphite.production.alphagov.co.uk/render?from=09%3A00_20140824&until=17%3A00_20150624&width=1200&height=800&target=movingMedian(sum(logs-elasticsearch-2_management_production.disk-sd%3F.disk_time.*)%2C30)&target=alias(dashed(constantLine(100))%2C%22warning%22)&target=alias(dashed(constantLine(200))%2C%22critical%22)&_uniq=0.9659334965981543
https://graphite.production.alphagov.co.uk/render?from=09%3A00_20140824&until=17%3A00_20150624&width=1200&height=800&target=movingMedian(sum(logs-elasticsearch-3_management_production.disk-sd%3F.disk_time.*)%2C30)&target=alias(dashed(constantLine(100))%2C%22warning%22)&target=alias(dashed(constantLine(200))%2C%22critical%22)&_uniq=0.9659334965981543

alphagov/govuk-puppet,alphagov/govuk-puppet,alphagov/govuk-puppet,alphagov/govuk-puppet,alphagov/govuk-puppet,alphagov/govuk-puppet