Checkly

Rationale

Checkly  is our monitoring-as-code (MAC ) tool for check-based tracking across our products. As a pivotal part of our continuous monitoring strategy, Checkly  allows us to define and manage periodical testing for each one of our components to be aware of its state every time.

The main reasons why we chose it over other alternatives are:

• It provides a global network of testing locations , allowing you to simulate user interactions from various geographical locations.
• It supports real browser checks , allowing you to test our web applications in a way that closely mimics user interactions.
• All the monitoring setup and tests can be configured and managed using Terraform .
• It provides dedicated API testing .
• It brings detailed metrics and insights into the performance of our products, helping to identify trends and areas for improvement.
• It provides a public dashboard  that showcases our component’s health and performance metrics. This feature is valuable for enhancing transparency and communication.
• It brings various possibilities for integrations , allowing us to connect different elements of the stack to keep track of failures, inform customers about the state of our components and bring fast solutions to any issue.
• Incorporates the option to implement a sophisticated retry strategy  to minimize false positives during monitoring.

Alternatives

The following alternatives were considered but not chosen for the following reasons:

• Atatus Synthetic Monitoring : It does not have the support to configure checks and tests with Terraform. Also, the checks are not very customizable and do not provide good support for integrations with other services or tools.
• BetterStack : It does not have checks that interact directly with the browser; it does not allow running the tests in multiple browsers or the option for running the checks in parallel.
• DataDog : Since the monitoring options do not provide greater value than Checkly , using this tool only for this purpose is more expensive than its alternatives.

Usage

We use Checkly  for:

• Set and run browser checks for our docs , platform , and website .
• Set and run API checks for our API  and the CI Gate .
• Set and manage check groups .
• Define retry strategies  to avoid false positive check failures.
• Generate automatic incidents  on our Statuspage  when a check fails.
• Set and display the public dashboard  of our component’s health.
• Notify the staff of any check failure through various channels .

We do not use Checkly  for:

• Heartbeats : This is a new Checkly feature, and it has yet to be tested by the team.
• Maintenance Window : Maintenance periods are not needed due to our deployment frequency and workflow.