One of our API-first brethren in San Francisco recently shared with us how they built their synthetic testing system to monitor uptime and latency. It was a large undertaking involving a huge Redshift warehouse, Datadog and many man months of engineering effort. At the end of it, they could measure latency’s completeness, whether it was functionally correct and, when it moved out of bounds, alert CSM/engineering teams.