How Cloudflare analyzes >1m DNS queries per second

Wednesday 4.55PM-5.20PM

@ Swift Suite 2

Open Source Databases

25 minutes conference

Beginner

Tracks:
Developer, Business / Case Studies

Cloudflare operates multiple DNS services that handle over 100 billion queries per day for over 6 million internet properties. We collect and aggregate logs for these queries for customer analytics, DDoS attack analysis and ad-hoc debugging. Due to the scale at which we operate, we've had to be creative in our implementation. In this talk, I'll go into more detail on the architecture we use for log ingestion and insertion into a ClickHouse cluster, as well as how we aggregate the data over time for longevity. I'll also touch on the tools we use downstream of ClickHouse to visualize and analyze the data ad-hoc.


Speakers

Tom Arnfeld

Tom Arnfeld (Cloudflare)

Systems Engineer

Biography:


Slides



  Download Slides  

Percona Live

Stay Connected on:

Percona Live Conferences

The Percona Live Open Source Database Conferences are the premier event for the diverse and active open source database community, as well as businesses that develop and use open source database software.
 

Contact Us

For general information about the event/expo/conference, including registration, please contact us at:

  • info(@) percona.com
  • +1-888-401-3401
  • +1-919-948-2863
  • 8081 Arco Corporate Drive - Suite 330 - Raleigh, NC 27617, USA