Building the Presto Open Source Community – Ahana Round Table
In this round table moderated by Eric Kavanagh of The Bloor Group, panelists from Uber, Facebook, Ahana, and Alibaba will discuss all aspects of building a thriving open source community around PrestoDB including why Presto is so popular & the problems it solves, the open source model the foundation follows, why governance and transparency are so important to an open source community, and what the community looks for in open source projects.
Presto on Kafka at Scale – Yang Yang & Yupeng Fu, Uber
Presto is a popular distributed SQL query engine for running interactive analytic queries. Presto provides a Connector API that allows plugins to dozens of data sources, and thus positions itself as a single point of access to a wide variety of data. At Uber, we significantly improved Presto’s Kafka connector to meet Uber’s scale. For example, the new connector allows dynamic Kafka cluster and topic discovery so users can directly query existing Kafka topics without any registration and onboarding process; dynamic schema discovery allows fetching the latest schema without any Presto restart or deployment; smart time range suggestions to users based on Kafka metadata analysis to avoid large-range scans and thus keep the query interactive.
Petabyte Scale Log Analysis at Alibaba: Infrastructure, Challenge and Optimization – Yunlei Ma
Yunlei will share the infrastructure for petabytes scale log data collection, storage and analysis at Alibaba . Presto plays a key role in the infrastructure. Presto processes over hundreds of billions of query, about over 1 quadrillion rows every day .