Building the Presto Open Source Community – Ahana Round Table
In this round table moderated by Eric Kavanagh of The Bloor Group, panelists from Uber, Facebook, Ahana, and Alibaba will discuss all aspects of building a thriving open source community around PrestoDB including why Presto is so popular & the problems it solves, the open source model the foundation follows, why governance and transparency are so important to an open source community, and what the community looks for in open source projects.
Disaggregated Coordinator Production Rollout – Swapnil Tailor, Meta
We would like to talk about disaggregated coordinator production rollout with some stats. Also we can inform community about changes needed to support deployment of disaggregated coordinator.
Disaggregated Coordinator – Swapnil Tailor, Facebook
In the existing Presto architecture, single coordinator has become a bottleneck in a number of ways for cluster scalability. – With an increasing number of workers, the coordinator has the potential of slow down due to a high number of tasks. – In high QPS use cases, we have found workers can become starved of splits by excessive CPU being spend on task updates in coordinator. – Also with single coordinator, we have an upper limit on the worker pool because of above-mentioned reasons. To overcome with this challenges, we are coming up with a new architecture which supports multiple coordinators in a single cluster.
Petabyte Scale Log Analysis at Alibaba: Infrastructure, Challenge and Optimization – Yunlei Ma
Yunlei will share the infrastructure for petabytes scale log data collection, storage and analysis at Alibaba . Presto plays a key role in the infrastructure. Presto processes over hundreds of billions of query, about over 1 quadrillion rows every day .