Building Large-scale Query Operators and Window Functions for Prestissimo using Velox – Aditi Pandit
In this talk, Aditi Pandit, Principal Software Engineer at Ahana and Presto/Velox contributor, will throw the covers back on some of the most interesting portions of working in Prestissimo and Velox. The talk will be based on the experience of implementing the windowing functions in Velox. It will cover the nitty gritty on the vectorized operator, memory management and spilling. This talk is perfect for anyone who is using Presto in production and wants to understand more about the internals, or someone who is new to Presto and is looking for a deep technical understanding of the architecture.
How to Get the Most from Presto by Connecting to OpenMetadata – Suresh Srinivas & Sriharsha Chinatalapani, Collate
PrestoDB is a fast and efficient software that can change the way teams access their data. OpenMetadata is a metadata management software that is here to change the data pipeline space. Together they can take your data, metadata and the entire company data culture to the next level. In this talk, Suresh and Sriharsha will show you how to connect your Presto database, ingest its metadata and get your data right. Use your company’s data to its full potential with OpenMetadata’s unified solution with data cataloging, discoverability, quality, lineage, operations, and collaboration all in one central UI. OpenMetadata’s philosophies: 1. Building Metadata Standards with a Schema and API first approach 2. Automation with bots abstraction for automating mundane tasks – quality, data deletion, tag propagation. 3. Top-Notch UX to enable everybody in the company to unlock the value of data.
Prestissimo – Presto-on-Velox for Faster More Efficient Queries – Orri Erling, Meta
We built a drop-in replacement for the Presto worker using C++ and Velox and saw a dramatic improvements in CPU efficiency and latency for interactive queries. We embraced adaptive execution provided by Velox to efficiently evaluate filters pushed down into scan and automatically enable array-based aggregations and joins. We make extensive use of dictionary encodings to achieve zero-copy execution throughout the engine. We allow for vectorization friendly function implementations, provide ASCII-only fast paths and many other tricks. We’d like to share our learnings, early results and future plans. We are looking forward to invite the community to join our efforts in building the next generation of Presto together.