Elevating Presto Query Optimization: Leveraging State-of-the-Art Techniques for Improved Performance 

Elevating Presto Query Optimization: Leveraging State-of-the-Art Techniques for Improved Performance 

By , , , ,  & 

Presto, a prominent open-source distributed SQL query engine, has been at the leading edge of high-performance data analytics for over a decade. In analytical data processing, the effectiveness of query optimization is paramount. Over the last half-century, optimizing SQL queries has been a hotbed of research and development, resulting in groundbreaking innovations. This blog post…

5 design choices—and 1 weird trick — to get 2x efficiency gains in Presto repartitioning

By , , , ,  & 

We like Presto. We like it a lot — so much we want to make it better in every way. Here’s an example: we just optimized the PartitionedOutputOperator. It’s now 2-3x more CPU efficient, which, when measured against Facebook’s production workload, translates to 6% gains overall. That’s huge. The optimized repartitioning is in use on…