Embracing Presto Open Source for Breakthrough Performance 

At IBM, we are passionate about pushing the boundaries of data processing capabilities. To that end, we’re excited to share our latest groundbreaking work towards Presto 2.0, the next-generation version of Presto that includes a robust native C++ worker. This initiative not only strengthens the project’s technological foundations but also reiterates our dedication to the…

Elevating Presto Query Optimization: Leveraging State-of-the-Art Techniques for Improved Performance 

Elevating Presto Query Optimization: Leveraging State-of-the-Art Techniques for Improved Performance 

Presto, a prominent open-source distributed SQL query engine, has been at the leading edge of high-performance data analytics for over a decade. In analytical data processing, the effectiveness of query optimization is paramount. Over the last half-century, optimizing SQL queries has been a hotbed of research and development, resulting in groundbreaking innovations. This blog post…

Avoid Data Silos in Presto in Meta: the journey from Raptor to RaptorX

Raptor is a Presto connector (presto-raptor) that is used to power some critical interactive query workloads in Meta (previously Facebook). Though referred to in the ICDE 2019 paper Presto: SQL on Everything, it remains somewhat mysterious to many Presto users because there is no available documentation for this feature. This article will shed some light…

RaptorX: Building a 10X Faster Presto

RaptorX is an internal project name aiming to boost query latency significantly beyond what vanilla Presto is capable of. This blog post introduces the hierarchical cache work, which is the key building block for RaptorX. With the support of the cache, we are able to boost query performance by 10X. This new architecture can beat…

Everything You Always Wanted To Do in Table Scan

Table scan, on the face of it, sounds trivial and boring. What’s there in just reading a long bunch of records from first to last? Aren’t indexing and other kinds of physical design more interesting? As data has gotten bigger, the columnar table scan has only gotten more prominent. The columnar scan is a fairly…