Extending Presto at LinkedIn with a Smart Catalog Layer LinkedIn

Extending Presto at LinkedIn with a Smart Catalog Layer LinkedIn

In this talk, Walaa describes how LinkedIn extended its Presto Hive Catalog with a smart logical abstraction layer that is capable of reasoning about logical views with UDFs by using two core components, Coral and Transport UDFs. Coral is a view virtualization library, powered by Apache Calcite, that represents views using their logical query plans. Walaa shows how LinkedIn leverages Coral abstractions to decouple view expression language from the execution engine, and hence execute non-Presto-SQL views inside Presto, and achieve on-the-fly query rewrite for data governance and query optimization.

Drag and Drop Query Builder for PrestoDB – Ravishankar Nair, PassionBytes

Drag and Drop Query Builder for PrestoDB – Ravishankar Nair, PassionBytes

You use multiple tools for databases, for example Azure Data Studio for SQLServer access, Toad or SQLDeveloper for Oracle access, MySQLWorkbench for MySQL databases. Imagine we have one tool and we can query any database, bring any table from any catalog to a single canvas! Now you join, the underlying PrestoDB compatible query is generated. Click a button, you get the profiled data, including distributions and correlations. An amazing tool in action.