comment-questionHow does it work?

What is the Query Optimizer and how does it work?

  • The Query Optimizer is a layer that sits between BigQuery and Looker (or any other client like python or java) connecting to the BigQuery APIarrow-up-right. This can be tested and validated by changing the API host i.e in the BigQuery Python Clientarrow-up-right.

  • The proxy implements all functionality of the BigQuery API, in fact it passes most API calls forward and only interacts with SQL payloads.

  • At the moment, the proxy is focused on optimizing analytical workloads (i.e SELECT statements), but there is also a roadmap for it to be further developed to optimize data pipelines (dbt, airflow etc).

Last updated