Redshift Tuning Tool - Query Data Summary

Redshift Tuning Tool is a lightweight option to get the critical query data set for query tuning and cluster optimization.

Origin of the Tuning Tool

The Redshift Tuning Tool was originally developed to support the performance of a large Redshift cluster. Despite adding nodes, cluster performance was constrained by various long running queries. We needed a solution for query optimization that could scale to our user base of 1000s. We developed a logic to identify slow operations in each query plan. The Tuning Tool pinpoints the specific SQL clause, such as joins or table scans, that are cause poor performing queries. The slowest lines from the query plan are presented to the user in the dataset, enabling them to effectively target the problem area for optimization, saving time on extensive trial and error.

Additionally, this data set gave us full visibly on the query activity on our cluster supporting all automated mechanisms such as user notification emails, job kill scripts, and Work Load Management design. Approximately $170k was paid in Data Engineering salary to develop this tool which is yours for $90/month.

Features

The Redshift Tuning Tool reads the query plan with code and identifies the longest running lines of SQL code from the query plan enabling you to quickly pinpoint areas for optimization to concentrate your efforts where they will have the greatest impact. Rather than wasting hours to identify the bottleneck in your queries use the Tuning Tool as your personal query optimization assistant.

It is a comprehensive data set for query activity on your Redshift cluster which provides you with thorough insights on performance at the Redshift Query ID level.

With this data at your disposal, your Data Engineering job has been made easier to:

• Optimize Queries
• Identify Problem Jobs
• Develop automated mechanisms, notifications, and kill scripts
• Set WLM Rules Appropriately
• Analyze Usage Patterns and Optimize Table DDLs
• Track Performance Metrics and Growth

For full details on what you get and how to use, view the Redshift Tuning Tool User Guide Wiki.

How to Access

Access the Redshift Tuning Tool data set through a Web UI. Connect your Redshift Cluster and download the results.

1.      The Redshift Tuning Tool is hosted here.

2.      Sing up with the same email you used for the Gumroad subscription.

3.      Connect to your Redshift cluster endpoint with a Redshift user name and password.

4.      Click Redshift Query Summary ‘Run’

5.      Download the results as a CSV file and/or publish the results to an S3 bucket of your choice.