<JB />
Joshua BusseyProduct Designer
LinkedIn
Work/Security Data Lake

Security Data Lake.

A net-new product letting customers query everything their integrations capture. Zero-to-one from research through GA.

Project metadata
Client
Red CanaryRed Canary
Role
Lead Product Designer
Team
2 PM · 6 Eng · 1 Designer
Shipped
Q3 2024
Type
0→1Innovate
Result
GA in 9 months

Friction

Pain points for the customer
  • Customer data was not retained in an accessible way for long enough.
  • Customers could only see data when it was attached to a security threat, not on their own terms.

My Role

What I owned during the process
  • Led UX strategy and design in close partnership with product and engineering.
  • Defined the workflows for monitoring, exporting, and querying data lake content.

Outcome

What I shipped
  • Shipped SDL on time with especially strong praise from enterprise customers.
  • Reduced compliance-driven churn risk.
  • Won positive feedback and new contracts once the search experience launched.
The TL;DR.

Summary

We built the Security Data Lake (SDL), a new feature enabling customers to query their Red Canary data in real time. It solved compliance pain, elevated customer satisfaction, and gave users far more transparency and control over the data they were already sending into the platform.

Customers sent the data. They just couldn't use it.

The Problem

Customers had very little visibility into the huge volume of data flowing into Red Canary. Outside of detections, they had no simple way to inspect, query, or report on what was already theirs.

That gap created compliance headaches for regulated customers and blocked deeper investigations for security teams that needed more than the default product views.

Key Decision
"How do we handle search quotas?"
When customers can query data measured in terabytes, one careless search can burn through a usage limit quickly. We needed a control that informed without getting in the way.
The Decision
Make query cost visible.
Show customers how much data a search will consume before they run it, instead of letting quota risk stay invisible until it is too late.
Click to unlock →
Visibility first. Query power second.

The Solution

SDL was intentionally phased so the team could solve compliance and reporting pain early, then layer in deeper search capability without blocking the whole initiative.

Usage dashboard first

The first release focused on a dashboard with at-a-glance usage, integration-level breakdowns, historical trends, and export support for compliance work.

Familiar SQL workflow

For the query tool, I leaned on patterns customers already understood so the product felt powerful without forcing them to learn a bespoke interface.

Warn on big queries

Searches exposed their expected cost before execution so customers could avoid blowing through query limits by accident.

Two months. A phased MVP.

The Process

Exploration

Exploration

Low-fidelity wireframes mapped the core layout and key interactions before any visual decisions were locked in.

Step 01

Identify the real customer need

Support tickets and recurring feedback made it obvious that customers needed direct control over their own data, not just another preset dashboard.

Step 02

Define the MVP phases

We prioritized a high-impact snapshot dashboard first, then followed with the SQL query tool for deeper investigation and more technical workflows.

Step 03

Design and test quickly

I worked closely with engineering to validate feasibility and tested prototypes with early adopters so we could refine usability before wider release.

Shipped

The final experience, tested with customers and validated through iteration.

What worked. What got tricky.

Reflection

Tough spots
  • The search experience required a lot of net-new design patterns in a short window.

  • Quota management had to be obvious without making the tool feel intimidating.

  • Chart choices mattered more than expected because the wrong visual could communicate the wrong message fast.

What went right
  • The team managed a changing scope well enough to still ship on time.

  • Data Lake Search received immediate positive feedback and helped win additional business.

  • Leaning on familiar query-tool patterns made the advanced workflow easier to adopt.