Building a Benchmarking Tool for Avahi + AWS Sales Teams

Building a Benchmarking Tool for Avahi + AWS Sales Teams

Building a Benchmarking Tool for Avahi + AWS Sales Teams

My role involved designing the end-to-end experience of the tool, creating flows for comparing text and image generations, translating technical metrics into clear visuals, and supporting live demos and client-facing conversations.

My role involved designing the end-to-end experience of the tool, creating flows for comparing text and image generations, translating technical metrics into clear visuals, and supporting live demos and client-facing conversations.

Role

Role

Role

Product Designer

Duration

Duration

Duration

6 months

CONTEXT

CONTEXT

Who is Avahi & what did I do?

Who is Avahi & what did I do?

Avahi Inc. is an AWS Premier Consulting Partner that helps enterprises adopt cloud, data, and AI solutions at scale. Their services span AWS migration, generative AI/ML, data & analytics, and cloud cost optimization, with a focus on security and compliance.

My role involved designing the end-to-end experience of the tool, creating flows for comparing text and image generations, translating technical metrics into clear visuals, and supporting live demos and client-facing conversations.

Enterprises exploring and comparing AI solutions faced three blockers.

Enterprises exploring and comparing AI solutions faced three blockers.

Crowded AI market

Crowded AI market

Clients were evaluating multiple providers at once, but had no clear way to compare them.

Modality complexity

Modality complexity

Some clients evaluated text outputs; others needed to compare image generations too.

High-stakes decisions

High-stakes decisions

Migrations required confidence in both performance and cost, not another opaque demo.

PROBLEM SPACE

PROBLEM SPACE

Demonstrating Gen AI and its value-add

Demonstrating Gen AI and its value-add

Avahi and AWS salespeople needed a tool that gave clients neutral, side-by-side comparisons across providers and modalities, so sales reps could build trust and accelerate adoption.

PREVIOUS RESEARCH

PREVIOUS RESEARCH

How might we showcase AWS Bedrock in a way that appeals to salespeople and clients?

How might we showcase AWS Bedrock in a way that appeals to salespeople and clients?

Research showed that sales reps needed to demo Bedrock with minimal steps, while clients wanted transparent criteria and evidence they could present internally.

Research showed that sales reps needed to demo Bedrock with minimal steps, while clients wanted transparent criteria and evidence they could present internally.

Research showed that sales reps needed to demo Bedrock with minimal steps, while clients wanted transparent criteria and evidence they could present internally.

My contribution: I owned the end-to-end evaluation flow, interaction model, prototyping, and design iteration with product, engineering, and sales stakeholders.

CLIENT NEEDS + METRICS

CLIENT NEEDS + METRICS

How do clients define value-add?

How do clients define value-add?

The most important questions were simple: How much will this cost? How fast will it run at scale? Those questions became the product’s two core metrics.

PROCESS

PROCESS

Exploring dual workflows

Exploring dual workflows

To move quickly toward an MVP, I ran unstructured participatory design sessions with stakeholders. We sketched workflows together, aligned priorities in real time, and validated concepts with the people closest to client needs.

first iteration

DESIGN + ITERATION

DESIGN + ITERATION

Single-Prompt Conversion

Single-Prompt Conversion

Observation: users found the first side-by-side flow overwhelming. Decision: collapse the experience into one guided form. Result: a clearer path from prompt to comparison.

Observation: users found the first side-by-side flow overwhelming. Decision: collapse the experience into one guided form. Result: a clearer path from prompt to comparison.

Observation: users found the first side-by-side flow overwhelming. Decision: collapse the experience into one guided form. Result: a clearer path from prompt to comparison.

DESIGN + ITERATION

DESIGN + ITERATION

Multi-Prompt Conversion

Multi-Prompt Conversion

I unified upload, processing, results, cost, latency, and report export into one consistent flow. This reduced interaction debt and made the comparison logic easier to explain during demos.

FINAL DESIGN

FINAL DESIGN

A faster, clearer demo experience.

A faster, clearer demo experience.

One guided flow: enter a prompt, choose models, compare results, review cost and latency, then export a report.

One guided flow: enter a prompt, choose models, compare results, review cost and latency, then export a report.

One guided flow: enter a prompt, choose models, compare results, review cost and latency, then export a report.

SOLUTION

SOLUTION

Where AI evaluation meets clarity

Where AI evaluation meets clarity

The final evaluator enabled enterprise clients and sales reps to compare providers across text and image generation, run single or bulk evaluations, understand cost and latency at a glance, and export boardroom-ready reports.

IMPACT

IMPACT

Backing sales conversations with hard data

Backing sales conversations with hard data

Observed in prototype evaluation and stakeholder review: sessions became shorter, cost and speed tradeoffs became easier to explain, and the team had a repeatable language for discussing model performance.

LESSONS LEARNED

LESSONS LEARNED

Question assumptions early.

Question assumptions early.

This project reinforced my ability to translate technical benchmarks into business-friendly UX, design for quick demos and enterprise workflows, and recognize when simplification matters more than additional UI polish. Next time, I would validate the metric hierarchy even earlier with real sales conversations.