NOT FOR UNAUTHORIZED USE

7 Steps to Design,
Build, and Scale
an AI Product
March 21, 2019

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 READ FIRST: TO ALL VIEWERS OF THIS PRESENTATION

This presentation was created by Allie K. Miller for her appearance

at Agile India on March 21, 2019.

For a more complete version (including use cases and Q&A), a

video of the talk will be posted on YouTube by Agile India.

All information provided is created and owned by Allie Miller and

not her employers (current or past). Any unauthorized copying,

alteration, distribution, transmission, performance, display, or other

use of this material is prohibited.

To request authorization, please contact hello@alliekmiller.com.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 Allie K. Miller

@alliekmiller

Amazon*
IBM Watson

Wharton MBA
Dartmouth BA

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 Artificial Intelligence

Using a computer to perform human-level tasks.

Ex: visual recognition, speech recognition,

natural language processing, pattern recognition,

and language translation.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 Machine Learning

Computer sees millions of examples.

Computer makes model to map inputs to outputs.

Computer sees new input.

Computer provides output.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 Now we know
what AI is.

How do you build it?

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

7 steps

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

7 STEPS TO DESIGN,
BUILD, AND SCALE AI

Problem Scope Team Data

Test Optimize Scale

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 PROBLEM FIND PAINPOINT
The bigger the need,

the easier the sell-through.

OUTCOME
What is the quantitative

result you want?

MEET USERS
Speak to users, develop

personas, uncover goals.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 SCOPE TIMELINE
Is there a date you

must adhere to? Why?

RESOURCES
What are your team, fiscal,

or other constraints?

BUDGET
Minimum MVP budget?

Add a buffer.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 TEAM HIRE OR TEACH ML
1 MLE : 4 SWEs

DIVERSITY & BIAS

Age, gender, ethnicity, geo,

and more. Change your QA.

MULTI-FUNCTION
Involve eng, design, PM, mktg,

sales, legal, finance, execs,

and subject experts early.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 DATA UNIQUE PIPELINE
What source? Is it owned?

Low or high barrier to entry?

GOOD DATA
Source, clean, legal. Match

training and production

inputs. Who is annotating

and QA? Noise reduction.

MORE OF IT
Prepare for edge cases.
NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019
 HALFWAY
DONE!

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 UX AI DISCLOSURE
BONUS! Must users know it's AI

(Uber route vs doctor reco)?

INTERFACE
Are users involved?

Common UX: thumb up/down.

Less common options?

EXPLAINABILITY
A spectrum of clear to

creepy to overwhelming.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 TEST PROVE SMALL
Research competitors,

align your team.

SUCCESS METRICS
Both AI and non-AI.

Accuracy/training and

business painpoints.

MEASURE & ADAPT

Don't aim for perfection.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 OPTIMIZE FEEDBACK LOOP
Treat mistakes with care.

DATA LIFECYCLE
Data is value.

Keep a constant stream.

Can it be automated?

DON'T SILO IT
Integrate AI within

business workflow.

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

 SCALE EXPAND SMART
Bigger data set? More

cities? New features?

COMBINE TECH
Consider SW and HW

collab - IoT and edge.

CHECK IN
Every few months. Is it still

valuable? Can you improve

it? What's new in market?

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019

1 Problem: who are you helping, and why?

2 Scope: what are the constraints?

3 Team: who is the best to get it done?

4 Data: where is the fuel?

5 Test: how can we prove this will work?

6 Optimize: can we make it better?

7 Scale: can the project grow?

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019
Thank you.

@alliekmiller

NOT FOR UNAUTHORIZED USE | ALLIE. K. MILLER | MARCH 21, 2019