Sunteți pe pagina 1din 27

The Journey to an AI led Agency

Karim BEGUIR, Co-Founder & CEO, InstaDeep

kb@instadeep.com
@kbeguir
AI Today
AI Today

AI = Reinforcement Learning + Deep Learning

David Silver (AlphaGos inventor) Google DeepMind


AI Today

(MIT Tech Review)

Both in MIT TR 10 Breakthrough Technologies (2017 and 2013)


Deep Learning: Pattern Recognition

(Deep Learning, Goodfellow, Bengio & Courville 2016)


Deep Learning: 3 reasons for success
Reinforcement Learning (RL)
AI Tomorrow
Learn to Learn: AI boosts Data

(Towards Automatic
Anime Characters
(Creative Adversarial Nets, Creation,
Elgammal & al. 2017) Jin & al. 2017)

Manga characters on demand


Passes Art Turing test:
Learn to Learn: AI boosts GPUs
Placement model learns
to allocate GPUs

(Device Placement Optimization with Reinforcement Learning, Mirhoseini & al. 2017)

19.7% faster than GPU experts for NLP and Vision tasks
Learn to Learn: AI for Deep Learning
AI builds its own competitive neural network:
(Neural Architecture
Search with Reinforcement
Learning,
Zoph & Le, 2017)

New state of the art results in Computer Vision


(CIFAR 10 dataset) and natural language tasks.
AI queries in the future:
Which of these eye
Describe this video
images shows symptoms
In Spanish
of diabetic retinopathy?

Find me documents related to


reinforcement learning for robotics
Please fetch me a cup of
and summarize them in German
tea from the kitchen

(Jeff Dean, Google Brain 2017)


Becoming an AI-led Agency
Step I: Cloud Based Solutions
Machine Learning in Google Cloud
Pre-trained ML models

Natural Vision API Speech Translation Jobs API Video


Language API API Intelligence API
API
Step II: Custom ML
Open, standard software for
general machine learning

Great for AI/Deep Learning


in particular

First released Nov 2015


http://tensorflow.org/ Version 1.3 released

Apache 2.0 license


Platforms TensorFlow supports:

CPU GPU
iOS Android

Raspberry
Pi
1st-gen TPU Cloud TPU
ML software Github Stars

(Jeff Dean, Google Brain 2017)


Step III: Hardware
TPU Pod
64 2nd-Gen TPUs
11.5 Pflops
4 TB RAM

2nd-Gen TPU:
180 Tflops 64 GB Ram
TensorFlow scales on GPUs too

(Jeff Dean, Google Brain 2017)


Step IV: Team set up and Learning
If you hire PhDs: one central AI team rather than scattered ones.

Raising awareness of developer teams: paying for the best AI MOOCs.

How to assess quality? Global AI/Data Science competitive rankings.


Step V: Data
AI

DATA
Example: Visual AI
How to quickly build
a visual AI tool?

1000s of products ?

No model ??

No data ???
Visual AI: Data Tricks
Take (or collect from the net) ~300 original pics for each product.

Each pic can generate 20 augmented pics (angle, blurriness,


background etc..). 300 -> 300*20 = 6,000 pics/product.
Visual AI: Model Tricks
Dont train from scratch. Use a trained model and transfer the learning.

(Inception V3 Model, Google Brain)

Keep low layers the same. Retrain top layers to classify your own labels
Can be done on the Google Cloud or on TensorFlow.
Real-time AI insights
Real-time now feasible:

TensorFlow-powered

Highly parallelized GPU or


Cloud TPU ML pipeline

Real+Augmented Data

Optimized Deep Learning

What are the next steps?


(Standard Cognition demo, Aug 2017)
2 Suggestions for Data:
Simulated/Synthetic Data: when real data is expensive or sensitive to get
(self-driving cars, personal medical files, etc)

Decentralized Data gathering with encryption and digital smart contracts:

You can train my AI model with your data, without you knowing my model or
me knowing your data Andrew Trask, OpenMined
Conclusion
The 5 steps to becoming an AI-led Agency all require patience, but are
accessible to anyone willing to learn.

Deep Learning is delivering results in speech, vision, NLP, healthcare etc.

Reinforcement Learning, and AI on AI tech are set to deliver massive


growth. This will increase the gap between AI-led companies and others.

THANK YOU FOR YOUR TIME

S-ar putea să vă placă și