Tell us of a problem with a product which bothers you.

● How would you use technology to solve the problem?

Propose more than one potential solution (max 3)
● Compare and choose the best solution for the problem
● How would you measure whether the chosen solution is
working?
● What might be the reason for this chosen solution to fail ?

Sankalp Jain
sankalp.jain10@iitg.ac.in
9957955977
v.nnd.2015.06
CONFIDENTIAL
 Online Education – It’s all good on the outside.

Overview: What’s inside?

Identifying
Breaking the smaller
Today doctorate, masters, bachelors even high school bigger picture problems and
into pieces. related
students, from third world countries to ivy league solutions.
Premise colleges, barely passing to straight A’s all type of
students are learning from resources available online. Analyzing the More on
What, Who, Why implementation,
and How of the feasibility and
solutions. scalability.

Online education is available in wrappings of different Establishing

selection
Product products like websites, mobile apps or school specific Choosing the
criterion and
right solution.
learning software. making the right
choice.

Identifying the
risks and
The road ahead. performance of
Despite all the opportunities it provides, online education selected solution
in real world.
has always possessed the problem of low completion
Problem rates. Students enroll with interest and excitement but Analyzing the
Preparing for
leave with boredom and lack of enthusiasm. situations in
what could go
which proposed
wrong.
solution can fail.

v.nnd.2015.06
CONFIDENTIAL
 End to End user experience in a single course

Sign Up and Attending the first Continuous Completing the Final Assessment
Enrollment lecture Evaluation course and Feedback

Problems at each stage (Student Perspective)

Course Selection Where to start? How to evaluate? Motivation to complete? Why take the exam?

• Ambiguity in course • Everybody doesn’t
content want to start from
• Too many similar beginning.
courses. • How to be specific as
per student needs?
• MCQ don’t provide
comprehensive
evaluation.
• How to change the
nature of online tests?
• Courses get • After learning, need to
monotonous in take final exam dies in
between. minds of students.
• Teach or • What is the apt award
solve/use/implement? to push students?

Proposed Solutions for highlighted problems

Personalized Short Real world

Course Answers driven
Structure Develop Model to based tests teaching Develop course
Use AI to interpret
calculate student section on
the submitted
interests and professional world,
answers and mark
progress to form a and use theories to
accordingly.
intuitive structure. solve and learn.

v.nnd.2015.06
CONFIDENTIAL
 Solution 1 : Personalized Course Structure.

Objective
• To provide a more specific and organized course
structure as per student’s knowledge and
requirement.

Solution
•Assess student’s knowledge based on basics of

Questions Repository
course in form of timed test.
•Use student’s performance in test to formulate a
specific course structure.
Enrollment Machine Course
Survey/Test Learning Model Structure
Impact
•For user – Improved learning and all knowledge
requirements getting fulfilled without unnecessary
content.
•For company – Increased customer participation. Model Predict and
Collect progress formulate
Data and course
Implementation interests structure
• Develop a machine learning model to analyze
student’s knowledge and interests based on test
and predict an apt course structure while adding or
removing content.

v.nnd.2015.06
CONFIDENTIAL
 Solution 2: Short Answers based tests.

• To provide more • Prepare subjective

comprehensive evaluation
and assess student’s
understanding of the topic
more thoroughly hence
providing better feedback.
questions that requires
general and thorough
understanding of the topic to
answer.
• Evaluate and mark the
submitted answer and
highlight student’s
knowledge in various areas.

Objective Solution

• For user – Now users just • Develop a deep learning

don’t have to complete the model to interpret the
test to proceed but the answer and map the
feedback from test provide similarity with correct
specific additional resources answer, hence highlighting
to learn. the areas of dissimilarity and
Match • For company – Increased providing additional
Read & Predict marks resources on those topics.
Collect submitted student satisfaction.
Interpret and areas of
Answers answers to
answers Improvement
correct answer

Impact Implementation

v.nnd.2015.06
CONFIDENTIAL
 Solution 3: Real World driven teaching.

Updates/Notifications
Professional
Technology Alerts / Facts
problems/Simulations

Raising excitement about

Hands on new technology Presenting historically unique
upcoming lectures and
prevalent in world today and day to day facts.
testimonials.

Objective Solution Impact Implementation

• To build and maintain interest of
enrolled students with
connecting things learned in
lectures to real world scenarios
and establish basic working
theories.
• New course section with real
world analogies and related
facts. Incorporate small
testimonials from professors
about new technologies and
opportunities in the course area.
• For user – Improved learning
experience and more interest
building activities with insight
into professional world.
• For company – Decreased drop-
out rate.
• Develop an notifications section
that sharpens user
understanding of today’s
problems and provides new
technology alert and interesting
facts about upcoming lectures.

v.nnd.2015.06
CONFIDENTIAL
 Choosing the best solution: Analyzing the metrics

Building
Capabilities
Research
and
Costs
resource
expansion
Marketing

No. of
User
enrolled
satisfaction
users

Activity
on site
Revenue
No. of
Competitive lectures
advantage viewed

v.nnd.2015.06
CONFIDENTIAL
 Choosing the best solution: Comparing the metrics

Criterion Personalized Course Short Answers based Real world driven

Structure Tests learning

No. of Enrolled Users

No. of lectures viewed
User satisfaction
Activity on site
Competitive advantage
Marketing
Building Capabilities

Research and resource

expansion
Total Score 8 -3 4

v.nnd.2015.06
CONFIDENTIAL
 Metrics for Solution-1 Performance measurement

Evaluating the Personalized course structure solution

Priority Level User Growth User Engagement User Drop Out

Top Priority Account creation per Avg. no. of lectures Weekly churn rate
week completed per week (User inactive)
No. of active users No. of users for each Average user
type of course lifetime.
structure per week
Medium Priority
% of users preferring No. of lecture No. of users leaving
alternate course completed per course in middle of course
structure structure per week. per week.
User Review & Feedback

Low Priority Website response Total content No. of users not

time (in hours) giving final exam

v.nnd.2015.06
CONFIDENTIAL
 Analyzing the situations causing Solution-1 to fail

•Users may boast about their skills in survey or

Users depict wrong go for most sought after fields.
interests
•Above would be resulting in improper learning.

•Course lectures may be such recorded that

adding or removing certain parts may not be
Course structure possible
indivisible
•Above would be resulting in incomplete
learning.

•Varying course structure would accompany

Incomprehensive
varying evaluations hence it is possible users
evaluation
are not tested properly.

•Breaking down content at various points or

Non-continuity in
adding new resources may result in non-
the new content
continuity in knowledge flow.

•Website when performing predictive analysis

Response time and could consume too much time.
Memory usage •Data collected from initial survey may occupy
too much space.

v.nnd.2015.06
CONFIDENTIAL