How to make a course adaptive (without really trying)

Student retention (preventing students from quitting or dropping out) is a major concern for online learning. So why do students drop out in the first place? One reason is a lack of engagement. Indeed, some of our friends over at edX previously found that students tend to stop watching lecture videos that go beyond 4 or 5 minutes.

Our team has already done an incredible job of making online lessons more engaging. In a previous post, we showed how we increased student attention span up to 20 minutes with our highly interactive lessons. So the engagement problem has largely been solved.

But while we've reduced dropout rates, a fair number of students still drop out of our interactive lessons. So we asked ourselves: what's going on here, and what we can do about it?

Now imagine you're working your way through a step-by-step, interactive lesson. You know what you're doing, getting every question right, but suddenly you hit a snag. You just can't seem to get this next question. Now you could ask for a hint, or you could try a few different approaches, but sometimes you'll just quit out of frustration.

With an in-person tutor, this wouldn't happen. A live tutor can diagnose exactly where you confusion is and help you get "unstuck." So our hypothesis is this: students drop out when they're told their answer is wrong without immediate, useful feedback.

If this is true, then we should see a direct correlation between how often a student is given specific feedback (either they got the correct answer or we address their wrong answer with a separate branch in the lesson) and how often the student will stick with the lesson and not drop out. So we combed the data from millions of students' answers to the thousands of questions from our hundreds of lessons (so yes, that's a lot of data), and here's what we found:

As we expected, there is a very strong correlation between how often students are given specific feedback regarding their answer and how often they'll stick stick around for the next part of the lesson. (For you stat-heads out there, the Pearson correlation for this graph was r = 0.572.)

This suggests an obvious way to improve retention: give students more (and better) feedback! Now that's always been our goal here at School Yourself. We regularly update our lessons so that common wrong answers are met with specific, helpful feedback. For example, in the latest version of our lesson on point-slope form, when you enter a slope with an extra minus sign or you accidentally flip the fraction (common mistakes we saw students making), you now proceed down a new path in the lesson that specifically addresses your error. Here's how the lesson map has evolved (note the change from a linear sequence to a more branched structure):

Now if we were to keep doing this, adding new branches to lessons where we accept all the wrong answers students give and provide specific feedback, that could take us forever (and we don't have that kind of time!) So the strategy we've adopted is to address the common wrong answers, prioritizing where students frequently make similar mistakes.

So how much work would it be to provide feedback to 90% of students for each question? According to the first graph, that means we could expect at least 97% retention for each question, which would be outstanding. And the answer turns out to depend on the question type. Here are the results for checkbox questions, and numerical response (in which a student can enter any fraction or decimal):

It turns out that for most questions, students are only giving a handful of answers. For both of these question types, on average, more than 90% of students give either the correct answer or the two most common wrong answers. So if our team should addresses the top two wrong answers, we should achieve 97% retention for each question. It takes our team about a day to make a lesson, and it would only take another day to update the lesson so it offers specific feedback to more than 90% of students.

So we'll continue to update our lessons, making them increasingly adaptive over time. And we won't have to pull any all-nighters to get it done!


  1. I was incredibly impressed with this during a lesson in the Algebra I course. I got an answer wrong and the system knew WHY I got that answer wrong. It was really neat and very helpful (I'm sure I forgot to flip a sign somewhere). I'm looking forward to the completion of the Algebra II course! Thank you.

    1. Good-day viewers that is reading this article, i want to share to the world how this great man save me from HERPES VIRUS 1/2 3years back i was battling with this terrible and disastrous disease which was so detesting,well on my aid of looking for solution all my effort conceived nothing, I was devastated but one day out of great enthusiasm i saw this intrigue testimonies about Dr Ojoka so afterwards i contacted Dr ojoka on his emails: (drojokarootandherbal@gmail com) I explained myself to him and i obeyed all his instruction without protesting any further he assured me that all will be fine and that was it,i was totally cure when i used the herbal medicine that was sent to me,Thank so much sir Dr Ojoka for your help, Dr ojoka also cures several disease such as DIABETES, HIV AIDS, HEPATITIS B & C And many more, incase you are going through this same infection yours can also be cured, contact his mobile or What App : +2348144172934
      check his blog: his blog:

    2. I have been married with my wife for 6 years and recently she broke up with me and it hurt me deeply when she told me to leave her alone and that she does not love me anymore when i was always faithful and honest to her. I tried all the ways to get her back buying her what she wants like i always did and she still left me heart broken and she even has a new boyfriend which destroyed me even more until a friend of mine from high school directed me to Dr Emu. This man changed my life completely. I followed everything he told me to do and my wife came back. I was stunned everything happened exactly like he told me. I had faith in everything he told me and everything was true. You can contact him via email: He will help you in anything you need and quick to answer once you contact him through his whats-app number: +2347012841542
      For more destails about Dr Emu you can visit his Website:

  2. This is all very good, but i think you forget that the reason students retain information with a private tutor is also due to a social element, or social pressure, which you cannot replicate. So no matter what you do, online tutoring can only do so much when students in the age of the distraction economy have very short attention spans.

  3. Prepare yourself for college the best possible way by understanding as much as possible about what you'll face with this engaging and fun game.

    student success game

  4. Oh ya, I noticed that on a few occasions, a pretty nifty way to do things

    Been a pretty nifty site so far! I think I'm about 1/4 through the algebra section.

  5. Great info and really valuable for teachers and tutors. This is really very wonderful post. I really appreciate it, this post is very helpful for educations. Engineering Colleges in Jaipur

  6. This project is probably dead

    My name is Tonyas Mary from Canada, I want to quickly tell the world that there is a real on line spell caster that is powerful and genuine, His name is Dr love0 He helped me recently to reunite my relationship with my husband who left me, When i contacted Dr love0 he cast a love spell for me, and my husband who said he doesn't have anything to do with me again called me and started begging me to come back. he is back now with so much love and care. today i am glad to let you all know that this spell caster have the powers to restore broken relationship back. because i am now happy with my husband. To anyone who is reading this article and needs any help, Dr love0 can also offer any type of help like, Curing of all types of Diseases, Court Cases, Pregnancy Spell, Spiritual protection and lot's more. You can contact him Via email ( check his blogs:  or check website: or visit his FB page:  

  8. Good information and really important to teachers and educators. This is an excellent post. I really appreciate it, this post is very helpful in teaching. Get free Online Education