How to make a course adaptive (without really trying)

Student retention (preventing students from quitting or dropping out) is a major concern for online learning. So why do students drop out in the first place? One reason is a lack of engagement. Indeed, some of our friends over at edX previously found that students tend to stop watching lecture videos that go beyond 4 or 5 minutes.

Our team has already done an incredible job of making online lessons more engaging. In a previous post, we showed how we increased student attention span up to 20 minutes with our highly interactive lessons. So the engagement problem has largely been solved.

But while we've reduced dropout rates, a fair number of students still drop out of our interactive lessons. So we asked ourselves: what's going on here, and what we can do about it?

Now imagine you're working your way through a step-by-step, interactive lesson. You know what you're doing, getting every question right, but suddenly you hit a snag. You just can't seem to get this next question. Now you could ask for a hint, or you could try a few different approaches, but sometimes you'll just quit out of frustration.

With an in-person tutor, this wouldn't happen. A live tutor can diagnose exactly where you confusion is and help you get "unstuck." So our hypothesis is this: students drop out when they're told their answer is wrong without immediate, useful feedback.

If this is true, then we should see a direct correlation between how often a student is given specific feedback (either they got the correct answer or we address their wrong answer with a separate branch in the lesson) and how often the student will stick with the lesson and not drop out. So we combed the data from millions of students' answers to the thousands of questions from our hundreds of lessons (so yes, that's a lot of data), and here's what we found:


As we expected, there is a very strong correlation between how often students are given specific feedback regarding their answer and how often they'll stick stick around for the next part of the lesson. (For you stat-heads out there, the Pearson correlation for this graph was r = 0.572.)

This suggests an obvious way to improve retention: give students more (and better) feedback! Now that's always been our goal here at School Yourself. We regularly update our lessons so that common wrong answers are met with specific, helpful feedback. For example, in the latest version of our lesson on point-slope form, when you enter a slope with an extra minus sign or you accidentally flip the fraction (common mistakes we saw students making), you now proceed down a new path in the lesson that specifically addresses your error. Here's how the lesson map has evolved (note the change from a linear sequence to a more branched structure):


Now if we were to keep doing this, adding new branches to lessons where we accept all the wrong answers students give and provide specific feedback, that could take us forever (and we don't have that kind of time!) So the strategy we've adopted is to address the common wrong answers, prioritizing where students frequently make similar mistakes.

So how much work would it be to provide feedback to 90% of students for each question? According to the first graph, that means we could expect at least 97% retention for each question, which would be outstanding. And the answer turns out to depend on the question type. Here are the results for checkbox questions, and numerical response (in which a student can enter any fraction or decimal):


It turns out that for most questions, students are only giving a handful of answers. For both of these question types, on average, more than 90% of students give either the correct answer or the two most common wrong answers. So if our team should addresses the top two wrong answers, we should achieve 97% retention for each question. It takes our team about a day to make a lesson, and it would only take another day to update the lesson so it offers specific feedback to more than 90% of students.

So we'll continue to update our lessons, making them increasingly adaptive over time. And we won't have to pull any all-nighters to get it done!

63 comments:

  1. I was incredibly impressed with this during a lesson in the Algebra I course. I got an answer wrong and the system knew WHY I got that answer wrong. It was really neat and very helpful (I'm sure I forgot to flip a sign somewhere). I'm looking forward to the completion of the Algebra II course! Thank you.

    ReplyDelete
    Replies
    1. Good-day viewers that is reading this article, i want to share to the world how this great man save me from HERPES VIRUS 1/2 3years back i was battling with this terrible and disastrous disease which was so detesting,well on my aid of looking for solution all my effort conceived nothing, I was devastated but one day out of great enthusiasm i saw this intrigue testimonies about Dr Ojoka so afterwards i contacted Dr ojoka on his emails: (drojokarootandherbal@gmail com) I explained myself to him and i obeyed all his instruction without protesting any further he assured me that all will be fine and that was it,i was totally cure when i used the herbal medicine that was sent to me,Thank so much sir Dr Ojoka for your help, Dr ojoka also cures several disease such as DIABETES, HIV AIDS, HEPATITIS B & C And many more, incase you are going through this same infection yours can also be cured, contact his mobile or What App : +2348144172934
      check his blog: https://perfectherbalcure.blogspot.com/check his blog: https://penisherbalenlarge.blogspot.com/

      Delete
    2. I have been married with my wife for 6 years and recently she broke up with me and it hurt me deeply when she told me to leave her alone and that she does not love me anymore when i was always faithful and honest to her. I tried all the ways to get her back buying her what she wants like i always did and she still left me heart broken and she even has a new boyfriend which destroyed me even more until a friend of mine from high school directed me to Dr Emu. This man changed my life completely. I followed everything he told me to do and my wife came back. I was stunned everything happened exactly like he told me. I had faith in everything he told me and everything was true. You can contact him via email: Emutemple@gmail.com He will help you in anything you need and quick to answer once you contact him through his whats-app number: +2347012841542
      For more destails about Dr Emu you can visit his Website: http://emutemple.website2.me/

      Delete
  2. This is all very good, but i think you forget that the reason students retain information with a private tutor is also due to a social element, or social pressure, which you cannot replicate. So no matter what you do, online tutoring can only do so much when students in the age of the distraction economy have very short attention spans.

    ReplyDelete
  3. Prepare yourself for college the best possible way by understanding as much as possible about what you'll face with this engaging and fun game.

    student success game

    ReplyDelete
  4. Oh ya, I noticed that on a few occasions, a pretty nifty way to do things

    Been a pretty nifty site so far! I think I'm about 1/4 through the algebra section.

    ReplyDelete
  5. Great info and really valuable for teachers and tutors. This is really very wonderful post. I really appreciate it, this post is very helpful for educations. Engineering Colleges in Jaipur

    ReplyDelete
  6. This project is probably dead

    ReplyDelete
  7. THE MOST RELIABLE SPELL CASTER THAT CAN HELP YOU GET BACK YOUR LOST LOVE BACK WITHIN 24HRS. (DOCTOR0LOVESPELL@GMAIL.COM)
    My name is Tonyas Mary from Canada, I want to quickly tell the world that there is a real on line spell caster that is powerful and genuine, His name is Dr love0 He helped me recently to reunite my relationship with my husband who left me, When i contacted Dr love0 he cast a love spell for me, and my husband who said he doesn't have anything to do with me again called me and started begging me to come back. he is back now with so much love and care. today i am glad to let you all know that this spell caster have the powers to restore broken relationship back. because i am now happy with my husband. To anyone who is reading this article and needs any help, Dr love0 can also offer any type of help like, Curing of all types of Diseases, Court Cases, Pregnancy Spell, Spiritual protection and lot's more. You can contact him Via email (doctor0lovespell@gmail.com) check his blogs: https://doctorlovespell0.blogspot.com/  or check website:  https://doctor0lovespell.wixsite.com/lovespell or visit his FB page: https://www.facebook.com/Love-Spell-Doctor0-107453264273672/  

    ReplyDelete
  8. Good information and really important to teachers and educators. This is an excellent post. I really appreciate it, this post is very helpful in teaching. Get free Online Education

    ReplyDelete
  9. I really wish you'd finished the courses here. I love your format and am gutted I can't complete Algebra 2!

    ReplyDelete
  10. The best thing about Call Girls in Agra, Delhi agency is that we have not just a few college girls for you to choose from but a whole collection of erotic girls simply waiting to have sex with their clients and it would not be courteous to not fulfill a girl’s wishes, right? If you are concerned about how you the whole booking will be carried out and other questions about the mode of payment then you can call us at Escorts Service in Faridabad, Delhi agency and one of our receptionists will be glad to help you out.
    Call Girls in Agra
    Call Girls
    Call Girls in Delhi
    Call Girls in Chanakyapuri

    ReplyDelete
  11. Try not to burn through your time in getting Dwarka accompanies

    Visit: Escorts in Dwarka


    Top Low-Cost Call Girls in Dwarka.

    Get Services: Call Girls in Dwarka


    Phenomenal Lavish escorts administration in Gurgaon on your offer

    Go With: Escorts in Gurgaon


    Prominent young ladies in Gurgaon let you experience exotic euphoria past your experience

    Website: Call Girls in Gurgaon


    Hot call young ladies for wild evenings in Gurgaon

    Website: Call Girls in Gurgaon


    Our Escorts: Beauties Like Models

    Visit:Call Girls in Haridwar


    Premium and top-class Haridwar Escorts Agency!

    Go With: Call Girls in Haridwar

    ReplyDelete
  12. ===============================================================================

    Try not to burn through your time in getting Dwarka accompanies

    Visit: Escorts in Dwarka


    Top Low-Cost Call Girls in Dwarka.

    Get Services: Call Girls in Dwarka


    Phenomenal Lavish escorts administration in Gurgaon on your offer

    Go With: Escorts in Gurgaon


    Prominent young ladies in Gurgaon let you experience exotic euphoria past your experience

    Website: Call Girls in Gurgaon


    Hot call young ladies for wild evenings in Gurgaon

    Website: Call Girls in Gurgaon


    Our Escorts: Beauties Like Models

    Visit:Call Girls in Haridwar


    Premium and top-class Haridwar Escorts Agency!

    Go With: Call Girls in Haridwar

    ReplyDelete
  13. Thank you for sharing useful information with us. please keep sharing like this. You might like the following article also.

    Queen Scotia
    Hercules and Queen Omphale
    Oldest sweet of India

    ReplyDelete
  14. He has been diagnosed with Genital Herpes for the past 2 years and I have been searching for cure. I have several outbreaks, But now i have been cured permanently by herbal doctor. Email; Dr Ahmeddrahmedusman5104@gmail.com. or send him a whatsapp text +14436204203

    ReplyDelete
  15. https://www.top-travel.ir/%d8%aa%d8%a7%da%86-%d8%a7%d9%84-%d8%b3%db%8c-%d8%af%db%8c-%d8%a2%db%8c%d9%81%d9%88%d9%86/Elegir un teléfono inteligente hoy en día es una tarea difícil y confusa considerando la gran cantidad de modelos en el mercado

    ReplyDelete

  16. The advancement of science is so unstoppable that even powerful individuals and strata cannot stand in its way.صرافی نیل In contrast, technology is the only thing that can be done with it.

    ReplyDelete
  17. The information you are providing that is really good. Thank for making and spending your precious time for this useful information. Thanks again and keep it up. 파친코

    ReplyDelete
  18. Thanks for a very interesting blog. What else may I get that kind of info written in such a perfect approach? I’ve a undertaking that I am simply now operating on, and I have been at the look out for such info. Feel free to visit my website; 안전놀이터

    ReplyDelete
  19. Pretty great post. I just stumbled upon your weblog and wished to say that I have really enjoyed browsing your weblog posts. In any case I’ll be subscribing to your rss feed and I am hoping you write again very soon! Feel free to visit my website; 온라인카지노

    ReplyDelete
  20. What’s up, I log on to your blogs daily. Your writing style is witty, keep it up!
    고스톱

    ReplyDelete
  21. Wow that was odd. I just wrote an incredibly long comment but after I clicked submit my comment didn’t show up.Grrrr… well I’m not writing all that over again. Regardless, just wanted to say excellent blog!
    My webpage 스포츠토토

    ReplyDelete
  22. Excellent weblog here! Additionally your web site quite a bit up fast!
    What host are you the use of? Can I get your affiliate link in your host?
    I wish my web site loaded up as fast as yours lol
    한국야동

    ReplyDelete
  23. Fabulous, what a weblog it is! This webpage presents helpful facts to us, keep it up.Look into my site 토토사이트

    ReplyDelete
  24. This is the perfect post. It helped me a lot. 사설토토

    ReplyDelete
  25. I finally found what I was looking for! I'm so happy. 파워볼게임

    ReplyDelete
  26. I love making new friends. You can see hot and sexy photos if you want to spend some time with me, then visit the website foot and call me to thank you
    Website Blog Link, Website Blog Link

    ReplyDelete
  27. Finding help with accounting assignments is easier than you think; all you need is to search online for an accounting assignment expert. But stay vigilant while ordering such services from the websites offering accounting assignment help and only pay if you are confident with the final draft you would be getting because we don’t want you to get deceived afterward. Accounting is not only a subject; instead, it is the discipline of every organization. It helps to analyze the financial transactions of every sector. It is a subject that can gift you the best jobs abroad. So, when you need to write your accounting assignment, do not write it haphazardly. There are accounting assignment experts available to solve your problem and offer you the best quality content.

    ReplyDelete
  28. It is very well written, and your points are well-expressed.
    카지노사이트

    ReplyDelete
  29. This is really helpful post and very informative there is no doubt about it.
    바카라사이트

    ReplyDelete
  30. it’s awesome and I found this one informative
    카지노사이트

    ReplyDelete
  31. Such an amazing and helpful post. I really really love it.
    온라인카지노

    ReplyDelete
  32. I came to this site with the introduction of a friend around me and I was very impressed when I found your writing. I'll come back often after bookmarking! majorsite

    ReplyDelete
  33. Very excellent information can be found on blog. 스포츠토토

    ReplyDelete
  34. Great blog, thank you so much for sharing with us. 경마사이트

    ReplyDelete
  35. The details mentioned within the write-up are a number of the top accessible
    릴게임

    ReplyDelete
  36. Pretty! This has been an incredibly wonderful article. Thank you for supplying this information. 토토사이트

    ReplyDelete
  37. I found your weblog using msn. This is a really well written article, keep doing awesome i truly delighted in investigating your site. 카지노사이트위키 카지노사이트

    ReplyDelete
  38. Hi! This is my first visit to your blog! We are a team of volunteers and new initiatives in the same niche. Blog gave us useful information to work. You have done an amazing job! 메이저토토사이트 Thank you very much. Can I refer to your post on my website? Your post touched me a lot and helped me a lot. If you have any questions, please visit my site and read what kind of posts I am posting. I am sure it will be interesting.

    ReplyDelete
  39. Please keep on posting such quality articles as this is a rare thing to find these days. I am always searching online for posts that can help me. watching forward to another great blog. Good luck to the author! all the best! 스포츠토토사이트

    ReplyDelete
  40. Superbly written article , This is s"httuch a great resource that you are providing and you give it away for free 사설토토

    ReplyDelete
  41. Hey, I am so thrilled I found your blog, Extremely decent blog and articles. I am realy extremely glad to visit your blog. 토토사이트링크

    ReplyDelete
  42. Hi! This is my first visit to your blog! first-rate post. I was checking constantly this weblog and i'm impressed! 스포츠토토 온라인카지노

    ReplyDelete
  43. Hello, the whole thing is going sound here and ofcourse every one is sharing information, that’s truly fine, keep up writing.
    카지노사이트

    ReplyDelete
  44. Thanks create a wonderful content for us it’s worthy.

    ReplyDelete
  45. I really like what you guys tend to be up too.
    This kind of clever work and exposure! Keep up the amazing works guys I’ve incorporated you guys to our blogroll.
    온라인카지노
    0

    ReplyDelete

  46. Thanks for the different tips discussed on this blog site.
    온라인바카라

    Some really select articles on this internet site
    홀덤사이트

    ReplyDelete
  47. That's a really impressive new idea!
    블랙잭사이트


    I finally found what I was looking for! I'm so happy.
    블랙잭사이트

    ReplyDelete
  48. I'm glad to find the best bibliography. Thank you for sharing a useful article. 스포츠 토토 안전놀이터

    ReplyDelete
  49. This is a very professional blog post. Thank you for the information that will help my project a lot. 토토사이트

    ReplyDelete


  50. Thanks for sharing with us this important Content.
    슬롯사이트

    found exactly what I used to be having a look for.
    슬롯사이트

    ReplyDelete


  51. thank you!
    블랙잭사이트

    I look forward to your kind cooperation.
    블랙잭사이트

    ReplyDelete
  52. That's exactly what I've been looking for
    검증카지노

    Your information was very useful to me.
    온라인카지노

    ReplyDelete
  53. The mentioned services are the basic 3, 4, 5 and 7 star hotel Aerocity call girls that they perform in their personal lives and are intended to describe and personalize only with their sensual qualities.

    Aerocity call girls

    ReplyDelete
  54. Nice post! Thanks for sharing this quality information with us. check my site OKBet

    ReplyDelete
  55. It's a day of self-confidence. I didn't know I could reply so quickly. good so good Wow happy day.사설토토사이트

    ReplyDelete
  56. This so amazing. I will also try this. I was looking for how to active course adaptive. This will me help me a lot. Thanks for sharing this with us. I really appreciate that. Now it's time to avail call center jobs in lahore for more information.

    ReplyDelete
  57. Great information is shared in this article. I read your article and I find it very informative. Now its time to avail chauffeur service houston for more information.

    ReplyDelete