How often do students guess their way through?

When designing online courses, like AlgebraX and GeometryX, a common cause for concern is that students can just "guess their way through" lessons and assessments. They're either totally lost, or not paying much attention, but they can still advance and get credit by brute-forcing their way.

This can be very problematic for the student (who is grinding away without really learning) and the course (which loses credibility when this type of student behavior is common). So here at School Yourself, we've been asking ourselves: 1) How often does this happen in our courses, and 2) What can we do about it?

To figure out how often students guess their way through lessons, our team developed a formula we call a student's guess index. It's a number between 0 and 1, where a greater number means the student is probably guessing. A student's guess index takes into account the question type (guessing on a multiple choice question vs. an algebraic question are handled differently), number of attempts, what students do between attempts, and a few other factors. Over time (and with lots of student data) we have found that a guess index of greater than or equal to 0.4 means a student probably guessed their way through a lesson. An index of 0.2 or 0.3 means they might have struggled through parts of the lesson, but they worked throughout without resorting to guessing. And an index of 0 or 0.1 means they confidently proceeded through the lesson.

So here's the distribution for the most recent 10,000 completed lessons:


Students appear to be guess their way through lessons 2% of the time. And we can do the same analysis for reviews (assessments):


Students seem to guess their way through reviews less than 1% of the time. It's a little comforting to know that students guess less on reviews than they do in lessons, since the reviews are what hold them accountable for their knowledge.

One or two guessing students out of a hundred may not sound too shabby. Indeed, these numbers are likely so low because 1) we prefer asking open-ended questions (with interactive graphs, algebraic expressions, numerical, or short answer) where possible, to ensure students understand what they're doing, and 2) our lessons are built around continuous, step-by-step user interaction, where the questions never get too far ahead of the students. But even though relatively few students are guessing, these are also the very students who need the most help! So now that we can precisely measure guessing behavior, what can we do to mitigate or prevent it?

First, it's helpful to know whether students are guessing at similar rates across all lessons and reviews (indicating a problem with the overall course design, question types, etc.), or if the guessing behavior is concentrated among certain lessons.


Half of the lessons exhibited zero guessing behavior, And guessing is concentrated among a handful of lessons, like Ambiguous case, Multiples, and Unsolvable equations. This is great news, because we can focus our attention on these lessons, see where students are guessing the most, and update the lessons (and add new branches providing feedback for common wrong answers).

When it comes to reviews, students don't guess as much:


The majority (69%) of reviews had zero guessing. And once again, it's a handful of reviews that are the most conducive to guessing. So that's where we'll focus our efforts.

So while students guessing their way through lessons doesn't seem to be a major problem for our content, it's something we can mitigate by focusing our effects on the most guess-prone lessons and reviews.

36 comments:

  1. Is there a way to check and see if my child is guessing he way through? Is there a tracking or other wise way to see his progress through in a teacher mode or something?

    ReplyDelete
    Replies
    1. I NEED A LOVE SPELL THAT WILL MANIFEST WITHIN 24 HOURS CONTACT (DR MARCUS  ) HE HIS THE BEST LOVE SPELL CASTER WHO HELPED ME RESTORE HAPPINESS BACK TO MY RELATIONSHIP 
      Hello everyone i want to testify of the great and powerful spell caster named Dr MARCUS who brought back my ex who left me and got engaged to another girl,We where happy together when all of a sudden he just change he used to call me every morning and and night before going to bed but all that stopped when i call him he yell at me and told me he didn't want to have anything to do with me anymore i was so sad and confused i didn't know what to do then i went online to search on how to get back my ex then i found  an article where someone was talking about how the great and powerful Dr MARCUS   helped her and she left his email address i took it and contacted him i told him my problem he only smiled and told me to relax everything will be OK i did everything he asked me to do  and he assured me that after 24hrs he will be back,To my greatest surprise the next morning it was my boyfriend he came back knelling and begging for me to accept him back now we are so happy together he can also help you contact him at drmarcushome@gmail.com or drmarcushome@yahoo.com also   directly on whats-app +2347066448668

      Delete
  2. How I Got My Ex Husband Back...........

    I am Stephine by name also from Canada. Greetings to every one that is reading this testimony. I have been rejected by my husband after three(3) years of marriage just because another woman had a spell on him and he left me and the kid to suffer. one day when i was reading through the web, i saw a post on how this spell caster on this address voodoospelltemple66@gmail.com , have help a woman to get back her husband and i gave him a reply to his address and he told me that a woman had a spell on my husband and he told me that he will help me and after 2 days that i will have my husband back. i believed him and today i am glad to let you all know that this spell caster have the power to bring lovers back. because i am now happy with my husband. Thanks for Dr.voodoo. His email: voodoospelltemple66@gmail.com you can also add Dr.voodoo on whatsApp +2348140120719

    ReplyDelete
  3. Rewriting is nothing else than the modification of a text without changing its context. Many factors make students start seeking a good article rewriting service. The best rewriting services are provided by our writers, so do not hesitate to ask for help.

    ReplyDelete
  4. I NEED A LOVE SPELL THAT WILL MANIFEST WITHIN 24 HOURS CONTACT (DR MARCUS  ) HE HIS THE BEST LOVE SPELL CASTER WHO HELPED ME RESTORE HAPPINESS BACK TO MY RELATIONSHIP 
    Hello everyone i want to testify of the great and powerful spell caster named Dr MARCUS who brought back my ex who left me and got engaged to another girl,We where happy together when all of a sudden he just change he used to call me every morning and and night before going to bed but all that stopped when i call him he yell at me and told me he didn't want to have anything to do with me anymore i was so sad and confused i didn't know what to do then i went online to search on how to get back my ex then i found  an article where someone was talking about how the great and powerful Dr MARCUS   helped her and she left his email address i took it and contacted him i told him my problem he only smiled and told me to relax everything will be OK i did everything he asked me to do  and he assured me that after 24hrs he will be back,To my greatest surprise the next morning it was my boyfriend he came back knelling and begging for me to accept him back now we are so happy together he can also help you contact him at drmarcushome@gmail.com or drmarcushome@yahoo.com also   directly on whats-app +2347066448668

    ReplyDelete
  5. Thank you for sharing useful information with us. please keep sharing like this. You might like the following article also.

    How to Prepare Shahi Paneer
    Recipe for Kheer Kadam

    ReplyDelete
  6. HAVE YOU LOST YOUR MONEY TO BINARY OPTION SCAM OR ANY ONLINE SCAM WHATSOEVER?.DO YOUR DESIRE CREDIT REPAIR[EQUIFAX, EXPERIAN, TRANSUNION? WELL, YOU HAVE FOUND REDEMPTION IN ASORE CORP.



    Asore Corp is a group of multinational hackers, an affiliate of Evil Corp. We make sure by all means necessary that our clients get the best of services on a🔐PAYMENT AFTER JOB IS DONE BASIS✅. Rather than send money and trust a criminal to fulfill your deal, you can make sure the job is done before WORKMANSHIP is paid for. You'll get excellent customer service.

    That's a 100% guarantee. Our Cyber security Technicians are on standby 24/7 to receive your job requests.



    ⚠️ BEWARE OF FRAUDSTERS looking to hoax.

    If you have been a VICTIM, contact : ✉️cyberprecinct@gmail.com for directives.

    Here, it's always a win for you.



    🔸OUR SERVICES🔸

    ➡️Binary Option funds recovery

    ➡️Social media hack

    ➡️Recovery of loan scam

    ➡️Credit repair (Equifax,Experian,Transunion)

    ➡️Email hack

    ➡️College score upgrade

    ➡️Android & iPhone Hack

    ➡️Website design

    ➡️Website hack

    And lots more.



    DISCLAIMER: Asore Cyber Corp accepts no responsibility for any information,previously given to anybody by clients on as regarding the job. Asore Cyber Corp will not distribute contact information collected on any hacking job other than in the Asore corps Hacker's listings themselves, and will not sell contact information to third parties.



    CONTACT INFO:

    📧 asorehackcorp@gmail.com

    cyberprecinct@gmail.com



    Copyright ©️

    Asore Cyber Corp 2021.

    All rights reserved

    ReplyDelete
  7. The doctors said Herpes virus do not have medical cure because the virus is capable of hiding within the human cells, it remains protected from your immune system. Herpes isn’t a special virus – your immune system has the tools to fight it back. But because it is able to lay dormant in protected cells, your immune system is unable to remove it from your body,But with strong reactive herbal medication is capable of getting rid of the virus gradually and totally from your body without damaging any of your cells,natural herbs kills the virus totally not just reducing the out break. Get natural herbs cure Email DR. VOODOO at voodoospelltemple66@gmail.com Add Dr voodoo on whatsApp +2348140120719

    ReplyDelete
  8. There is a great herbal man called Dr voodoo who can cure Hepatitis B virus and other deadly diseases with the use of natural herbs to cure Hepatitis B virus problems. He is from Africa and he is a great doctor and he can also cure you as well if you are have the problem And other deadly disease and here is email address voodoospelltemple66@gmail.com or Whatsapp +2348140120719 HERPES CURE,CANCER CURE,HIV/AIDS CURE,HPV CURE

    ReplyDelete
  9. I started playing lottery games 3 years ago and I have never won big sums. I went online to seek help on how I can win big in my lottery games and I saw some nice reviews about Dr Amber who has made different people huge winners in their lottery games with his prayers. I gave it a try and I contacted Dr Amber who told me how and what to do before I can become a big lottery winner and I accepted. He made special prayers for me at his temple and gave me the required numbers to play the lottery game and when I played it, I won a massive $235.4 million POWERBALL jackpot. I was so happy and I chose to receive my winnings in a one-time, lump-sum payment of $160,038,447.27 at Florida Lottery Headquarters in Tallahassee and the balance was given to the store that I bought & played the game from. I would love other people to seek help from him and he can be contacted through +1 (808) 481-5132 via call/text or email: amberlotterytemple@yahoo.com

    ReplyDelete
  10. Hello everyone my name is wee and i'm here to testify about a great doctor, dr marsu who
    brought back my ex to me, after he left me for another woman. My ex and i dated for 3 years Having plans of getting married too, then
    suddenly his attitude changed towards me that was when i noticed he has started cheating on me after few months he broke up with me which left me totally heart broken and frustrated but then luck shined on me after i contacted dr marsu and within 24 hours my ex came running back to me begging for my forgiviness and after few weeks he proposed to me.So now i'm married to the love of my life and expecting a beautiful baby. if you have any marriage problem, any diseases, or you need a child. contact dr marsu on whatsapp +2349139174545 or email him @ drmarsuofficial@gmail.com

    ReplyDelete
  11. This comment has been removed by the author.

    ReplyDelete
  12. All these lessons are so amazing as they will be helping the students to get to know about the decisions they are taking for their future. Thanks for sharing this with us. I really appreciate that. Now it's time to avail vacuum storage bags for more information.

    ReplyDelete
  13. This blog is very helpful for students. One or two guessing students out of a hundred may not sound too shabby. Now it's time to avail HALFCASTE CREAM SET for more information.

    ReplyDelete
  14. Hello everyone my name is Martha and am here to tell u how i recover my Cryptocurrencies And Stolen Bitcoin. After falling victim to a cryptocurrency investment scam, I was left with nothing after these swindlers stole $139,060 in USDT and Bitcoins from me. I was so lucky to come across a post about Recovery my lost coins, a cryptocurrency and funds recovery Hackers with plenty of experience in cybersecurity. {MAX VIRUS} was able to recover all of MY funds, and with the information we provided, they were tracked down and reported to the appropriate authorities. I highly recommend {MAX VIRUS} for your cryptocurrency recovery.
    l will always recommend {MAX VIRUS}…Contact them with the following below

    Maxvirus@cyber-wizard.com
    Via WhatsApp +1 (941) 960-9892

    ReplyDelete
  15. I appreciated about this article is that it is not judgmental or critical of students who guess their way through exams. Instead, the author acknowledges that guessing is sometimes necessary, and suggests that students can use it strategically to improve their chances of success.

    ReplyDelete
  16. Do you intend to yell out for assistance? Do you want to offer to take my classes? Your request for assistance has been answered by Online Exam Panda. When it comes to help with online coursework, we provide the highest caliber services. We handle it all, from setting up effective study schedules to creating mock exams for exam practice. To learn more about our services, let's speak with our customer care agent. We take pride in assisting students in their efforts to enroll in online classes. Thus, follow our advice for knowledgeable assistance in online classes and grade guarantees.

    ReplyDelete
  17. Algebra is a very complicated subject and I am very weak in this subject. So, whenever I need to write my assignment on algebra topic then I took some assistance from my colleagues and even some time from online professionals.

    ReplyDelete
  18. This post is very interesting. 247 exam help is offering the best and most professional do my exam online as they have the best academic consultant through which you can achieve your desired results.

    ReplyDelete
  19. This post is very interesting. Top Class takers is a unique learning platform for students. With Pay Someone To Do My Assignments , you can learn from our extensive collection of knowledge and resources, to help you improve your performance in class and gain admission into the best universities around the world.

    ReplyDelete
  20. Wow, your blog post is truly wonderful and awesome! It helped me understand many concepts and provided me with valuable insights. The way you explained everything was very clear, and I learned a lot from your post. Thank you for sharing such helpful information!
    separation-agreement-in-virginia

    ReplyDelete
  21. Whether you're attending a corporate event or a casual dinner party, Succession S04 Kendall Roy Suede Jacket adds a touch of class and refinement to any outfit.

    ReplyDelete
  22. I love how you broke down such a complex topic into easy-to-understand concepts. Your post has helped me better understand the subject matter, and I'm excited to put some of your tips into practice.

    ReplyDelete
  23. What you wrote in your blog is completely accurate, and I am a student. I enjoy your blog, and I enjoy blogs that have some information. I read your site and got a lot of knowledge from it. Let me tell you, if you want to try something different this winter, I Can’t Smoke Varsity Jacket must try this jacket at least once.

    ReplyDelete
  24. I wanted to express my heartfelt appreciation for the valuable insights you shared in your post. Your content is not only helpful but also provides reliable information that I can rely on. Thank you so much for taking the time to create and share this wonderful post. Your contribution is truly appreciated
    Divorce Lawyers Culpeper VA

    ReplyDelete
  25. It was a well explained article and it shows the effort that you have taken to summarize your knowledge on the topic.
    Ayurvedic clinics in Dubai | Ayurvedic centre Dubai

    ReplyDelete
  26. Your blogs are really good and interesting. It is very great and informative. I got a lots of useful information in your blog. But even though relatively few students are guessing, these are also the very students who need the most help! So now that we can precisely measure guessing behavior, what can we do to mitigate or prevent it? bankruptcy lawyers virginia beach Keeps sharing more useful blogs..

    ReplyDelete
  27. This comment has been removed by the author.

    ReplyDelete
  28. Algebra is very confusing subject for me because I did not knew the importance of calculations but now I totally understand the importance of Algebra because it really helps me in my Best Travel Agency in Dubai as I need to calculate the cost and give a reasonable estimate to the client for tour package.

    ReplyDelete
  29. Excellent and decent post. It is brilliant blog. I like the way you express information to us. Thanks for such post and please keep it up.Pink Blazer Margot Robbie

    ReplyDelete
  30. I really amazed to read this blog post. It is so unique and informative. TV Series Jackets

    ReplyDelete
  31. The phenomenon of students "guessing their way through" is a common experience, especially when they encounter challenging questions. This blog post shines a light on a relatable aspect of the educational journey. It's a reminder of the importance of providing students with the necessary tools and support to genuinely understand and engage with the material. It also emphasizes the need for effective teaching methods and assessments that encourage true comprehension rather than guesswork. A thought-provoking topic for anyone involved in education.

    Cuanto una Conducir Descuidado Multa en Nueva Jersey
    Nueva Jersey Violencia Doméstica Acto

    ReplyDelete
  32. Thanks for a wonderful share. Here is the great example related to you blog. Walking Dead Rick jacket


    ReplyDelete
  33. Addressing the concern of students guessing through online courses, School Yourself introduces a student's guess index to identify potential guesswork. Analyzing recent data, they find students guess 2% of the time.
    Reckless Driving New Jersey

    ReplyDelete