How often do students guess their way through?

When designing online courses, like AlgebraX and GeometryX, a common cause for concern is that students can just "guess their way through" lessons and assessments. They're either totally lost, or not paying much attention, but they can still advance and get credit by brute-forcing their way.

This can be very problematic for the student (who is grinding away without really learning) and the course (which loses credibility when this type of student behavior is common). So here at School Yourself, we've been asking ourselves: 1) How often does this happen in our courses, and 2) What can we do about it?

To figure out how often students guess their way through lessons, our team developed a formula we call a student's guess index. It's a number between 0 and 1, where a greater number means the student is probably guessing. A student's guess index takes into account the question type (guessing on a multiple choice question vs. an algebraic question are handled differently), number of attempts, what students do between attempts, and a few other factors. Over time (and with lots of student data) we have found that a guess index of greater than or equal to 0.4 means a student probably guessed their way through a lesson. An index of 0.2 or 0.3 means they might have struggled through parts of the lesson, but they worked throughout without resorting to guessing. And an index of 0 or 0.1 means they confidently proceeded through the lesson.

So here's the distribution for the most recent 10,000 completed lessons:


Students appear to be guess their way through lessons 2% of the time. And we can do the same analysis for reviews (assessments):


Students seem to guess their way through reviews less than 1% of the time. It's a little comforting to know that students guess less on reviews than they do in lessons, since the reviews are what hold them accountable for their knowledge.

One or two guessing students out of a hundred may not sound too shabby. Indeed, these numbers are likely so low because 1) we prefer asking open-ended questions (with interactive graphs, algebraic expressions, numerical, or short answer) where possible, to ensure students understand what they're doing, and 2) our lessons are built around continuous, step-by-step user interaction, where the questions never get too far ahead of the students. But even though relatively few students are guessing, these are also the very students who need the most help! So now that we can precisely measure guessing behavior, what can we do to mitigate or prevent it?

First, it's helpful to know whether students are guessing at similar rates across all lessons and reviews (indicating a problem with the overall course design, question types, etc.), or if the guessing behavior is concentrated among certain lessons.


Half of the lessons exhibited zero guessing behavior, And guessing is concentrated among a handful of lessons, like Ambiguous case, Multiples, and Unsolvable equations. This is great news, because we can focus our attention on these lessons, see where students are guessing the most, and update the lessons (and add new branches providing feedback for common wrong answers).

When it comes to reviews, students don't guess as much:


The majority (69%) of reviews had zero guessing. And once again, it's a handful of reviews that are the most conducive to guessing. So that's where we'll focus our efforts.

So while students guessing their way through lessons doesn't seem to be a major problem for our content, it's something we can mitigate by focusing our effects on the most guess-prone lessons and reviews.

23 comments:

  1. Is there a way to check and see if my child is guessing he way through? Is there a tracking or other wise way to see his progress through in a teacher mode or something?

    ReplyDelete
    Replies
    1. I have been married with my wife for 6 years and recently she broke up with me and it hurt me deeply when she told me to leave her alone and that she does not love me anymore when i was always faithful and honest to her. I tried all the ways to get her back buying her what she wants like i always did and she still left me heart broken and she even has a new boyfriend which destroyed me even more until a friend of mine from high school directed me to Dr Emu. This man changed my life completely. I followed everything he told me to do and my wife came back. I was stunned everything happened exactly like he told me. I had faith in everything he told me and everything was true. You can contact him via email: Emutemple@gmail.com He will help you in anything you need and quick to answer once you contact him through his whats-app number: +2347012841542
      For more destails about Dr Emu you can visit his Website: http://emutemple.website2.me/

      Delete
    2. I NEED A LOVE SPELL THAT WILL MANIFEST WITHIN 24 HOURS CONTACT (DR MARCUS  ) HE HIS THE BEST LOVE SPELL CASTER WHO HELPED ME RESTORE HAPPINESS BACK TO MY RELATIONSHIP 
      Hello everyone i want to testify of the great and powerful spell caster named Dr MARCUS who brought back my ex who left me and got engaged to another girl,We where happy together when all of a sudden he just change he used to call me every morning and and night before going to bed but all that stopped when i call him he yell at me and told me he didn't want to have anything to do with me anymore i was so sad and confused i didn't know what to do then i went online to search on how to get back my ex then i found  an article where someone was talking about how the great and powerful Dr MARCUS   helped her and she left his email address i took it and contacted him i told him my problem he only smiled and told me to relax everything will be OK i did everything he asked me to do  and he assured me that after 24hrs he will be back,To my greatest surprise the next morning it was my boyfriend he came back knelling and begging for me to accept him back now we are so happy together he can also help you contact him at drmarcushome@gmail.com or drmarcushome@yahoo.com also   directly on whats-app +2347066448668

      Delete
    3. Good day friends. The truth is that GREAT MOTHER IS REAL AND UNIQUELY POWERFUL. Contact the Great Mother today and she will help you. when my husband left me for another woman, i thought that was the end but i contacted many spell casters but there was no positive responses and everything seemed not to be working and i was losing my mind until my cousin told me about the GREAT MOTHER who also helped her to bring back her man and also helped her to cure her herpes disease. I gave it a try and i contacted the Great Mother on her Website and i saw various testimonies about her on her good works how she has helped a lot of people. I explained my problems to her. she laughed and told me that, everything will be okay again and that she will help me bring back my man in 3 days time. I actually thought that it was a joke but since i had no other options, i gave it a try and i did what she instructed me do and to my greatest surprise, my man came back to me begging in 3 days time just as she told me. Contact the Great Mother now on her website:   https://Ourgreatmother1.blogspot.com   and you can also reach her on her email: Greatmotherofsolutiontemple1@gmail.com  or you can equally contact her on her whatsapp number: +17025514367

      Delete
  2. How I Got My Ex Husband Back...........

    I am Stephine by name also from Canada. Greetings to every one that is reading this testimony. I have been rejected by my husband after three(3) years of marriage just because another woman had a spell on him and he left me and the kid to suffer. one day when i was reading through the web, i saw a post on how this spell caster on this address voodoospelltemple66@gmail.com , have help a woman to get back her husband and i gave him a reply to his address and he told me that a woman had a spell on my husband and he told me that he will help me and after 2 days that i will have my husband back. i believed him and today i am glad to let you all know that this spell caster have the power to bring lovers back. because i am now happy with my husband. Thanks for Dr.voodoo. His email: voodoospelltemple66@gmail.com you can also add Dr.voodoo on whatsApp +2348140120719

    ReplyDelete
  3. Rewriting is nothing else than the modification of a text without changing its context. Many factors make students start seeking a good article rewriting service. The best rewriting services are provided by our writers, so do not hesitate to ask for help.

    ReplyDelete
  4. I NEED A LOVE SPELL THAT WILL MANIFEST WITHIN 24 HOURS CONTACT (DR MARCUS  ) HE HIS THE BEST LOVE SPELL CASTER WHO HELPED ME RESTORE HAPPINESS BACK TO MY RELATIONSHIP 
    Hello everyone i want to testify of the great and powerful spell caster named Dr MARCUS who brought back my ex who left me and got engaged to another girl,We where happy together when all of a sudden he just change he used to call me every morning and and night before going to bed but all that stopped when i call him he yell at me and told me he didn't want to have anything to do with me anymore i was so sad and confused i didn't know what to do then i went online to search on how to get back my ex then i found  an article where someone was talking about how the great and powerful Dr MARCUS   helped her and she left his email address i took it and contacted him i told him my problem he only smiled and told me to relax everything will be OK i did everything he asked me to do  and he assured me that after 24hrs he will be back,To my greatest surprise the next morning it was my boyfriend he came back knelling and begging for me to accept him back now we are so happy together he can also help you contact him at drmarcushome@gmail.com or drmarcushome@yahoo.com also   directly on whats-app +2347066448668

    ReplyDelete
  5. Thank you for sharing useful information with us. please keep sharing like this. You might like the following article also.

    How to Prepare Shahi Paneer
    Recipe for Kheer Kadam

    ReplyDelete
  6. Good day friends. The truth is that GREAT MOTHER IS REAL AND UNIQUELY POWERFUL. Contact the Great Mother today and she will help you. when my husband left me for another woman, i thought that was the end but i contacted many spell casters but there was no positive responses and everything seemed not to be working and i was losing my mind until my cousin told me about the GREAT MOTHER who also helped her to bring back her man and also helped her to cure her herpes disease. I gave it a try and i contacted the Great Mother on her Website and i saw various testimonies about her on her good works how she has helped a lot of people. I explained my problems to her. she laughed and told me that, everything will be okay again and that she will help me bring back my man in 3 days time. I actually thought that it was a joke but since i had no other options, i gave it a try and i did what she instructed me do and to my greatest surprise, my man came back to me begging in 3 days time just as she told me. Contact the Great Mother now on her website:   https://Ourgreatmother1.blogspot.com   and you can also reach her on her email: Greatmotherofsolutiontemple1@gmail.com  or you can equally contact her on her whatsapp number: +17025514367

    ReplyDelete
  7. HAVE YOU LOST YOUR MONEY TO BINARY OPTION SCAM OR ANY ONLINE SCAM WHATSOEVER?.DO YOUR DESIRE CREDIT REPAIR[EQUIFAX, EXPERIAN, TRANSUNION? WELL, YOU HAVE FOUND REDEMPTION IN ASORE CORP.



    Asore Corp is a group of multinational hackers, an affiliate of Evil Corp. We make sure by all means necessary that our clients get the best of services on a🔐PAYMENT AFTER JOB IS DONE BASIS✅. Rather than send money and trust a criminal to fulfill your deal, you can make sure the job is done before WORKMANSHIP is paid for. You'll get excellent customer service.

    That's a 100% guarantee. Our Cyber security Technicians are on standby 24/7 to receive your job requests.



    ⚠️ BEWARE OF FRAUDSTERS looking to hoax.

    If you have been a VICTIM, contact : ✉️cyberprecinct@gmail.com for directives.

    Here, it's always a win for you.



    🔸OUR SERVICES🔸

    ➡️Binary Option funds recovery

    ➡️Social media hack

    ➡️Recovery of loan scam

    ➡️Credit repair (Equifax,Experian,Transunion)

    ➡️Email hack

    ➡️College score upgrade

    ➡️Android & iPhone Hack

    ➡️Website design

    ➡️Website hack

    And lots more.



    DISCLAIMER: Asore Cyber Corp accepts no responsibility for any information,previously given to anybody by clients on as regarding the job. Asore Cyber Corp will not distribute contact information collected on any hacking job other than in the Asore corps Hacker's listings themselves, and will not sell contact information to third parties.



    CONTACT INFO:

    📧 asorehackcorp@gmail.com

    cyberprecinct@gmail.com



    Copyright ©️

    Asore Cyber Corp 2021.

    All rights reserved

    ReplyDelete
  8. The doctors said Herpes virus do not have medical cure because the virus is capable of hiding within the human cells, it remains protected from your immune system. Herpes isn’t a special virus – your immune system has the tools to fight it back. But because it is able to lay dormant in protected cells, your immune system is unable to remove it from your body,But with strong reactive herbal medication is capable of getting rid of the virus gradually and totally from your body without damaging any of your cells,natural herbs kills the virus totally not just reducing the out break. Get natural herbs cure Email DR. VOODOO at voodoospelltemple66@gmail.com Add Dr voodoo on whatsApp +2348140120719

    ReplyDelete
  9. There is a great herbal man called Dr voodoo who can cure Hepatitis B virus and other deadly diseases with the use of natural herbs to cure Hepatitis B virus problems. He is from Africa and he is a great doctor and he can also cure you as well if you are have the problem And other deadly disease and here is email address voodoospelltemple66@gmail.com or Whatsapp +2348140120719 HERPES CURE,CANCER CURE,HIV/AIDS CURE,HPV CURE

    ReplyDelete
  10. I started playing lottery games 3 years ago and I have never won big sums. I went online to seek help on how I can win big in my lottery games and I saw some nice reviews about Dr Amber who has made different people huge winners in their lottery games with his prayers. I gave it a try and I contacted Dr Amber who told me how and what to do before I can become a big lottery winner and I accepted. He made special prayers for me at his temple and gave me the required numbers to play the lottery game and when I played it, I won a massive $235.4 million POWERBALL jackpot. I was so happy and I chose to receive my winnings in a one-time, lump-sum payment of $160,038,447.27 at Florida Lottery Headquarters in Tallahassee and the balance was given to the store that I bought & played the game from. I would love other people to seek help from him and he can be contacted through +1 (808) 481-5132 via call/text or email: amberlotterytemple@yahoo.com

    ReplyDelete
  11. This is such a great resource that you are providing and you give it away for free. I love seeing blog that understand the value of providing a quality resource for free DIPLOMATIC PASSPORT US ,I will also take the advantage to ask for your permission to join our TELEGRAM GROUP

    ReplyDelete
  12. It is amazing and wonderful to visit your site.Thanks for sharing this information,this is useful to me

    inside bc
    Allen Student Login
    mnsud2l

    ReplyDelete
  13. Hello everyone my name is wee and i'm here to testify about a great doctor, dr marsu who
    brought back my ex to me, after he left me for another woman. My ex and i dated for 3 years Having plans of getting married too, then
    suddenly his attitude changed towards me that was when i noticed he has started cheating on me after few months he broke up with me which left me totally heart broken and frustrated but then luck shined on me after i contacted dr marsu and within 24 hours my ex came running back to me begging for my forgiviness and after few weeks he proposed to me.So now i'm married to the love of my life and expecting a beautiful baby. if you have any marriage problem, any diseases, or you need a child. contact dr marsu on whatsapp +2349139174545 or email him @ drmarsuofficial@gmail.com

    ReplyDelete
  14. This comment has been removed by the author.

    ReplyDelete
  15. All these lessons are so amazing as they will be helping the students to get to know about the decisions they are taking for their future. Thanks for sharing this with us. I really appreciate that. Now it's time to avail vacuum storage bags for more information.

    ReplyDelete
  16. This blog is very helpful for students. One or two guessing students out of a hundred may not sound too shabby. Now it's time to avail HALFCASTE CREAM SET for more information.

    ReplyDelete
  17. Hello everyone my name is Martha and am here to tell u how i recover my Cryptocurrencies And Stolen Bitcoin. After falling victim to a cryptocurrency investment scam, I was left with nothing after these swindlers stole $139,060 in USDT and Bitcoins from me. I was so lucky to come across a post about Recovery my lost coins, a cryptocurrency and funds recovery Hackers with plenty of experience in cybersecurity. {MAX VIRUS} was able to recover all of MY funds, and with the information we provided, they were tracked down and reported to the appropriate authorities. I highly recommend {MAX VIRUS} for your cryptocurrency recovery.
    l will always recommend {MAX VIRUS}…Contact them with the following below

    Maxvirus@cyber-wizard.com
    Via WhatsApp +1 (941) 960-9892

    ReplyDelete
  18. I appreciated about this article is that it is not judgmental or critical of students who guess their way through exams. Instead, the author acknowledges that guessing is sometimes necessary, and suggests that students can use it strategically to improve their chances of success.

    ReplyDelete
  19. Do you intend to yell out for assistance? Do you want to offer to take my classes? Your request for assistance has been answered by Online Exam Panda. When it comes to help with online coursework, we provide the highest caliber services. We handle it all, from setting up effective study schedules to creating mock exams for exam practice. To learn more about our services, let's speak with our customer care agent. We take pride in assisting students in their efforts to enroll in online classes. Thus, follow our advice for knowledgeable assistance in online classes and grade guarantees.

    ReplyDelete