Activity: preparing multiple-choice questions

There are many subject areas where multiple-choice questions are used, particularly to test a wide range of factual or declarative knowledge. 

You'll need a course plan or course description including learning outcomes, or you can try this with any topic. 

As usual, you can choose a GenAI tool to try this with, such as one those listed on this page.. You need to choose one which accesses the internet like Bing Copilot. Then write a prompt something like this, depending on what you want to do: 

"Using the course handbook I have uploaded (or pasted in) and your access to the internet, generate 5 different sets of 20 multiple choice questions with 4 choices of response for each question. Each question has equal value (1 point) for a correct answer.

Or

On the topic of “XXXX” generate 5 different sets of 20 multiple choice questions with 4 choices of response for each question. Each question has equal value (1 point) for a correct answer.

Check the outputs. What do you think of the level and the quality of the distractor (false) responses?

You can refine this in different ways. For instance, you could add one of these options to the prompt:

  • Make all the options correct, but the student has to choose the single best answer.
  • Set two questions for each week of the course handbook.
  • Make the questions progressively more difficult, and increase the number of points per question as they get more difficult.
  • Mix the type of questions so that there are 5 where there is only one correct answer, 5 with a ‘fill the gap’ type answer, 5 where the students have to rank answers from best to worst, and 5 which are true/false.

Here is an example from ChatGPT 4o (August 2024) for this prompt: "On the topic of "how to design a good grading rubric for higher educaiton",  generate 5 different sets of 20 multiple choice questions with 4 choices of response for each question. Each question has equal value (1 point) for a correct answer."

I have just pasted the first set in. I will comment here, since the list is long, but these have potential. However, they are not all well designed, with some implausible distractors (wrong answers) and some debatable answers (eg Set 1, question 1, Answer C is also a good one!). But compared to me creating them manually, there is definitely some potential here, as long as I edit carefully. 

Set 1: Principles of Effective Rubric Design

  1. What is the primary purpose of a grading rubric?

    • A. To make grading faster
    • B. To communicate grading criteria clearly to students
    • C. To reduce teacher bias
    • D. To make exams harder
      (Correct Answer: B)

  2. Which component is crucial in a well-designed rubric?

    • A. Broad categories
    • B. Detailed descriptors for each performance level
    • C. Maximum word count
    • D. Random grading criteria
      (Correct Answer: B)

  3. A grading rubric should align with:

    • A. The course's objectives and outcomes
    • B. The teacher's preferences
    • C. The student's needs only
    • D. None of the above
      (Correct Answer: A)

  4. Which type of rubric offers specific feedback for different levels of performance?

    • A. Holistic rubric
    • B. Analytic rubric
    • C. Summative rubric
    • D. General rubric
      (Correct Answer: B)

  5. Rubrics benefit students primarily by:

    • A. Giving them more work
    • B. Setting clear expectations and grading standards
    • C. Making grading harder
    • D. Making assignments optional
      (Correct Answer: B)

  6. An effective rubric should:

    • A. Be complex and hard to understand
    • B. Be clear, specific, and fair
    • C. Avoid alignment with course goals
    • D. Focus only on creativity
      (Correct Answer: B)

  7. How many performance levels are recommended for a clear rubric?

    • A. 1
    • B. 2-3
    • C. 3-5
    • D. 10
      (Correct Answer: C)

  8. Rubrics should be developed:

    • A. After students submit their assignments
    • B. In collaboration with students or peers
    • C. Solely by the teacher with no input
    • D. Without considering course objectives
      (Correct Answer: B)

  9. When using a holistic rubric, you:

    • A. Grade based on one overall impression of the student's work
    • B. Grade based on multiple, separate criteria
    • C. Use it only for final exams
    • D. Use numeric scales exclusively
      (Correct Answer: A)

  10. Which statement is true for an analytic rubric?

  • A. It uses one score for overall performance
  • B. It provides detailed feedback on multiple criteria
  • C. It is only useful for subjective assignments
  • D. It is used for grading participation
    (Correct Answer: B)
  1. What type of rubric would you use to evaluate writing based on grammar, structure, and creativity?
  • A. General rubric
  • B. Analytic rubric
  • C. Holistic rubric
  • D. None of the above
    (Correct Answer: B)
  1. A good rubric should be:
  • A. Vague but adaptable
  • B. Specific and measurable
  • C. Open to wide interpretation
  • D. Constantly changing
    (Correct Answer: B)
  1. A rubric that evaluates performance on multiple criteria and assigns a single score is known as:
  • A. Holistic rubric
  • B. Analytic rubric
  • C. Summative rubric
  • D. Criterion-based rubric
    (Correct Answer: A)
  1. What is one benefit of a well-designed grading rubric for instructors?
  • A. Reduces bias in grading
  • B. Increases grading time
  • C. Encourages subjective feedback
  • D. Confuses students
    (Correct Answer: A)
  1. A rubric can help improve student performance by:
  • A. Making tasks more difficult
  • B. Providing clear guidelines and expectations
  • C. Assigning grades without explanation
  • D. Only focusing on one area
    (Correct Answer: B)
  1. Which of the following is a disadvantage of a poorly designed rubric?
  • A. Clarity in grading
  • B. Bias reduction
  • C. Inconsistent and unclear grading standards
  • D. Objective assessment
    (Correct Answer: C)
  1. An effective rubric provides feedback that is:
  • A. General
  • B. Vague and nonspecific
  • C. Targeted and constructive
  • D. Negative
    (Correct Answer: C)
  1. What is one potential drawback of using a holistic rubric?
  • A. Lack of detailed feedback
  • B. Consistent grading
  • C. Time-saving for the instructor
  • D. Objective grading criteria
    (Correct Answer: A)
  1. A rubric that provides descriptions for each level of achievement on each criterion is:
  • A. Holistic rubric
  • B. Analytic rubric
  • C. General rubric
  • D. Custom rubric
    (Correct Answer: B)
  1. What is a common mistake in creating rubrics?
  • A. Aligning it with learning objectives
  • B. Using vague or ambiguous language
  • C. Giving clear descriptions for each level
  • D. Providing specific, measurable criteria
    (Correct Answer: B)