A Comprehension test is an optional multiple-choice test that can be added to a skill's Curriculum. This article provides an overview of the test settings and scoring specifications.
Overview
Comprehension tests are created within a skill's Curriculum. The test content is finalized when the skill is Save Temporarily or published.
Specifications
Questions and answer choices
- A single test can contain up to 20 questions
- Each question must have between 2 and 4 answer choices
- There are two Question types: multiple choice and true/false. For true/false questions, the answer choices are fixed as "True" and "False," and only one correct answer can be selected
- Duplicate answer choices within the same question cannot be registered
- Each question must have at least one correct answer
- The Test name must be within 200 characters, question text within 400 characters, answer choices within 200 characters, and explanations within 800 characters
Questions per attempt and passing score
- Questions per attempt…Sets how many questions from the registered pool will be presented per attempt. Must be at least 1 and no more than the total number of registered questions
- Passing score…Sets how many correct answers are required to pass. Must be at least 1 and no more than the number of questions per attempt
- Required to pass questions…Can be configured per question. Questions marked as Required to pass are included in every attempt, so the number of such questions cannot exceed the Questions per attempt
Scoring
- The conditions for passing are "the number of correct answers meets or exceeds the passing score" and "all Required to pass questions are answered correctly". Passing with all answers correct is not required
- Unanswered questions are treated as incorrect
- The questions to be presented, as well as the order of questions and answer choices, are determined at the time the attempt begins. Even if the test content changes during an attempt, scoring is based on the content at the time the attempt started
- A test that has been passed cannot be retaken
Retake settings
You can set a waiting period before a learner can retake the test after failing.
- Turn on "Set a waiting period" and specify the number of days. The range is 0 to 365 days, set in day increments
- Learners who are waiting will see "Waiting to retake" and will be informed of the date they can next take the test
- If the waiting period setting is changed, it is immediately Apply to learners who have already failed
- A test that has already been started can still be submitted even during the waiting period. Only the start of a new attempt is restricted
AI question generation
Questions can be generated from the content of manuals. At least one manual must be registered to the target skill. If none are registered, the message "AI generation requires at least one manual registered to the skill" will be displayed.
- Between 1 and 20 manuals can be selected as the source for generation
- The Number of questions to generate is between 1 and 20
- If you want to add additional instructions for generation conditions, enter them within 500 characters
- From the generated questions, select the ones you want to Apply and add them to the test. If adding them would bring the total over 20 questions, reduce the number you select
- AI generation references the latest published manuals in Teachme Biz. The content may differ from the manuals saved to the skill
Related
How do I create and publish a skill?
https://help.myskill.teachme.jp/hc/en-us/articles/61438147908249
How to use
Set up comprehension tests
https://teachme.jp/8/manuals/50102421