A Comprehension test is an optional multiple-choice test that can be added to a skill's Curriculum. This article summarizes the test settings and scoring specifications.
Overview
Comprehension tests are created within a skill's Curriculum. The test content is finalized when the skill is Save Temporarily or published.
Specifications
Questions and answer choices
- A single test can contain up to 20 questions
- Each question must have between 2 and 4 answer choices
- There are two Question types: Multiple choice and True/False. True/False choices are fixed as "True" and "False", with only one correct answer
- Duplicate answer choices within the same question cannot be registered
- Each question must have at least one correct answer
- The Test name must be within 200 characters, question text within 400 characters, answer choices within 200 characters, and explanations within 800 characters
Questions per attempt and passing score
- Questions per attempt…Sets how many questions from the registered pool will be presented. Must be at least 1 and no more than the total number of registered questions
- Passing score…Sets how many correct answers are needed to pass. Must be at least 1 and no more than the number of questions per attempt
- Required to pass questions…Can be set per question. Since Required to pass questions are always included in every attempt, the number of Required to pass questions cannot exceed the Questions per attempt
Scoring
- The conditions for passing are "number of correct answers meets or exceeds the passing score" and "Pass with all answers correct on all Required to pass questions". It is possible to pass without answering every question correctly
- Unanswered questions are treated as incorrect
- The questions presented and the order of questions and answer choices are determined at the moment the attempt begins. Even if the test content changes during an attempt, scoring is based on the content at the time the attempt started
- A test that has been passed cannot be retaken
Retake settings
You can set a waiting period before a learner can retake a test after failing.
- Turn on "Set a waiting period" and configure the Waiting period in days, hours, and minutes
- Enter days as 0–365, hours as 0–23, and minutes as 0–59, with a total of at least 1 minute and no more than 365 days
- Learners who are waiting will see "Waiting to retake" and will be informed of the date and time when they can next take the test (the learner screen displays this down to the second)
- If the Retake settings waiting period is changed, it will be immediately Applied to learners who have already failed
- A test that has already been started can still be submitted even during the waiting period. Only the start of a new attempt is restricted
AI-generated questions
Questions can be generated from the content of manuals. At least one manual must be registered to the target skill. If none are registered, the message "AI generation requires at least one manual registered to the skill" will be displayed.
- You can select between 1 and 20 source manuals
- The Number of questions to generate is between 1 and 20
- If you want to add additional instructions for generation, enter them within 500 characters
- From the generated questions, select the ones you want to Apply and add them to the test. If adding them would bring the total above 20 questions, reduce the number you select
- AI generation references the latest published manuals in Teachme Biz. The content may differ from the manuals saved to the skill
Related
Tell me about creating and publishing skills
https://help.myskill.teachme.jp/hc/en-us/articles/61438147908249
How to operate
Set up comprehension tests
https://teachme.jp/8/manuals/50102421