Goals
- Promote learning by delivering formative assessments
- Increase engagement by adding interaction to learning activities
- Benchmark performance before and after learning activities
Background and strategic fit
LearningBuilder is an assessment platform. One of the modes of assessment is to administer on-line, low-stakes assessments. These assessments are typically used for Practice Exams and to validate learning for situations in which organizations curate learning activities but wish to promote and/or measure engagement with learning materials. Adoption has been slow, but we have a handful of customers who use the assessment engine (ABO and ABOM). Other customers have inquired about it and it comes up frequently with prospects (e.g., NBCRNA). - May 2018.
Assumptions
- The Assessment Engine is not designed to manage highly secure tests. We want to make it annoying to hack the assessments, but not dedicate significant resources to preventing cheating.
Requirements
| # | Title | User Story | Importance | Notes |
|---|---|---|---|---|
| 1 | Create an Assessment | As an Administrator, I create an Assessment so that I can evaluate a person's knowledge. | ||
| 2 | Create a Section | As an Administrator, I can create a Section of questions that groups a set of questions around common content. | ||
| 3 | Create a Question | As an Administrator, I can create a Question so that I can measure a specific component of knowledge. | ||
| 4 | Re-Order Questions | As an Administrator, I can order questions so that there is a sequential experience of questions. | ||
| 5 | Create a Response | As an Administrator, I can create a Response so that a person can answer a question. | Probably move to Question page | |
| 6 | Specify a Cut score | As an Administrator, I can create a cut score to establish the score necessary for a passing result. | ||
| 7 | Specify a Competency Model | As an Administrator, I can assign a Competency Model to the Assessment to govern the scope of Competencies available to assign to Questions. | ||
| 8 | Define Result | As an Administrator, I can manage a Results page so that the results can be tailored to the kind of assessment being taken. | ||
| 9 | Publish an Assessment | As an Administrator, I can publish an Assessment so that it is available to be completed. | ||
| 10 | Un-publish an Assessment | As an Administrator, I can un-publish an Assessment so that it is not available to be completed while changes are made. | ||
| 11 | Automated Scoring | As an Administrator, by indicating the "correct" answer for each question (or by assigning each answer a value and specifying a Cut Score for the Assessment as a whole), I can create an Assessment that is immediately and automatically scored so that the user receives immediate realtime feedback about their performance. | ||
| 12 | Manual Scoring | As an Administrator, I can indicate that certain questions (such as essays or other complex interaction types) require human evaluation before a score can be assigned. | Not implemented yet | |
| 13 | Manage Forms | As an Administrator, I can create multiple Forms within a single Assessment so that I can administer the Assessment multiple times without duplicating the Assessment Experience. |
User interaction and design
Questions
Below is a list of questions to be addressed as a result of this requirements document:
| Question | Outcome |
|---|---|