Within Saxion we generate summative tests on the tab Testform creation. We have made there a testform named Testmatrix with rules and for generating the first, second and third chance of this test for a certain year, we use the tab 'Generate Test' in this testform TestMatrix. However for the second and third or fourth chance of the same testmatrix, you really don't want to use the same questions.This moment you have to exclude already used questions in former chances by hand. This is taking a lot of time, and looks like an activity that could easily be automated. So we would like to have a functionality in Testform creation (not (only) in the wizard!!), that makes it possible to say: use the rules in the testform to generate a test, but exclude all the questions used in testform X, Y and/or Z. If there aren't enough different questions for this use, there should be a warning and one of the already used questions should be picked.
Your Idea its now live on our Surpass product.
Thank you for your contribution.
Leen van Kaam commented
We've already thought of this and it is not really as simple executable as one could think.
Let me give an example: This year we have f.i. 4 chances of a certain exam. Suppose we have for each question in the exam 4 replacement questions that measure exactly the same. We could make 4 folder structures (of tags) defining which question is picked by the testmatrix. But what you do than is making 4 fixed exams. You will always have the same 4 exams, every year again. If we want to make other exams next year, we should move all the questions to different folders or give different tags to all the questions. This action has to be executed every year for all the questions in the database..... That's a lot and a lot of work ans I think asking for problems. Why in this case use a testmatrix at all? Making fixed testforms would be the solution.
Saxion has chosen Surpass because of the possibility to create testforms from a testmatrix. Your suggestion would completely destroy the use of a testmatrix. Then we would have chosen the wrong system for our exams.
Development of a good question is costing almost 1 hour per question. So we have to use the questions available more effective . The use of a testmatrix to generate testforms garantees quality and is saving time of the creation of tests. Why should we do all kind of concessionsin regards to quality.
With those 4 versions of a question we could have much more variety in exams, if we could exclude the last used questions and let the system choose the other questions at random in the next version.
Thank you for your idea.
Could your idea be achieved in Authoring by creating separate folders (for example first chance, second chance, third chance, etc.)? Then in Test Creation each Test Form would select from one of these folders, this would stop the system using the same items across chances.
This suggestion can be achieved now in Surpass Editions. If you are unclear then I can provide an example of how this would be set up.
Alexander Kremers commented