SARAS TEST and ASSESSMENT Product Features Author: Meenakshi M C Product Manager – SARAS Test and Assessment Contents 1. Administrative Activities ....................................................................................................................... 5 1.1. 1.1.1 Add ........................................................................................................................................ 6 1.1.2 Edit ........................................................................................................................................ 6 1.1.3 Block ...................................................................................................................................... 6 1.1.4 Activation Period ................................................................................................................... 7 1.1.5 Delete .................................................................................................................................... 7 1.2. Manage Role ................................................................................................................................. 7 1.2.1. Add ........................................................................................................................................ 8 1.2.2. Edit ........................................................................................................................................ 9 1.2.3. Delete .................................................................................................................................... 9 1.3. Manage User ............................................................................................................................... 10 1.3.1. Add ...................................................................................................................................... 11 1.3.2. Edit ...................................................................................................................................... 13 1.3.3. Delete .................................................................................................................................. 13 1.3.4. View Password .................................................................................................................... 13 1.3.5. Export .................................................................................................................................. 13 1.4. Manage Batch ............................................................................................................................. 14 1.4.1. Add ...................................................................................................................................... 14 1.4.2. Edit ...................................................................................................................................... 14 1.4.3. Delete .................................................................................................................................. 14 1.4.4. Tag / Untag Users ................................................................................................................ 14 1.5. 2. Manage Customer......................................................................................................................... 5 Manage Product.......................................................................................................................... 14 Content Management ......................................................................................................................... 16 2.1. Manage Repository ..................................................................................................................... 16 2.1.1. Add Repository .................................................................................................................... 17 2.1.2. Edit Repository .................................................................................................................... 17 2.1.3. Share Repository ................................................................................................................. 17 2.1.4. Delete Repository................................................................................................................ 18 2.2. Manage Question........................................................................................................................ 18 1|Page Excelsoft Technologies Pvt. Ltd Confidential 2.2.1. Question Types ................................................................................................................... 18 2.2.2. Add question - Web based authoring ................................................................................. 39 2.2.3. Data about a question......................................................................................................... 39 2.2.4. Import Question - Offline Authoring................................................................................... 45 2.2.5. Edit question ....................................................................................................................... 47 2.2.6. Question preview ................................................................................................................ 48 2.2.7. Search & Advanced search.................................................................................................. 48 2.2.8. Export .................................................................................................................................. 48 2.2.9. Repository Preview ............................................................................................................. 48 2.2.10. Duplicate Search ................................................................................................................. 48 2.2.11. View History ........................................................................................................................ 49 2.2.12. Delete question ................................................................................................................... 50 2.3. Manage Digital Assets ................................................................................................................. 51 2.3.1. Add asset ............................................................................................................................. 51 2.3.2. Preview asset ...................................................................................................................... 52 2.3.3. Edit asset ............................................................................................................................. 52 2.3.4. Search asset ........................................................................................................................ 53 2.3.5. Delete asset......................................................................................................................... 53 2.3.6. Import asset ........................................................................................................................ 53 2.4. Manage Workflow ...................................................................................................................... 54 2.4.1. Add Workflow ..................................................................................................................... 54 2.4.2. View Workflow .................................................................................................................... 59 2.4.3. Extend schedule date .......................................................................................................... 59 2.4.4. Delete Workflow ................................................................................................................. 59 2.5. Manage Test Templates .............................................................................................................. 59 2.5.1. Add Test Template .............................................................................................................. 59 2.5.2. View the availability of questions in Test Template ........................................................... 61 2.5.3. Edit Test Template .............................................................................................................. 61 2.5.4. Delete Test Template .......................................................................................................... 61 2.6. Manage Grade Scheme ............................................................................................................... 61 2.6.1. Add Grade Scheme.............................................................................................................. 62 2.6.2. View Grade Scheme ............................................................................................................ 62 2|Page Excelsoft Technologies Pvt. Ltd Confidential 2.6.3. Edit Grade Scheme .............................................................................................................. 63 2.6.4. Delete Grade Scheme ......................................................................................................... 63 2.7. Manage Test................................................................................................................................ 63 2.7.1. Test Construction or Test creation...................................................................................... 64 2.7.2. Test Preferences ................................................................................................................. 69 2.7.3. Non-Template based test creation Vs. Template based test creation ............................... 74 2.7.4. Edit Test............................................................................................................................... 75 2.7.5. Preview Test ........................................................................................................................ 76 2.7.6. View Details......................................................................................................................... 76 2.7.7. Copy Test ............................................................................................................................. 77 2.7.8. Print Test ............................................................................................................................. 77 2.7.9. Delete Test .......................................................................................................................... 78 2.7.10. Test Types ........................................................................................................................... 78 2.8. Schedule Tests............................................................................................................................. 81 2.8.1. 2.9. Test Priority ......................................................................................................................... 83 Candidate Verification / Registration ......................................................................................... 83 2.10. Reports .................................................................................................................................... 84 2.10.1. Data Forensics ..................................................................................................................... 84 2.10.2. Pre Exam Report ................................................................................................................. 85 2.10.3. During Exam Report ............................................................................................................ 87 2.10.4. Post Exam Reports .............................................................................................................. 88 14.1. Offline Test ............................................................................................................................ 101 14.2. Test Delivery Modes.............................................................................................................. 101 14.2.1. Centralized ........................................................................................................................ 101 14.2.2. Distributed ........................................................................................................................ 103 14.3. Monitoring Dashboard .......................................................................................................... 106 14.4. Test player features .............................................................................................................. 107 14.5. Customer Account Settings ................................................................................................... 113 14.6. Personalization ...................................................................................................................... 115 14.7. Online Proctoring .................................................................................................................. 115 14.8. Secured Browser ........................................................................ Error! Bookmark not defined. 3|Page Excelsoft Technologies Pvt. Ltd Confidential 4|Page Excelsoft Technologies Pvt. Ltd Confidential 1. Administrative Activities 1.1. Manage Customer Organization/ Customersare created and managed by the Super Admin or Application Admin in the solution. This helps in maintaining a solution through a central administration. This in turn helps in the communication, content sharing across organizations and its users. Super Organization Add Organization Organization 1 Organization 2 Share Repositories / Communication Organization 3 _ _ _ Organization n Admin can manage i.e., add, edit, set activation period, block and delete organization or customers in the system. Also, Super Admin can easily manage roles, users, licenses required, whilst customer management. 5|Page Excelsoft Technologies Pvt. Ltd Confidential 1.1.1 Add Addition of a new customer into the system with details including name, geographical location, and the contact details. As part of branding, the customer logo can be uploaded. The roles for a customer can be created by the Super Admin and inherit those roles while managing their customer details. Also, the theme or the style sheet or look and feel of the application can be chosen from the pre-defined list by the Super Admin whilst customer creation. If in case to contact particular person in an organization, the Super Admin can key in the persons’ contact details. 1.1.2 Edit Once the customer or organization is created, and if any changes in the details are observed, the Super Admin can easily modify the details. 1.1.3 Block 6|Page For reasons (if found untrustworthy, not made payments, license expires) the customer can be blocked. On blocking the users of the organization will not be able to use the system. However, the Super Admin can unblock the customer to use the system at any point. Excelsoft Technologies Pvt. Ltd Confidential 1.1.4 Activation Period Based on the organization licensing, the activation period can be set. However, the organization can be blocked within the set activation period. 1.1.5 Delete 1.2. For reasons (no more a customer) the customer can be deleted. On deletion, the users of the organization will not have an access to the system anytime in future. Post deletion, the Admin will not be able to view the customer details in the system. The deleted details however are saved in the database with a bit ’isdeleted’ set to 1 Manage Role For an organization, different roles are defined for whom privileges are set accordingly. The privileges are actually the tasks which have to be performed by the user who is defined for a particular role. Organization Roles in an Organization Add Roles Teacher / SME / Author Invigilators Evaluators Test Taker [[Define Role]] and set privileges Admin can manage i.e., add, edit and delete roles for an organization.Roles are defined with specific privileges. 7|Page Excelsoft Technologies Pvt. Ltd Confidential 1.2.1. Add 8|Page The system basically allows creation to two role types. The ‘Power user’ who is set with the required administrative privileges. The ‘End user’ who is set with test delivery privileges. When an organization is created, it becomes mandatory for the application admin to create a role with required admin privileges to manage the individual organization. Excelsoft Technologies Pvt. Ltd Confidential 1.2.2. Edit The existing roles if assigned or de-allocated with their privileges, Admin edits the role privileges. 1.2.3. Delete 9|Page If the organization does not hold a particular role any more, the role can be deleted by the admin. Prior to role deletion, all the users tagged to the role should be deleted. On deletion, Excelsoft Technologies Pvt. Ltd Confidential those role users will not have an access to the system anytime in future. Post deletion, the Admin will not be able to view the roles details in the system. The deleted details however are saved in the database with a bit ’isdeleted’ set to 1 1.3. Manage User Super Admin / Organization Admin can manage i.e., add, edit and deleteusers in the system. Organization Users in an Organization Admin 1 performs Roles defined in an Organization CenterAdmin Admin 2 performs Teacher 1 performs Add User Teacher performs Teacher 2 performs Evaluator Evaluator 1 _ _ _ _ Test taker performs Student 1 _ _ _ _ performs Student n 10 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 1.3.1. Add The users are added for an organization in either of the modes mentioned below: 1.3.1.1. Individual Add User 11 | P a g e A single user when required to be added into the system, happens through Individual user addition mode. During addition, the user profile along with the organization to which (s)he belongs to, the role they perform in the organization and the credentials to login to the system are also added. The Login ID / Username is the unique Id for any user created in the system. The password for the user is well decided by the Admin. Excelsoft Technologies Pvt. Ltd Confidential 1.3.1.2. Import Users: 1.3.1.3. Bulk Add User: 12 | P a g e Users in large numbers,around 4000-5000 users are added into the system through a .csv file with the user details in a required format. If the users are added to a Batch around 500 users can be imported at a single point in time. Users joining the system in batches are added through bulk import. Can add up to 10 users at a time Excelsoft Technologies Pvt. Ltd Confidential 1.3.2. Edit Change in any detail of an individual user is editable. However, the username(id to login to the system) can be edited only if not existing in the system. 1.3.3. Delete If the user has left the organization for any reasons, the user details can be deleted. The users can be deleted individually or in bulk. Any user who is deleted will not have an access to enter the system. However, the deleted user details are available in the database with ‘isdeleted’ bit set to 1. 1.3.4. View Password If in case the password is lost, the user can contact the Admin to get password. With this, the Admin can search the particular user details and mail the password to respective user’s mail id. 1.3.5. Export The user details can be exported to excel sheet. 13 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 1.4. Manage Batch Super Admin / Organization Admin can manage i.e., add, edit and delete batches or group of users in the system. The grouping can be on the similar performing users / users of same subject or course / or any others 1.4.1. Add The groups/batches are added for an organization through ‘Add Batch’ feature. An empty group can be created and the users can be tagged later. As well, the users can be grouped directly to an existing group when the users are added in the system through ‘Manage Users’ feature. The batches created have just single hierarchy. There can any number of users added to a batch. A single user can exist in multiple batches. 1.4.2. Edit The batches created can be edited for its details through ‘Edit Batch’ feature. The edited details get reflected on the 1.4.3. Delete The batches created can be deleted if the batch does not exist anymore through ‘Delete Batch’ feature. When the batch is deleted the users in the batch get untagged but not deleted and they have an access to enter the system yet. However, the deleted batch details are available in the database with ‘isdeleted’ bit set to 1. 1.4.4. Tag / Untag Users 1.5. The new users to the system can be tagged to one or more batches. Likewise, the users who are not part of the batch or moved to another batch can be untagged from the batch. Manage Product The Organization Admin manages (i.e, Add, Edit, Delete) the product under various categories of programs / courses the users to be assessed on. e.g.: under the main category ‘Certification’, the sub categories are Microsoft certifications, Oracle certifications, Adobe certifications and so on. And under Microsoft certifications, various products are MCTS, MCITP. Various exams are attached under each of these products. 14 | P a g e Excelsoft Technologies Pvt. Ltd Confidential It is must to manage the categories/sub-categories before managing the products. Based on the organization’s needs, products can be used to manage the high stake or test prep exams. As well, the licenses to conduct the examination over a product can also be managed. 15 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2. Content Management 2.1. Manage Repository Admin can manage i.e., add, edit, share and delete repositories. It also helps admin organize the repositories of content in a required structure. Organization A User A1 Repository Structure Digital Assets DigiAsset 1 Organization B DA Child 1.1 Share Add Repository DA Child 1.2 User B1 DigiAsset n Share Item Organization C Item 1 Share Item 1.1 User C1 Item 1.2 Item n Test Test 1 Test 1.1 Test 1.2 Test n Share User A2 The system has four staged repositories namely, Digital Assets, Item (Question), Test template, Test. The content stored in digital asset repository is used in question management. Questions are used to create the test template or used in creation of tests. Tests can also be directly created from the questions picked from question repository. 16 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.1.1. Add Repository The repositories are the structured folders to store the content like digital assets, questions or items, test templates and tests. The repositories created are either based on the curriculum structure of the school syllabi, or it could be on the Subjects, Topic, Sub-topic and so on structuring or it could be the competency vs. skills categorization. It could also be on the target audience. So it is left to the flexibility of the admin who defines the repository structure to define it. The repository treeis built to ‘n’ sub-level s. Repository at any level can have any number of data in it. The repositories created by organization admins are accessible by the application or the super admin, but not to other organization admins. For e.g., there are around 7000 no. of questions stored in one of the repositories used by one of our customers (MGU) The limit on number of nodes is set when building the repository structure. Repository activation period: The repository life time are set, which as well means to be the life time of the questions in the repository 2.1.2. Edit Repository The repository details added can be edited at any point in time. 2.1.3. Share Repository The super admin can share the repositories to different organization on selection. Provided the privilege, one organization admin can share the repositories of one organization to another organization where the organizations cater similar services. 17 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.1.4. Delete Repository The repository having content in it can be deleted at any point in time. However, double confirmation happens on the repository to be deleted. If the main repository is deleted, all its sub-repositories and contents are deleted. If in case, the questions in repository used in tests, and the repository is deleted, there is no effect on the test which is already created, or the test which is published or been taken by the test takers and also in the results. Only the repository will get deleted, but not the content wherever used. The deletion of repository is soft/logical deletion. 2.2. Manage Question Subject Matter experts / Authors can manage i.e., create, edit,search, import, exportand delete questions Organization A Author creates the questions Author Go to Question Management Area Search Questions Metadata such as score, hints, feedback, difficulty level, classification are selected for a question. Move questions across the repository. Author Qs 24 + 6 (programming Q types) can be added. Web based : Add Question Digital Assets Image, audio, video or flash file can be selected and the same can be added as a part of the question Question Repository End Tag workflows to the Qs Windows based : Import (QTI compliance) Questions. 5 Q Types can be authored 2.2.1. Question Types Questions created in SARAS system are compliant to QTI (Question and Test interoperability) standards and are of version 1.2. SARAS supports creation of different types of questions including both objective and subjective types.. Below is the list of supported question types. 18 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1. Objective question types 2.2.1.1.1. Multiple choices static o Include Question stem which has static content Single correct answer and multiple distractors User is to choose one choice as the response among the list of options. 19 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1.2. Multiple choices dynamic o Include Question stem with certain variable content and the range of variables is as defined by the question author Single correct answer and multiple distractors User is to choose one choice as the response among the list of options. Usually, used in creation of simple math problem. 20 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1.3. Multiple responses static o Include Question stem which has static content Multiple correct answers and single or multiple distractors User is to choose more than one choice as the answer. The max and min limit to choose the choices can be set whilst its creation. 2.2.1.1.4. Multiple responses dynamic o Include Question stem with certain variable content and the range of variables is as defined by the question author Multiple correct answers and single or multiple distractors User is to choose more than one choice as the answer. The max and min limit to choose the choices can be set whilst its creation. 21 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1.5. Matching o Include Two columns, in which the left hand column is, question column and the right hand column is response column. The no. of question and response content in the two columns are same in number. User is to choose one among the options available in the right hand column (dropdown). The question column contains text / digital assets. But the response column has only text. 2.2.1.1.6. True or False o Include 2.2.1.1.7. Drag and drop o Include 22 | P a g e A question statement Options ‘Yes/No’ or ‘True/False’ or ‘Correct/Incorrect’ User is to choose either one of the options Question statement Background image Dropping image(s) Excelsoft Technologies Pvt. Ltd Confidential User drags and drops the response images on the background image. 2.2.1.1.8. Fill in blanks o Include Question statement Defined with single or multiple blanks User is supposed to fill in the blanks. 2.2.1.1.9. Fill in blanks dynamic o Include 23 | P a g e Question statement with certain variable content and the range of variables is as defined by the question author. Defined with single or multiple blanks. Excelsoft Technologies Pvt. Ltd Confidential User gives the response by filling in the blanks. Responses vary according to the numeric variables presented in the question. 2.2.1.1.10. Hotspot multiple choices o Include Question statement Background image Single selection option on the image. User is to spot single option as the response on the image. The spots are defined by the question author whilst creation. 2.2.1.1.11. Hotspot multiple responses o Include Question statement Background image User is to spot multiple options as the response on the image. The spots are defined by the question author whilst creation. 24 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1.12. Entry list static o Include Question statement with static content Sub-questions with a text box against each. User is supposed to key in the responses in the blanks of the sub-questions. 2.2.1.1.13. Entry list dynamic o Include Question statement with certain numeric variables Sub-questions with a text box against each User is supposed to key in the responses in the blanks of the sub-questions. 2.2.1.1.14. Likert scale o Include Question statement which relates to psychometric Default five options like Agree, Disagree, Strongly Agree, Strongly Disagree and neither Agree nor Disagree (The options are changeable) User is to mark the response on the degree of agreement on the question statement. This is completely individual response based question. 25 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.1.15. Matrix o Include Question statement Sub-questions with single correct response and multiple distractors Or Sub-questions with multiple correct responses and single/ multiple distractors User is to choose response(s) in the list of options. 2.2.1.1.16. Numeric o Include Question statement Blank to be filled with numbers only. User is to key in the numeric responses only. 2.2.1.1.17. Pull down list: Similar to Matching type of question o 26 | P a g e Include Excelsoft Technologies Pvt. Ltd Confidential Two columns, in which the left hand column is, question column and the right hand column is response column. The no. of question and response content in the two columns are not the same. User is to choose one among the options available in the right hand column (dropdown). The question column contains text / digital assets. But the response column has only text. 2.2.1.1.18. Ranking o Include Question statement List of events in form of statements which are not in the sequential order. Dropdown of numbers against each statement User is to sequence the events by picking the right number 2.2.1.1.19. Select a blank: Similar to fill in the blanks o Include Question statement with single or multiple blanks Blanks have pre-defined options User is select one among the options listed to fill in the blank 2.2.1.1.20. Slider o Include Question statement Slider with set of values User is to slide and set the correct value on the image for the question asked. This is mostly used in questions with numbers. 2.2.1.1.21. Text match o Include 27 | P a g e Question statement Text area to key in the short text Excelsoft Technologies Pvt. Ltd Confidential User enters the short texts in the text area provided. User is scored based on the keyword matching. Keywords are defined by the question author whilst creation. 2.2.1.1.22. Connect the points o Include Question statement Background image Multiple points on the image User is to connect various points on the image as a response to the question. This requires Java Applet to be pre-installed to run on the client machine. 2.2.1.2. Subjective question types 2.2.1.2.1. Essay o Include Question statement Text area User keys in the descriptive answer in the text area defined. 28 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.2.2. File upload o Include Question statement Space to upload files User creates a document offline and later uploads it as the response. This type is used in test assignments. 2.2.1.3. Objective HTML5 based question types 2.2.1.3.1. Fill in the blanks – Drag and Drop o Include The option area where the fill-ups to be dragged and dropped is listed. The question area where the blanks are defined User is to drag and drop the fill-ups are to be dragged and dropped into the blanks defined. 29 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.3.2. Horizontal sequencing - Single set & multiple set o Single Set type, Include Question stem with a static content. Horizontal display of the letters or digits or words or expressions User is supposed to re-arrange the content to its correct form. 30 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Note: Though the samples relate to English language, these question types can be used for other subjects and topics. E.g., In Math, to arrange the numbers in ascending order. o Multiple Set type, Include Question stem with a static content. Horizontal display of the letters or digits or words or expressions but with multiple sets. User is supposed to re-arrange the contents to its correct form. 31 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.3.3. Vertical sequencing o Include Question stem has static content which is the instruction to follow for answering the question. List of jumbled events/statements. User has to rearrange events/statements in proper sequence. Note: This is again not just restricted to English subject, but is extended to be used in arranging the events of history / steps to write a computer program / steps to solve a math problem and so on. 2.2.1.3.4. Image labeling – Select and Match o Include Question stem has static content with Background image Area / parts of the image to be labeled Labels of the area / parts User shouldclick and select theareas/parts on the image and the labels to connect between the two. 32 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.3.5. Image labeling - Drag and Drop o Include Question stem has static content with Background image Area / parts of the image to be labeled Labels of the area / parts User has to identify and drag and dropthe labelsto its correct position. 33 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.3.6. Connect the points o Include Question statement Background image Multiple points on the image User is to connect various points on the image as a response to the question. 34 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 35 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.1.3.7. Matching -Drag & Drop Text to Text o Include Question stem will have static content. Text and its descriptions under two columns. User has to match the text with appropriate description. 36 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Image to Text o Include Question stem will have static content. Image and text under two columns which is interchangeable. User has to match the text with its correspondingimage 37 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Image to Image o Include Question stem will have static content Images under both columns. User has to match the two related images. 38 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.2. Add question - Web based authoring In this type of Authoring, an interface is provided in the solution where in the Author can key in the questions in an HTML editor. The HTML editor supports the rich text forms. Enables the authors create questions in required form. All the various question types defined can be authored through web based authoring. 2.2.3. Data about a question Basically question has, 39 | P a g e Question label: An identifier for every question which gets created in the system. Excelsoft Technologies Pvt. Ltd Confidential Question content: Question content need not be just the text; instead can include hyperlinks, audio clips, video clips, Images and flash objects which supplement the textual content. Correct and Incorrect answers: Everyquestion has a correct and an incorrect answer. Few of the type of questions have incorrect answers to be defined. And for the others, if the answer other than what is defined is answered, it becomes an incorrect answer. Scores: Every question created in the system has a score set. Score for a question can have value from 0 to 99. The score is positive value or a decimal value for correct answer and a negative number or a zero for an incorrect answer. Negative scoring is mainly used during the competitive exams, where in the elimination process gets easier. Note: In multiple choice question type, the choices can have incremental value. The choice having the max score is considered to be the best answer. Option O1 O2 O3 O4 Score 1 2 3 4 O4 is the best answer and O1 is the least likely answer. Shuffle options:Enabling this option, does change the order of options or choices in the question types such as multiple choice or multiple response. This reduces the chances of responses being copied by two users answering the same question. e.g., a question has 4 options: O1, O2, O3, O4 and the right answer is O2 User1 User2 1) O2 O4 2) O3 O3 3) O4 O2 4) O1 O1 User 1 copying and marking the answer as third option gets no mark. Choice presentation layout:Based on the needs of the questions, the choices can be either presented in horizontal (side by side) or vertical (one below the other) forms. This is seen in question types such as true or false, multiple choice or multiple response. Item Stem (Horizontal) O1 O2 O3 O5 Item stem (Vertical) O1 O2 40 | P a g e Excelsoft Technologies Pvt. Ltd Confidential O3 O4 Hints:Hints / clues are provided for every question. For learning assessments, providing hints for a question during the test to the candidates enable them to answer the questions in a better manner. Practice tests may also contain Hints as a part of questions. The feedback is added by the Subject matter expert (SME) whilst its creation. The Hint can be just a text or a video clip or an audio clip or an image or the mentioned digital assets supplementing the textual content. Feedback:During practicing, the users can get to know the explanation or solution on how to get the answer of the question. The feedback is added by the SME whilst its creation. The feedback can be just a text or a video clip or an audio clip or an image or the mentioned digital assets supplementing the textual content. Difficulty or complexity level:SME sets the difficulty level of a question as easy, moderate, or difficult to understand how well a user has mastered the topic. If required the levels of difficulty can be increased or decreased from back end. Classification on Bloom’s taxonomy:SME classifies the question into one of the classifications based on Bloom’s taxonomy i.e., knowledge, comprehension, application, analysis, synthesis, evaluation to assess the users cognitive thinking. Question time: The question can be set with a time or can be set with unlimited timing. Activation period: Set the period for which the question has to be active. Based on this period, the question will be available in the test. This holds good for the test created with random pick of questions in a huge question bank. Exposure limit:If for e.g., the exposure limit is set as 2, the question will be exposed to two users who get this question in the test. This holds good for the test created with random pick of questions resided in a huge question bank. Hide question: SME can hide a question if he/she half completes the question creation and does not wish to expose it to question bank. Secure question: Questions which will be used for final tests is secured by the SME. Secured questions will not be available for the users when they create ‘My tests’ i.e., practice tests. 41 | P a g e Copyright: Gives the information on the organization to which the question belongs to Excelsoft Technologies Pvt. Ltd Confidential Questions in Multiple languages:The SARAS solution supports multi languages or the Localization feature. Questions in any language authored using Unicode fonts enables the system display the questions in the respective language. Custom Metadata: Apart from the metadata pre-defined in the system, there can also be custom metadata defined for every question with a value across each. 42 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 43 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 44 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.4. Import Question - Offline Authoring Offline or Windows based authoring is an easy authoring method. The SME /authors can author the questions on the word document or an excel sheet. Large number of questions can be authored, not depending on the network / internet connections. Authors have to just follow the formatting template to author different question types in the word document or excel sheet. 2.2.4.1. Word Authoring Eight question types are authored through word based authoring. The various question types supported include Multiple choice Multiple response True-false Essay Matching Pull down list Fill in the blanks Matrix While authoring the question types the metadata of the question like the score, hints, feedback, difficulty level, classification, wrong score, question id, time required to answer the question.Shuffling of the choices is set for the questions (containing choices) authored in a word document. Images (only) can also be added as a part of questions or choices in a word document. 45 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Once the questions are formatted in the word document, they are converted to importable form using SARAS Word to QTI Converter tool. The output of conversion is the zip file containing the question QTI xmlsand related digital assets. These zip packages are later imported into thequestion banks. Pre-requisites to run the tool on the system where the conversion happens: .Net Framework 3.0 ,MS Office. The word document should be of 2003 or 2007 version. 46 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.4.2. Excel Sheet Authoring Excel sheet authoring supports authoring of two question types Multiple Choice Multiple Response Here the questions are authored in an Excel sheet, with all the required metadata like question id, hints, feedback, difficulty level, classification, score, time required to answer the question. Though tedious, if required the images can be added with its path mentioned in the relevant excel cell. Once the questions are formatted in the excel sheet, they are converted to importable form using SARAS Excel to QTI Converter tool. The output of conversion is the zip file containing the question QTI xmlsand related digital assets (if any). These zip packages are later imported into thequestion banks. However, it is wise to use the Excel sheet authoring when the question content is textual. 2.2.5. Edit question If there are any modifications in the question, the SME can edit the question. 47 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Assuming a question created is used in the test and has been taken by few students. During the test taking period, if a question is observed to be modified, the test has to be republished. The modified question will be reflected only to the test takers post re-publishing. 2.2.6. Question preview Questions created by the authors are previewed to check the correctness before next actions. 2.2.7. Search & Advanced search Ability to search questions in question banks by keywords, in label, question text, meta-tags like complexity / classification / time / score. And also on topic names, author names, question created date, the questions which are hidden or secured. There can be certain actions performed on the questions searched like, preview and export or delete the question if not up to the mark. 2.2.8. Export The questions are exported onto the local system. The exported questions will be in the QTI format and the same is uploaded in any QTI compatible systems / solutions. 2.2.9. Repository Preview Instead of previewing each question of a repository, all the questions resided in a particular question bank can be previewed at once. If any questions are found duplicate or not authored correctly, they can be removed easily. 2.2.10. Duplicate Search 48 | P a g e Excelsoft Technologies Pvt. Ltd Confidential This feature enables the SME to search those questions which are duplicatedwithin a selected repository or between two repositories. The SME can check for: o content between two questions without any keyword entry for either 100% or 80% or 50% duplication in question text or options. o specific keywords’ duplication within the question text / in the options. This search is based on fuzzy logic. 2.2.11. View History When the questions are correctly created by the SME in the very first attempt the question is set with the version V1. If in case there are any updates to the question, a new version of the question gets created which goes as V2, V3 and so on depending on the number of updates. SME will have an idea of the changes or updates made in each version on comparison with the feature ‘Item Compare’through ‘View History’. The latest version of the question will be available in the item bank for using it in test creation. 49 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.2.12. Delete question Those roles who have the privilege, can delete the questions. On deletion, the questions are not found in the repository. And the question deletion is a soft/logical deletion where the status of deleted questions is set to ‘isdeleted=1’ in the database. The question can be deleted in the following cases: o o o o o o 50 | P a g e Newly created questions Question is created and changes are made i.e., edited Question is used in test creation Question is used in test and published and the test is not taken by any test takers yet. Question is used in test and published and test is started by test takers Question is part of workflow and is published to repository. In this case,only creator can delete the question provided with‘Manage Item’ privilege. Excelsoft Technologies Pvt. Ltd Confidential 2.3. Manage Digital Assets Admin can manage i.e., add, edit, search, preview and delete the digital assets in the system. 2.3.1. Add asset The assets can be uploaded either individually or in multiples. The assets are uploaded to repositories organized through Manage Repository feature. The file(s) to be uploaded are browsed from the local drive path of the system. The details like name and description are added while uploading the asset for its identification. Single asset upload: Multiple assets upload: 51 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Note: Multiple assets upload does not mean, zipping various files like image1, video2, audio3 and uploading. This is not supported in the system. The digital assets added in the system are used in various areas: o Assets like video, audio, flash and images are used in question creation o Assets like document, excel sheets, text files, presentation files, pdfs are used as supplementary resources or additional resources along with the Practice tests. 2.3.2. Preview asset The uploaded asset can be previewed before it is used as part of the questions or as supplementary resources. 2.3.3. Edit asset 52 | P a g e Any changes in the asset details like name and description is possible through edit asset feature. Also, the file can also be replaced if there any changes in the content. Edit happens only on an individual asset. Excelsoft Technologies Pvt. Ltd Confidential Note: If there are any changes in the asset content : As part of question creation, the assets are first imported to the Digital Asset Library which gets stored in ‘Digital Asset Folder (DAF)’ of Database File System. When the same is used while authoring questions it gets stored in ‘Question / Test folder (Q/TF)’ of Database File System. When the asset is updated, it is stored in DAF and not to Q/TF. Hence, the edited assets will not be directly visible in the questions in which they are used. 2.3.4. Search asset When the number of assets added increase in large number within a repository, search functionality helps the Asset manager to search for the right asset for further actions like edit or delete. Asset can be searched by filtering it according to the type or with the name or description as its search keyword. 2.3.5. Delete asset If the asset is not up to the mark then the asset can be deleted from the Asset library. Single or multiple unwanted assets can be deleted at a time.And the asset deletion is a soft/logical deletion where the status of deleted asset is set to ‘isdeleted=1’ in the database As described in ‘Edit asset’ the deletion of an asset does not delete it from the question in which it is used. 2.3.6. Import asset 53 | P a g e At cases, the digital assets are added as knowledge resources to be accessed from mobile devices. If the assets are to be played on mobile devices, the raw content in the word document is converted to QTI xml form and is imported to the system through ‘Import’ functionality. With this the mobile devices need not have plug-in of word reader toview the content of a document. The conversion happens by SARAS Learning material converter tool. Excelsoft Technologies Pvt. Ltd Confidential 2.4. Manage Workflow SARAS Test and Assessment system supports question development via collaborative workflow. Each question development workflow can be set up with a maximum of 5 stages i.e., (create, review, accept, approve and publish) or a minimum of just 2 stages (write and publish). Organization A User who creates the workflow User A1 Tag to Workflow 1 Question Repository(any) Scheduling the workflow for Questions O R Acceptor Creator Reviewer Create T Approver Publisher Tag to A C To Create Test (Any) The actors can vary for different workflows To Accept To Review Creator Workflow 2 Reviewer _ _ _ Workflow n Acceptor To Publish Publisher To Approve Approver Published Questions will be available while creation of test END 2.4.1. Add Workflow The Workflow manager creates the workflow to get quality passed questions published in the question bank for its use in test creation. The various steps to set up an item development project/workflow are as described below along with the screen captures: o 54 | P a g e Step 1: Set up workflow details Excelsoft Technologies Pvt. Ltd Confidential o Step 2: Decide the project group who will work on it (actual users who can be assigned to be writers, reviewers, approvers, etc) o Step 3: Provide a blueprint which defines number of items, type of item and several meta data of those items that the project group has to work on and finally 55 | P a g e Excelsoft Technologies Pvt. Ltd Confidential o Step 4: The project plan to set start and end dates for each user in the workflow. Users can be selected to play more than one role The members who are involved in the workflow play the same role or play different roles in an organization. There can be questions added to multiple subtopics but belonging to same topic, as part of the same workflow process. Once the question workflow is created by a Workflow manager, every stage of an item is recorded in the system. At every stage, the appropriate workflow user who has to take action at that particular stage: can add comments, make any changes and finally accept/reject the item, which will either move it to next/back step in the workflow. Every change made in the item is saved in terms of versions. Workflow usercan compare any 2 versions of an item and check the evolution of an item. 56 | P a g e Excelsoft Technologies Pvt. Ltd Confidential The items are available in item bank and are accessible to the test constructor only after it is approved in the last stage of the workflow process. The system does not directly support the search of items at different stages when part of workflow. However, the dashboard of a workflow provides clear information on the items at different stages i.e., the number of items at each stage of the workflow, progress of the task and items left for completion. Each status message can be clicked to view the actual item to take action on it. The Workflow manager who creates the workflow can know the status of the questions in various stages only if part of the workflow. Below is the list of workflow scenarios that work in the system: o o o o There are 5 members in the workflow. Each have specific task to perform i.e., M1 (Create), M2 (Review),M3 (Approve), M4 (Accept), and M5 (Publish). Just 2 members in the workflow with specific tasks likeM1 (Create), M2 (Publish) to be performed There are 3 members in the workflow with multiple activities attached.i.e.,M1(Create) , M2 (Review and Approve), M3 (Accept and Publish) Assuming there are 10 members, where multiple members are to perform one i.e., M1, M2, M3 (Create), M4, M5 (Review) and so on… Note: There cannot be one person who is set with the task to create the questions and is part of the workflow. In such case, the question development should be outside workflow. 57 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Collaborative item authoring with review process 58 | P a g e Excelsoft Technologies Pvt. Ltd Confidential The process after the workflow creation is captured in the presentation and the video attached. Refer the same. Collaborative Item development Process.ppt (D:\New Year - 2013\Product News on my system) https://www.dropbox.com/s/ow86maui3mccou8/CollaborativeItemDevelopment.zip 2.4.2. View Workflow Allows the Workflow manager who created the workflow to have a view of the workflow for any modifications in the details before the schedule start time. 2.4.3. Extend schedule date If the workflow tasks are not complete within the set project plan, then the workflow manager who created the workflow has the privilege to add a new project plan and extend the dates as required to complete the task. 2.4.4. Delete Workflow 2.5. The workflow can be deleted by the one who creates the workflow only before the schedule start time. However, it cannot be deleted if the scheduled time of the workflow is started and also if it has got expired. The deletion of workflow is a soft/logical deletion. Manage Test Templates Test constructors manage i.e., create, edit, view the availability of questions, and delete the test templates. What are Test templates? : When the volume of questions residing in a repository is huge, it becomes a tedious process to handpick the questions while creating the test. Also same set of questions will be displayed to all the candidates who will take the same test. In order to overcome such a limitation, test templates are used to pick the questions randomly from a repository / topic according to the criteria as definedin the template. Test templates are the Blue prints whilst its use in the collaborative question development process. The usage of test templates is more effective, in High Stake exams to avoid mal practices during the test taking activity at test centers. 2.5.1. Add Test Template 59 | P a g e Excelsoft Technologies Pvt. Ltd Confidential The test templates are created by choosing various pre-defined question metadata like: Topic / Repository of questions, Classification based on Bloom’s taxonomy, Level of question complexity, Type of question, No. of questions and marks across each question. According to the needs, the metadata can be extended. A single test template can include multiple question selection criteria which help the organization identify the performance of an individual in right manner. Eg., if to understand the mastery of an individual on a particular topic, the template can be designed in the way as mentioned below. Topic Taxonomy Difficulty Level Item Type No of Q Marks English > Grammar Knowledge Easy MCQ 10 1 English > Grammar Knowledge Moderate MCQ 10 2 English > Grammar Application Difficult Essay 2 5 However, the test template usage in test is dependent on the availability of the questions in the respective topics / repositories. 60 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.5.2. View the availability of questions in Test Template The test template view feature enables the Test constructors to check if enough questions are available in the repository chosen for a test to be created. 2.5.3. Edit Test Template The test templates can be edited and updated for various metadata details until the test template is used in test creation and is published. 2.5.4. Delete Test Template 2.6. The test templates cannot be deleted once if they are used in test creation. However the test template deletion is a soft / logical deletion. Manage Grade Scheme Test constructors manage i.e., create, view, edit and delete grade schemes. Grade schemes are used in test construction with categorization of score to know the performance of an individual test taker. This helps the education institutions to improve the students’ with lower grades, the corporates to provide the certification for individual’s areas of expertise. Grades are assigned in letters for example, A, B, C, D, or E with the range of scores defined between 0 to 100 and the description as feedback like excellent, great, good, satisfactory, needs improvement to each of the grade levels. 61 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.6.1. Add Grade Scheme The Grade schemes are added by the test constructors as shown 2.6.2. View Grade Scheme The grade scheme once added is viewed to check if it is fine to be included in test construction. 62 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.6.3. Edit Grade Scheme If the grade scheme viewed requires any changes, it can be edited using the feature ‘Edit’ grade scheme. If the grade scheme is used in test and is scheduled or published or test already taken or its results available, the edited grade scheme will not be reflected. 2.6.4. Delete Grade Scheme When the grade scheme created is not suitable, it can be deleted using the feature ‘Delete’ grade scheme. The deletion of the grade scheme will not affect if is used in test and is scheduled or published or test already taken or its results are available. The deletion is soft/logical deletion. 2.7. Manage Test Test constructor/administrator can manage i.e., create, preview, view details, copy, edit and delete tests. Also Print the test. Tests arecreated for test types such as High stakes, Preparatory, DRT with or without templates: NON-TEMPLATE BASED: In this case,the questions are manually picked from the repository based on the test constructor’s choice. The same set of questions will be picked and presented to all the test takers. However, the order of the question can be changed. e.g.,The test having 5 questions Q1, Q2, Q3, Q4, and Q5 is presented to test takers U1, U2, U3 the order of questions is as follows. U1 > Q1, Q2, Q3, Q4, Q5 U2 > Q1, Q2, Q3, Q4, Q5 U3 > Q1, Q2, Q3, Q4, Q5 Check the logic TEMPLATE BASED: In this case, the test is createdfrom the Test Templates managed. The tests are presented in different ways as mentioned below: Same set of items to test takers, by random pick of items by the system based on the test template criteria. Same set of items to test takers, by manual select of items based on the test template criteria. Different items to test takers, by random pick of items by the system based on the test template criteria. 63 | P a g e Excelsoft Technologies Pvt. Ltd Confidential A single test form (set) or multiple sets when the tests have to be more secure can be generated.The sets are automatically generated by the system based on the availability of questions based on the test template criteria or as defined by the test constructor. 2.7.1. Test Construction or Test creation Test creation in SARAS system is followed by six easy steps. These steps include: Test Details: Adding basic information of test such as Test name (Title displayed when the test taker takes a test), Test details, selection of type of test to be catered, selection of the category and products Setting the sections, selection of templates or questions in each of the sections Adding single page or multiple page instructions Choosing the Grade scheme Setting the preferences or rules Applying the style sheet or test player theme Below gives the information on test creation with ability to automatically let the system pick items based on a template, along with the ability to manually replace items to ensure test overall meets item statistics targets. o 64 | P a g e A) Select ‘Generate sets’ check box if you wish to create single or multiple sets (forms) of a test Excelsoft Technologies Pvt. Ltd Confidential i) System generates the sets automatically based on the test template criteria Vs. items available in the item bank. The system generates X no. of sets (forms) automatically based on a logic for the items available in the pool. [e.g. in a pool of 9 items (satisfying the test template criteria), template was set to pick 4 items. There were 4 sets generated automatically. The formula used to generate the sets is as follows: No of questions in item pool or item bank that satisfy the test template criteria No of questions set to be picked in test template 2 Fraction is rounded off to nearest whole number and then multiplied by 2] Note: On scheduling a test to user, the option ‘multiple set’ has to be selected. This will enable our delivery system to randomly pick a form for the student ii) Enter the number of sets to be generated The test administrator defines the number of sets (forms) to be generated. The system automatically picks the items and generates the defined number of sets. 65 | P a g e Excelsoft Technologies Pvt. Ltd Confidential iii) Generate sets choosing preferred items A preferred item here refers to manually selected items by the test form creator/administrator. 2 ways available for the user to choose preferred items (manually select items) A: The items desired by the test creator can be handpicked/manually selected by selecting the Details link > Preferred items, which is available after completion of the test wizard. Or B: Set test rules (Displayed by default with ‘Generate Sets’ option unselected) Under test rules setting there are three options: i) Presents same set of items to students, by random pick of items by the system based on the test template criteria. Example: If the test template is created with the criteria to pick 5 items out of pool of 20 items. On selecting this option, the system generates a set of random items i.e., I1, I5, I6, I9, I20. This randomly picked set (the same set) is presented to all the test takers. ii) Presents same set of items to students, by manual select of items based on the test template criteria. 66 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Example: If the test template is created with the criteria to pick 5 items out of pool of 20 items. On selecting this option, the test administrator is provided an option to hand pick (manually select) the items from the item bank chosen in the test template. The selection of items is manual and the same set (form) is presented to all the test takers. Note: The items preferred for the test are handpicked by selecting the Details link > Preferred items post completion of test creation wizard. iii) Presents different items to test takers, by random pick of items by the system based on the test template criteria. Example: The test template is created with the criteria to pick 5 items out of pool of 20 items of specific meta data (that can be defined in the template). On selecting this option, the system generates a set of random items, such that the probability of the same items appearing to the users is as less as possible (Determined by overall size of item pool) The selection of items is completely randomized and the test takers are presented with different set of items. Note: The output of setting rules i) and ii) look similar, but the process of selection differs. Once the test basic detailing is done, the test sections are set. A test can contain any number of sections and each section can contain any number of questions in it. 67 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Apart from this, the questions in the section can be shuffled if manually picked from test template. Also the time can be set for every section in the test. Next step is in providing the instructions which is either single page or multiple pages. The instructions could be: o o o o o 68 | P a g e The information about the test such as, no. of sections/questions in the test, test duration etc., The learning objective / learning outcome of the test The way the test takers are supposed to navigate when they enter the test taking page. The NDA, terms and conditions to accept before taking the test added in multiple pages. The instructions for tests online and on paper differ. Hence the system provides space to the test constructor to add instructions if the tests are printed for offline tests. Excelsoft Technologies Pvt. Ltd Confidential Next is to attach a grade scheme to the test created. The grade schemes are managed under ‘Manage Grade Scheme’ feature in the system. Later is to attach the preferences for the test created. Preferences under various levels such as Test Presentation, Test Rule, Enforcing time, Test status and Test Results can be set for the test. The detailing is done under the sub-heading ‘Test Preferences’ Lastly is to select a test player theme or style sheet. The test constructor is allowed to choose the pre-defined style sheets. Any new style sheets can be added … how?? 2.7.2. Test Preferences Show hints Allow backward navigation Hints / clues are provided for a/every question while it is authored. A max of three hints can be presented to a test taker. Hints are presented when: - The questions are used in tests as part of learning or practicing of a topic - The questions are difficult, and to make the test takers catch the answers Test taker is allowed to navigate across various sections of the test. If this option is not checked, the test taker will not be allowed to move 69 | P a g e Excelsoft Technologies Pvt. Ltd Confidential back to the previous sections to review the answers before submission. However, the navigation of questions (back and forth) within a section is possible. Allow bookmark in tests Enabling this option helps the Test-taker flag or bookmark questions for which they are not clear on the answers. This could be because the question is time consuming or difficult to answer. Instead of wasting time, test-taker can quickly re- visit the marked question later, before submitting the test Apply Negative marking The questions when authored can be set with negative marks for wrong answers. Every wrong score can be set with different negative marks. More nearer to the answers, less deduction in the scores. Applying negative marks drive the test takers towards answering the questions correctly. This is possible only if the test takers have mastered a topic. This option helps the evaluators understand the level of mastery on a topic of every test taker and in the faster filtration of the test takers by performance. Clear Answers This preference enables the test taker to clear the unsure answers. When the test taker answers a particular question and if not sure of the correct answers, they can clear the answers and choose another option or leave it unanswered. This is quite useful when there is negative marking included for the test. However, the preference ‘All questions should be answered’ should not be enabled with this preference. Enable Item panel Item panel is the display of numbers for the questions in a section / test. This appears to the left-hand side of the test player where it consumes part of the question content area. With this option enabled, the test taker can have a quick look on the total questions available /questions attempted/questions un-attempted as well collapse the panel to increase the content area for proper question view. Enable buzzer before time Buzzer or an alert is set for a test for the test takers to revise, before the time ends for the test. The buzzer time can be set to a max of 59 minutes. Number of items per page This preference helps the test constructor to decide on the number of questions to be displayed / page of the test player. This helps the test taker look into the questions at a stretch and answer them accordingly. Assuming a test of 10 questions is set with 5 questions display / page. When there is power failure or network failure, the responses of only the last question will be resumed on continuing the test post network or power re-gain. Hence, this option is not preferable to be selected. Number of attempts Number of times the test can be re- visited before submission. This option before submission has to be enabled, to ensure the test taker submits the test without any loss in the responses to power or network fluctuations. Allow participants to view Submit button is displayed only after the test takers have spent the time submit button at time level defined. in % e.g., If the total duration of the test is 1 hour and the time level defined is 70 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 50%, the candidates will see the submit button only after spending 30 minutes in the test. This is to make sure that the test takers spend a minimum time in the test and are not allowed to leave the exam hall until the defined time, once the exam is commenced. Display score for question With this option checked, the score of every question is displayed when a test it played. The score for every question is displayed while it is created. This helps the test taker, - know the score for each question and respond accordingly - also calculate the final scoring All questions should be With this option checked, every question in the test has to be answered. answered Test takers will be able to submit only after all questions are attempted with or without skipping the questions.However, if the time elapses, the test is auto-submitted. This becomes important - during question analysis - knowing the performance of test takers under various topics included in the test Enable grouping passage Reading / listening / visual comprehension questions contain a common questions comprehensive content and the related questions. While such questions are authored, the common content is tagged to all the related questions and is saved individually. This option is enabled, to make the questions display as a group for a common comprehensive content. When this option is enabled, the common content is displayed on the lefthand side and the related questions are displayed on the right-hand side of the test player (i.e, Test player is split vertically). This saves the test takers’ time by enabling them go through the content once and answer the questions accordingly. Allow skipping of questions With this option, the test takers are allowed skip the questions within the test. It is not mandatory to answer all questions or in sequence. This helps test takers score better when the negative scoring is attached to the questions. Shuffle questions With this, the questions are shuffled (change in order of the same set of questions)when the same test is presented to different users. However, if any power or network fluctuations, the order of the questions remain same as presented for the first time. This reduces the chance of users copying the answers, as the questions are not presented in the same order. Save the response at the With this option enabled every action of the user is saved for every 2 secs end of each page and details are updated in the database. This makes the users resume the test with regards to theresponses, time and position of the testif there is a power / network failure or fluctuation during their test taking activity. When the test is taken anytime, anywhere and if there are any fluctuations or failure in network experienced, the user gets information 71 | P a g e Excelsoft Technologies Pvt. Ltd Confidential on the non-availability and is forced to close the test. Once the network is regained, the user has to re-login to the SARAS system and continue with the resumed test. More is the fluctuations or failures, more are the relogins. Enable Test Utilities On marking this option, the Test utilities such as calculator and/or notepad are enabled in the test player for test takers to use. Calculator helps the test takers in solving the difficult mathematical problems in a faster way. The notepad can be used to make notes or do rough calculations and/or make an outline of the answer. e.g., While answering an essay question, make notes on the points to be covered based on your ideas, organize and complete the essay. This avoids the revision, for multiple times. Allow participants to view This allows the test takers to view the test submit button only when they submit button at last reach the last question of the test. This is to make sure that the test taker at least goes through all the questions in the test. Enforce timing at various The test created is set with timing at various levels i.e., Test, section, levels question and no limit depending on the type of test. Timing at ‘Test’ level: Defines the total duration of the test and allows the user to answer the questions according to their pace. However, the usercan stay at the same question for the whole test duration. Timing at ‘Section’ level: Defines the time for every section within a test. Once the time for the section completes, the system automatically takes the user to the next section. The user is not allowed to navigate back to the previous sections. However, the user can stay in the same question for the whole section duration. In this case, the test duration is the sum of sections duration. The section time is defined when a section is added for a test. Timing at ‘Question’ level: The system automatically takes the user to the next question once the time set for a question elapse. The time for every question is defined under the metadata ‘time required to answer the question’ during question creation. The test duration is the sum of questions duration. On selection of ‘None’ option the test is set with no time limit. The user can take the test for any longer until submission. This is set for practice tests where the users have to master a topic. Enable online proctoring Essay Evaluation Mode Enable review question 72 | P a g e Evaluation based on text mode Evaluation based on image mode Evaluation based on correction Review questions helps test taker view all questions /No. of questions attempted/ questions un-attempted/book marked before test submission. Excelsoft Technologies Pvt. Ltd Confidential Test taker can revisit the questions and has privilege to change / modify the questions before test submission Enable review response Show grade View solution Test Submit Result view Accept feedback student Configure summary Test taker will not have privilege to change / modify the response posttest submission. With this option enabled, the test player is set to view only mode where the test taker only views the responses which they have answered. This enables the user view their ‘grade’ soon after test submission. The score to grades are managed under ‘Manage Grade scheme’ feature. Every question when authored can be added with a solution which explains how the answer is obtained or deduced. The solution could just be the text/image/video clip/audio clip which explains in detail. With this option enabled,post test submission, the test taker will be allowed to view the solution for the question. The solution could be for the wrong answers or is an alternate path from the test taker’s way of analyzing the question. Allow student to view report in the test Allow students to view progress report in the test Detailed summary Test summary in paragraph Based on the organization or examination needs, the users are allowed to either view their results in detail including the scores orjust the information on the number of questions they have attempted. And/Or Permit the users to view their responses they answered posttest submission with or without the correct responses. from The tests presented are not of the same complexity to each individual test taker. It becomes important to know how complex or how clear the test was. This is made possible by getting the feedback from test takers either at item level or at test level. Accepting the feedback at item level, helps the test constructors in deciding whether the questions have to be the same or to be changed. Also, helps in analyzing the performance/success rates of the item authors. The test evaluators can set a time limit to accept the feedback from the test takers. Results The summary of results for the test / sections / questions in the test can be configured. On check of the type of summary, the test takers will be able to view post test submission. These preferences can be configured, saved and used based on the type of the test created. 73 | P a g e Excelsoft Technologies Pvt. Ltd Confidential e.g., for high stake tests, the preferences such as bookmarking, clear answers, Buzzer, display of scores, view of submit button, online proctoring, display of test summary are set and saved. When the need changes, the preferences can be set accordingly and updated. 2.7.3. Non-Template based test creation Vs. Template based test creation Non-template based Template based On selection on non-template option during test On selection of non-template option during test creation, it allows the generation of multiple sets creation, it does not allow the generation of or forms multiple sets (forms) It is always a single set which is generated. The test constructor can allow the system to 74 | P a g e Excelsoft Technologies Pvt. Ltd Confidential generate the sets / forms automatically. One can enter the number of forms to be created Also, the items selected on the form can be automatically picked by the system OR manually picked by the user. Note that in both cases, they need to conform to the item meta data defined in the template Once the test is created, there can be changes Once the test is created, there can be changes (addition or removal or update) in the following (addition or removal or update) in the following parameters (before scheduling the test) parameters (before scheduling the test) The test details The test sections (addition or deletion of the sections) The no. of items selected for a section in the test (eg: section had 10 Qs, increased to 15 Qs) Add/replace/delete items on the test Re-publish a test, which will automatically make any item edits to be reflected in the test The test details (Test name, Test code and Test details) The test sections (addition or deletion of the sections) Changes to meta-data in the test template (updating the test template) Updating items that will be picked on a form 2.7.4. Edit Test Any modifications in the test with respect to test details or tagged items or any other test data can be updated. Tests can be edited only before it is scheduled to the test takers. While editing, the system checks for any updates in the questions tagged to the test. The test constructor can decide whether to retain the same version or get the latest version of the questions. However, the test has to be republished when the latest version of the questions is chosen. 75 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.7.5. Preview Test The test once created has to be confirmed for its correctness before it is scheduled to the test takers. The ‘Preview’ feature enables the test constructor to preview the test and tryout as if a student. The test constructor can preview the test starting from instructions to submission, including the test preferences set, except for the results. 2.7.6. View Details ‘Details’ feature enables the test admin to quickly understand the details of a test. This includes the information such as Test name, Duration, No. of sections, Total number of item(s), selection mode (template / non-template). Further the details of the section include Section names, Distribution of items based on complexity & classification. Also information on total number of users who are scheduled, who have started, yet to start, users who have submitted the test is displayed. Apart from the above details, the test-republish and IRT processing happens here. 76 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.7.7. Copy Test The test is duplicated by ‘Copy’ test feature. There may be cases where the same test with very few changes in the preference has to be scheduled for two groups. E.g., Users with normal mental behavior are set with x time to answer the test. The same test when presented to the users with special needs would require more time(x + extra time) to answer. In this case, the time information alone changes and the other details remain same. 2.7.8. Print Test 77 | P a g e Excelsoft Technologies Pvt. Ltd Confidential If there is poor / no network /power availability, test admin can print the test that are managed online and conduct paper pen exams. On printing the test created online, the information such as instructions, sections and questions with serial number and score across each is displayed. Along with the test paper, the answers are also printed to assist the markers who mark the scores manually. Extending to this the scores of every individual test taker manually marked is put back to the system through the ‘Score Editor’ feature. 2.7.9. Delete Test Those roles who have the privilege, can delete the tests. The tests which are editable i.e., the tests which are created and not yet published / taken by the users can be deleted. On deletion, the tests are deleted from the repository. The deletion is a soft/logical, where the status of deleted tests is set to ‘isdeleted=1’ in the database. 2.7.10. Test Types 1. High Stake Tests The high stake tests are those which lead to take decisions on, movement to next grade, placement to higher education, placement to the corporate industries or it could also be used to evaluate the teachers/trainers. The major features of High Stake Test delivery are: o o o o o o o o o o 78 | P a g e Collaborative Item Authoring Generation of forms or sets during test management Candidate Verification through biometric devices Test availability for a specific duration Centralized or distributed delivery (explained in next pages of the document) Secure test delivery - Lock down browser Monitoring of tests through Live dashboard Admin control of test takers activities Audit trail Test set with objective type questions (However, the subjective questions included have to undergo manual evaluation process. Otherwise, as per a case-study they are used to know the candidates comprehensive capabilities during foregoing steps of the evaluation process) Excelsoft Technologies Pvt. Ltd Confidential Apart from this in recent days, the high stake tests are not conducted in exam centers alone; instead the candidates can take the test anywhere. In such cases, the ‘Remote proctoring’ of test candidates happen. 2. Test Prep Tests are created and presented to the candidates to enable them learn and master a topic / subject/ program as part of learning process. The major features of Prep Tests delivery are: o o o o o o o o o o o 79 | P a g e Item authoring with combinations of complexity and classification Tests set with one/multiple attempts for practicing Tests at topic/subject/program level Test availability for long duration / until all the attempts complete Centralized delivery (explained in next pages of the document) Support anytime, anywhere test delivery, without any loss in the responses View the progression of the test for various attempts View detailed report View the solution/explanation on how to obtain the answers helping answer the next attempts better Quick view of results in graphical representation Present a summative test post practicing Excelsoft Technologies Pvt. Ltd Confidential o Test set with objective type questions (However, the subjective questions included have to undergo manual evaluation process and this might cause delay in the learning process as the learners have to until the essay is evaluated. If organized properly the subjective questions can also be supported for learning.) 3. DRT DRT represents Diagnose, Remediation, Test. The users are diagnosed at granular level of a subject/program with one or multiple tests, for their strong areas and areas of improvement. Post diagnosis, the users are provided with remediation to improve the weak areas. Once the user views progression, they take the Mock test to know their final like results. This kind of test model is quite useful to those who are preparing for the competitive exams. The major features of DRT Tests delivery are: o o o o o o o o o o o o Item authoring with combinations of complexity and classification Item bank of questions with granular level structuring Test availability? Centralized delivery (explained in next pages of the document) Support anytime, anywhere test delivery, without any loss in the responses View the strong area and areas of improvement report Remediation could be solution or explanation for every question/ connect to sessions / read the study material tagged at topic or subject level View progression and detailed report during remediation Quick view of results in graphical representation Mock tests are run-through of the real tests Mock test results viewed as if the real results, helps know the position or ranking Test set with objective type questions 4. Survey Survey test is used to gather the opinions or suggestions which could be on an organization/an event/a subject/a program. Survey test created does not require any authentication if presented for public opinion. Such tests need not be scheduled, the same is accessed by a URL and the users need not use the login credentials to take the survey test. Instead they enter their details to take the surveys and give their opinions. However, the Surveys can be presented to a closed group within an organization and this requires authentication. Survey can contain objective questions where the user is allowed to choose and subjective to express their thoughts. 80 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 5. Adaptive test The Adaptive test created in SARAS system is based on the grade scheme. Test templates are managed and tagged at various grade levels. Initially a set of questions (randomly from a base test template) is presented to the user. Based on their performance or grade obtained the next set of questions (templates tagged to the respective grades) are presented. The test templates and the grades are managed and mapped manually by the Test constructor. The objective question types alone are used in SARAS Adaptive tests for the instant response processing happens for every set of questions, identify the grade and present the next relevant template. Creating Adaptive Tests using IRT theory is part of SARAS Test and Assessment product roadmap. 6. Assignment 2.8. Assignments are used when the responses are expected to be more elaborative or descriptive with supporting resources or content. The users are required to use the file resources such as image/document/excel sheets/power point presentations as defined by the test constructor. For the same, the users work offline on any of the files and later upload it as a part of response for the question. Only ‘File Upload’ questions are used for assignment. Assignments are usually set with duration in terms of days. Schedule Tests The tests which are created and have (have not) passed through the review process are assigned to users either individual or in batch, to be taken on a particular date if high stakes and time or for a specific duration if for preparatory. The flexibility is provided for the candidates when the test is scheduled. The schedule of a test is dependent on the type of test, and the delivery mode i.e, centralized or distributed.Also, the test scheduling is based on the UTC time system which enables scheduling to user groups across different geographical areas. 81 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Below screen capture indicates the search user facility available during test scheduling. Explained with an example are the scenarios of scheduling Assuming Test duration: 3 hours; 82 | P a g e Test start time: 9:00 am; Test end time: 12:00 pm All users start test exactly at 9:00 am and end the test at 12:00 pm. Users appear to the test anytime between 9:00 am to 12:00 pm and complete the test for the remaining schedule time. i.e, user starting test at 9:00 am will have complete 3 hours while, if starts at 11:00 am user will have just an hour’s duration to complete the test. Excelsoft Technologies Pvt. Ltd Confidential Tests available to group of users at specific date and time o o o Candidates are already in the system and the tests are scheduled. Tests are scheduled for anunknown list of users and login information is generated, which is used by the candidates while taking high stake tests. With this the candidates need to enter their information before taking the test. On Fly Schedule – where in the test is created and is available for the users who are registered into the solution. While scheduling for the practice tests, number of attempts is mentioned. This would enable thecandidates to take a practice test for n number of times. The same test would be available with the same set of questions but in a shuffled manner When large number of users have to be scheduled,the data management happens through excel sheet containing the details of users, date time, test. The schedules tests can be viewed for the details as shown below. 2.8.1. Test Priority At times, the users are assessed not by just one test, but with multiple tests. When multiple sets are scheduled, it is left to the user to choose the test they prefer to answer first. Otherwise, if the order of the test has to be followed by all the users then the arrangement of test becomes important. This may also be made dependent on the previous tests’ results. To make tests more secure the access code for a schedule can be generated by the test admin. e.g. The users are set to take 2 tests, with Test X first and Test Y later. Users can move to Test Y only if they score 50% in Test X. 2.9. Candidate Verification / Registration Particularly High Stake tests are conducted in Test centers. The candidates to attend the test would have registered online individually or through the organization. In order to verify and confirm the candidates to take test in the test centers, candidate verification process is carried out by the test center admin orproctor on the test day, 83 | P a g e Excelsoft Technologies Pvt. Ltd Confidential The various mechanisms used for verification are: Photo Capture and Match: The candidates are supposed to upload their photographs during the process of registration to the organization or to the test. On the test day, the test center admin takes the photograph of the test attendee and manually matches the two photographs. Finger Print Verification: This happens similar to photo capture as mentioned above where finger print capture device is used. User Details verification: The candidate would have entered the details while registration process. On the test day, the candidate is verified for the online registered details manually against the supporting documents. The biometric verifications like photo and finger print requires the supporting software installations on the canter admin machine. Only if the candidates are verified, the center admin register the candidates to take the test. 2.10. Reports 2.10.1. Data Forensics The below mentioned data of SARAS Test and Assessment system are captured in the database. Based on the need and the type, the reports are customizable. Data about Test taker Login credentials E-mail address Test taker First Name, Last Name Other Test taker demographic information like Gender, DOB, Photo snap, Organization, Batch they belong to Post Test taking data : Score and percentage obtained , No. of questions attempted , correctly / wrongly answered, No. of questions un-attempted and unseen, No of times test is resumed before submission due to power or n/w failure, time spent on every item, time spent on the test, start time of the test, end time of the test. Information about Items Item Label Item score: Score for each question which can have +ve numbers for correct score and -ve / 0 / decimal score for wrong answers, Answer key or correct answer Item type (e.g., multiple-choice, true or false, …) Item language type Item response time Clear responses while taking test Order in which the item was presented 84 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Maximum score for each item Preferences of question like complexity, classification, time allotted (optional), copyright information, item activation period, item exposure limit, shuffle choices Item is scored or not The item bank from which the item is picked from Item Author, How many times this item was rejected, Item used in how many tests, Item Rubrics, used in what kind of tests, how many users answered it correct, how many users answered it incorrect, how many times this item was presented, how many users have seen this , not seen this.. Information about the Test Test identifier Test details like Test name, No. of sections, No. of Questions, Test Duration, Test Max score, Test Instructions, selection of selected questions or randomized questions Cut-score for pass/fail decision The preferences set to the test like, display score, allow bookmark, Enable Buzzer, Save responses, allow backward navigation, enforce answering all questions, view test summary immediately after test submission or not, allow test takers to view Submit button after certain test time, allow participants to view submit button at last question Theme of the test player Data about the Test Schedule Date of test Test score Time of day test was administered Duration of the test schedule Test delivery method (e.g., online / distributed ) No. of students assigned to the test Information about the Test center / location Test site or location code Location information like, Country, state, city Proctors tagged to the center Below is the list of standard reports available in the system. However, based on the need of the organization or the exam, the reports are customizable. The reports generated are easily exportable to Excel sheet, Word document and HTML file format. Also, can be printed. 2.10.2. Pre Exam Report Scheduled User details 85 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 86 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2.10.3. During Exam Report Test Monitoring Dashboard Following the above figure, ‘Total candidates’ details 87 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Submitted candidates details 2.10.4. PostExam Reports 1. Participant Report 88 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 2. Score List Report 89 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 3. Transcript Report 90 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 4. Participant Analysis Report 5. Participant Consolidated Report 91 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 6. Test Results by Participants 92 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 7. Attendance and Absent Report 93 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 8. Score Report 9. Response Report 94 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 10. Summary Report 95 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 11. User-wise Performance test 96 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 12. Individual score report 97 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 13. Advanced Report of Individual Score report 14. IRT Reports The IRT Reports Item Information function (IIF), Item Characteristic Curve (ICC) and test information function generate are based on the Discrimination (a), Difficulty (b) and Guessing factor(c) values. o 98 | P a g e Item Information function (IIF):The information function of a given item will be at its maximum for individuals whose ability is at or near the value of the difficulty parameter. Item information functions tend to look bell-shaped. Highly discriminating items have tall, narrow information functions; they contribute greatly but over a narrow range. Less discriminating items provide less information but over a wider range. Excelsoft Technologies Pvt. Ltd Confidential o 99 | P a g e Item Characteristic Curve (ICC): is the basic building block of Item Response Theory. This plot is drawn for each item (item). Many terminologies derived in IRT depend on this curve. The x-axis indicates examinee (student) ability and y-axis indicates probability of answering the item. Excelsoft Technologies Pvt. Ltd Confidential o The Test information function(TIF): is simply the sum of the information functions of the items on the exam. Using this property with a large item bank, test information functions can be shaped to control very precisely. Summation of all the item information functions, Index of how much information a test is providing a given trait level , The more items at a given trait level the more information is obtained. 100 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.1. Offline Test An option is provided for the users to download a test and play the same in an offline mode. For an instance an Admin can download the test and provide the downloaded package to the candidate for taking the test. The candidate who is taking the test will have no access to internet. They can play the test in an offline mode and proceed with the answering of the questions. The responses are saved in an xml file, whichis later uploaded by the admin into the SARAS T and A solution to update the results of the candidate. 14.2. Test Delivery Modes 14.2.1. Centralized The Centralized mode of delivery is chosen where a centralized server is used to author items , manage tests, manage users/batch, manage schedules , verify/permit the users to take test,allow users take test and view reports. This mode of delivery includes various components such as: – – 101 | P a g e Controller of Examination CoE : The activities like authoring questions, manage templates, manage customer, manage tests, scheduling, batches and users are performed Data Exchange Server: Registering the test center from CoE, Validate the Test Center by accepting its MACID, Provide spaces for CoE to upload packages, Data Center Centralized to download packages. Excelsoft Technologies Pvt. Ltd Confidential – Data Center – Centralized: Centralized packages will be downloaded, via FTP from Data Exchange Server. Later the packages are extracted and data is loaded into the database. Then administrators can register the candidate and allow them to take test and view the reposts post submission. Below diagram shows the centralized mode of delivery process through different components. Below diagram depicts the functional architecture of Centralized test delivery 102 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.2.2. Distributed In Distributed mode of delivery, the Load on the single centralized server is distributed acrossmultiple servers at various test centers. This enables huge concurrency since the load is distributed on each Test Center.Interim reporting servers enableadmin to view the report of the tests of distributed delivery mode. And at EOD, the whole reportsare available in Centralized report interface. This mode of delivery includes various components such as: – – – 103 | P a g e Controller of Examination CoE : The activities like authoring questions, manage templates, manage customer, manage tests, scheduling, batches and users are performed Data Exchange Server: Registering the test center from CoE, Validate the Test Center by accepting its MACID, Provide spaces for CoE to upload packages, Data Center Centralized to download packages. Data Center – Centralized: Distributed packages will be downloaded, via FTP from Data Exchange Server. Later the packages are extracted and data is loaded into the database. The reports of distributed events can be viewed here. Excelsoft Technologies Pvt. Ltd Confidential – – Data Center – Distributed: An interim reporting server where reports for the distributed events are viewed. Test Center: Distributed packages will be downloaded, via FTP from Data Exchange server. Later, the packages will be extracted and data will be loaded into the database. Test center administrators register the candidate of the distributed batch and allow them to take test.Results packages will be generated and then be uploaded, via FTP to Data exchange server. Below diagram shows the distributed mode of delivery process through different components Below diagram depicts the functional architecture of Distributed test delivery 104 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Test Center Architecture 105 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.3. Monitoring Dashboard A dashboard is available for the Admin to monitor the High Stake exams. The dashboard provides information on the status of the registration for candidates, how many of them have started the test, how many of them have submitted etc. This also has a feature of extending the schedule end time if required. I.e. the Admin can change the end time of the schedule and the test will be available for the candidates till the updated end time of the schedule. 106 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.4. Test player features Below are the features of the SARAS test player: Feature Save Response Bookmark Loading of Questions 107 | P a g e Description If Save Response option is enabled, in case of power /network failure the responses are saved for the questions which are attempted by the candidate, once the connection and system are resumed the candidate can attempt the remaining questions and then submit the test. It is an option available on the test player which helps the Candidate flag or bookmark questions for which they are not clear on the answers, while taking test. Candidate visits the marked question later before submitting the test When a test is presented to the end user, the questions/ images/ audio/ video content first gets loaded onto the test player and then the test time starts ticking. So, there is no time lost for the Candidate during loading the questions. Excelsoft Technologies Pvt. Ltd Confidential Mandatory answering of all The Candidates can be forced to answer all the questions with or the questions without skipping the questions and then submit the test. This is configurable Question navigation panel The Candidates can navigate through the questions in the test player through the question navigation panel available on the test player Question attempted or not - The test player gets the questions highlighted for the questions which attempted are attempted in the question navigation panel. Also, the number of the questions attempted will be displayed Timer The count-down timer is displayed in the test player. This ticks initially only after all the questions have been downloaded. The timer starts from where it was left out when there is network / power failure. Providing more Question The Candidates can collapse the question navigation panel, which content Area makes more space for the question content Short Cut Keys The navigation to the questions in the test player is also enabled with the shortcut keys. Sections/Blocks for a test The test player supports the section wise test i.e. blocks which has a section name or a topic name and in which the respective questions related to the section is presented. Max number of questions There can be a maximum of 100 Questions played per section. And a total of 360 questions played per test Maximum number of Sections There can be a maximum of 9 sections in a Test Questions in single page or Questions can be displayed in single page or multiple pages for a test. multiple pages Max number of questions A restriction can be set to enforce Candidates attempt maximum number of questions in a test and only then allow test submission. Multi Language Support Test player supports multi languages and hence the questions in various languages can be presented in the test. Auto submission on test time Enabling question level time enforcement for tests moves the elapse Candidates to the next questions once the present question time is up. Similarly, the test player automatically submits the test once the test duration set is complete Screen Display The test is displayed in the test player in full screen and it’s not possible to maximize or minimize the screen till the test is submitted unless there is a power failure. Menu options on the Browser The Menu options on the browser are disabled. This would restrict the user to use any of the options available on the browser such as Back, Refresh etc Disable Keys Disabling key functions such as right click options, tab keys, control keys, when the test is being taken by the candidate on a test player. Copy / paste options would also be disabled. Print Screen Option Disabled The print screen option will not be working when the test taking activity is going on. View Test Summary Test summary report will be displayed to the candidates after the test is submitted. Browser Compatibility Test Players compatible with IE6, IE 7 and Mozilla 2.0 and 3.0 108 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Resolution Compatibility Single User Login Test players can run in any resolution on the desktop system A login credential of a candidate used to take the test is just for the single user login. No two users can use the same credentials to login from different locations. Backward Navigation The candidates are allowed to go to the previous section in the test player. This is configurable. Registration Page For the tests scheduled for Walk in users, a Mandatory Information form is provided in the test player before the candidate takes the test. Only after filling in the required details in the page the walk-in candidate can proceed with the test taking activity. Accessibility Depending on the target users, the font of the questions is decided during its authoring. The varied font feature in the test player helps user increase or decrease the font during test taking for more clarity during test taking. Exam Utilities The exam utilities such as calculator or/and notepad are used by users for easy and fast solving of problems. Filtration of questions During test taking, the user can quickly filter the questions which have been bookmarked / attempted/ yet to be attempted / All View Solution When users take practice tests, if the questions are set with solutions, the solutions can be viewed post-test submission. Provide Feedback with time On Test submission, the users can provide the feedback either at item set or test level. This is configurable. Instruction page The Instruction page appears before the users actually enter the test taking page. Navigation buttons User is enabled with easy navigation with the Next, Previous navigation buttons Built on HTML5 This enables various revamped questions types on SARAS like Drag and Drop/Connect the points to be played without the Java plugin. Personal information of user The personal information of user such as Name and photograph is displayed. Screen Capture of During Test Taking features 109 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 110 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Screen Capture of Post Test Submission features 111 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 112 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.5. Customer Account Settings The SARAS Test and Assessment system caters to various E-learning organizations such as Educational institutions, Test-Prep Organizations, High Stake Exam conducting organizations, Corporates. Every such organizationhas its own business requirements. All the features and functionalities in the system may not be useful. Hence, based on the needs, the customers’ account is managed under ‘Customer Account settings’ feature. 113 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Each customer account has a variety of settings which has to be configured when an organization is created. The settings could be on selection of the type of questions or the preferences of the item or the fields to be displayed while an organization is created and so on. This is also extended in configuring the General controls for the selected customer. 114 | P a g e Excelsoft Technologies Pvt. Ltd Confidential 14.6. Personalization The personalization varies from Admin to the end user in the system. The Admins can change their passwords at any point in time. Also, set the default paging size for the listing pages such as Manage user. Apart from this, the Admin can decide the language the application to be presented for their customers’ who are geographically distributed. At the user level, the personalization is set with changing the passwords only. 14.7. Online Proctoring The word ‘Proctor’ means supervising an exam. Any exam which is held in an examination hall or the test center, needs proctoring. Proctoring is required for there are chances of some of the test takers cheat and pass their examinations with good scores which brings down the scores of the genuine hard working test takers. When it comes to proctoring done physically by a proctor or invigilator, they can easily identify the person cheating and check/allow them to resume the test once the copy materials are taken / snatch the papers and end the test for the test taker. As most of the examinations in recent days are online, it’s important to monitor and control the activities of the test takers online. This is possible in SARAS Test and Assessment system through ‘Online Proctoring’ feature. The Admin is created with a privilege to proctor and control the online test taker activities. The proctor enters the details of all the users and the test they are taking online. In the same hall there can be users who take the same test or different test. (e.g., at schools, students of various classes are grouped to take exams). 115 | P a g e Excelsoft Technologies Pvt. Ltd Confidential Proctor views the total no. of questions in the test, and can perform the activities on a cheating test taker, which includes: Pause: Pause the test for selected test taker. Test taker is stopped from taking the test and views a time counting down to zero, post which the test is resumed. The timer stops when test is paused. Resume: Proctor allows the test taker to resume the test with regards to time and the questions responded. Suspend: Proctor stops the test taker from taking the test. Results are generated only for the responses before suspension. Add time: Proctor provides additional time if any test taker requires. The same gets reflected in test taker reports as well. Status: Displays test taking status such as ‘started’, ‘in progress’, ‘submitted’ Page refresh: Page refreshes automatically once in every 30 seconds to retrieve the test status. Or the page can be refreshed manually. Clear list: The list of all the test takers will be cleared to view the new list of users. 116 | P a g e Excelsoft Technologies Pvt. Ltd Confidential
© Copyright 2026 Paperzz