SARAS TEST and ASSESSMENT Product Features

SARAS TEST and
ASSESSMENT
Product Features
Author: Meenakshi M C
Product Manager – SARAS Test and Assessment
Contents
1.
Administrative Activities ....................................................................................................................... 5
1.1.
1.1.1
Add ........................................................................................................................................ 6
1.1.2
Edit ........................................................................................................................................ 6
1.1.3
Block ...................................................................................................................................... 6
1.1.4
Activation Period ................................................................................................................... 7
1.1.5
Delete .................................................................................................................................... 7
1.2.
Manage Role ................................................................................................................................. 7
1.2.1.
Add ........................................................................................................................................ 8
1.2.2.
Edit ........................................................................................................................................ 9
1.2.3.
Delete .................................................................................................................................... 9
1.3.
Manage User ............................................................................................................................... 10
1.3.1.
Add ...................................................................................................................................... 11
1.3.2.
Edit ...................................................................................................................................... 13
1.3.3.
Delete .................................................................................................................................. 13
1.3.4.
View Password .................................................................................................................... 13
1.3.5.
Export .................................................................................................................................. 13
1.4.
Manage Batch ............................................................................................................................. 14
1.4.1.
Add ...................................................................................................................................... 14
1.4.2.
Edit ...................................................................................................................................... 14
1.4.3.
Delete .................................................................................................................................. 14
1.4.4.
Tag / Untag Users ................................................................................................................ 14
1.5.
2.
Manage Customer......................................................................................................................... 5
Manage Product.......................................................................................................................... 14
Content Management ......................................................................................................................... 16
2.1.
Manage Repository ..................................................................................................................... 16
2.1.1.
Add Repository .................................................................................................................... 17
2.1.2.
Edit Repository .................................................................................................................... 17
2.1.3.
Share Repository ................................................................................................................. 17
2.1.4.
Delete Repository................................................................................................................ 18
2.2.
Manage Question........................................................................................................................ 18
1|Page
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.
Question Types ................................................................................................................... 18
2.2.2.
Add question - Web based authoring ................................................................................. 39
2.2.3.
Data about a question......................................................................................................... 39
2.2.4.
Import Question - Offline Authoring................................................................................... 45
2.2.5.
Edit question ....................................................................................................................... 47
2.2.6.
Question preview ................................................................................................................ 48
2.2.7.
Search & Advanced search.................................................................................................. 48
2.2.8.
Export .................................................................................................................................. 48
2.2.9.
Repository Preview ............................................................................................................. 48
2.2.10.
Duplicate Search ................................................................................................................. 48
2.2.11.
View History ........................................................................................................................ 49
2.2.12.
Delete question ................................................................................................................... 50
2.3.
Manage Digital Assets ................................................................................................................. 51
2.3.1.
Add asset ............................................................................................................................. 51
2.3.2.
Preview asset ...................................................................................................................... 52
2.3.3.
Edit asset ............................................................................................................................. 52
2.3.4.
Search asset ........................................................................................................................ 53
2.3.5.
Delete asset......................................................................................................................... 53
2.3.6.
Import asset ........................................................................................................................ 53
2.4.
Manage Workflow ...................................................................................................................... 54
2.4.1.
Add Workflow ..................................................................................................................... 54
2.4.2.
View Workflow .................................................................................................................... 59
2.4.3.
Extend schedule date .......................................................................................................... 59
2.4.4.
Delete Workflow ................................................................................................................. 59
2.5.
Manage Test Templates .............................................................................................................. 59
2.5.1.
Add Test Template .............................................................................................................. 59
2.5.2.
View the availability of questions in Test Template ........................................................... 61
2.5.3.
Edit Test Template .............................................................................................................. 61
2.5.4.
Delete Test Template .......................................................................................................... 61
2.6.
Manage Grade Scheme ............................................................................................................... 61
2.6.1.
Add Grade Scheme.............................................................................................................. 62
2.6.2.
View Grade Scheme ............................................................................................................ 62
2|Page
Excelsoft Technologies Pvt. Ltd
Confidential
2.6.3.
Edit Grade Scheme .............................................................................................................. 63
2.6.4.
Delete Grade Scheme ......................................................................................................... 63
2.7.
Manage Test................................................................................................................................ 63
2.7.1.
Test Construction or Test creation...................................................................................... 64
2.7.2.
Test Preferences ................................................................................................................. 69
2.7.3.
Non-Template based test creation Vs. Template based test creation ............................... 74
2.7.4.
Edit Test............................................................................................................................... 75
2.7.5.
Preview Test ........................................................................................................................ 76
2.7.6.
View Details......................................................................................................................... 76
2.7.7.
Copy Test ............................................................................................................................. 77
2.7.8.
Print Test ............................................................................................................................. 77
2.7.9.
Delete Test .......................................................................................................................... 78
2.7.10.
Test Types ........................................................................................................................... 78
2.8.
Schedule Tests............................................................................................................................. 81
2.8.1.
2.9.
Test Priority ......................................................................................................................... 83
Candidate Verification / Registration ......................................................................................... 83
2.10.
Reports .................................................................................................................................... 84
2.10.1.
Data Forensics ..................................................................................................................... 84
2.10.2.
Pre Exam Report ................................................................................................................. 85
2.10.3.
During Exam Report ............................................................................................................ 87
2.10.4.
Post Exam Reports .............................................................................................................. 88
14.1.
Offline Test ............................................................................................................................ 101
14.2.
Test Delivery Modes.............................................................................................................. 101
14.2.1.
Centralized ........................................................................................................................ 101
14.2.2.
Distributed ........................................................................................................................ 103
14.3.
Monitoring Dashboard .......................................................................................................... 106
14.4.
Test player features .............................................................................................................. 107
14.5.
Customer Account Settings ................................................................................................... 113
14.6.
Personalization ...................................................................................................................... 115
14.7.
Online Proctoring .................................................................................................................. 115
14.8.
Secured Browser ........................................................................ Error! Bookmark not defined.
3|Page
Excelsoft Technologies Pvt. Ltd
Confidential
4|Page
Excelsoft Technologies Pvt. Ltd
Confidential
1. Administrative Activities
1.1.
Manage Customer
Organization/ Customersare created and managed by the Super Admin or Application Admin in the
solution. This helps in maintaining a solution through a central administration. This in turn helps in the
communication, content sharing across organizations and its users.
Super
Organization
Add Organization
Organization 1
Organization 2
Share
Repositories /
Communication
Organization 3
_
_
_
Organization n
Admin can manage i.e., add, edit, set activation period, block and delete organization or customers in
the system.
Also, Super Admin can easily manage roles, users, licenses required, whilst customer management.
5|Page
Excelsoft Technologies Pvt. Ltd
Confidential
1.1.1 Add




Addition of a new customer into the system with details including name, geographical
location, and the contact details. As part of branding, the customer logo can be uploaded.
The roles for a customer can be created by the Super Admin and inherit those roles while
managing their customer details.
Also, the theme or the style sheet or look and feel of the application can be chosen from the
pre-defined list by the Super Admin whilst customer creation.
If in case to contact particular person in an organization, the Super Admin can key in the
persons’ contact details.
1.1.2 Edit

Once the customer or organization is created, and if any changes in the details are observed,
the Super Admin can easily modify the details.
1.1.3 Block

6|Page
For reasons (if found untrustworthy, not made payments, license expires) the customer can
be blocked. On blocking the users of the organization will not be able to use the system.
However, the Super Admin can unblock the customer to use the system at any point.
Excelsoft Technologies Pvt. Ltd
Confidential
1.1.4 Activation Period

Based on the organization licensing, the activation period can be set. However, the
organization can be blocked within the set activation period.
1.1.5 Delete

1.2.
For reasons (no more a customer) the customer can be deleted. On deletion, the users of
the organization will not have an access to the system anytime in future. Post deletion, the
Admin will not be able to view the customer details in the system.
The deleted details however are saved in the database with a bit ’isdeleted’ set to 1
Manage Role
For an organization, different roles are defined for whom privileges are set accordingly. The privileges
are actually the tasks which have to be performed by the user who is defined for a particular role.
Organization
Roles in an Organization
Add Roles
Teacher / SME /
Author
Invigilators
Evaluators
Test Taker
[[Define Role]]
and set
privileges
Admin can manage i.e., add, edit and delete roles for an organization.Roles are defined with specific
privileges.
7|Page
Excelsoft Technologies Pvt. Ltd
Confidential
1.2.1. Add


8|Page
The system basically allows creation to two role types. The ‘Power user’ who is set with
the required administrative privileges. The ‘End user’ who is set with test delivery
privileges.
When an organization is created, it becomes mandatory for the application admin to
create a role with required admin privileges to manage the individual organization.
Excelsoft Technologies Pvt. Ltd
Confidential
1.2.2. Edit

The existing roles if assigned or de-allocated with their privileges, Admin edits the role
privileges.
1.2.3. Delete

9|Page
If the organization does not hold a particular role any more, the role can be deleted by the
admin. Prior to role deletion, all the users tagged to the role should be deleted. On deletion,
Excelsoft Technologies Pvt. Ltd
Confidential
those role users will not have an access to the system anytime in future. Post deletion, the
Admin will not be able to view the roles details in the system.
The deleted details however are saved in the database with a bit ’isdeleted’ set to 1
1.3.
Manage User
Super Admin / Organization Admin can manage i.e., add, edit and deleteusers in the system.
Organization
Users in an Organization
Admin 1
performs
Roles defined in an
Organization
CenterAdmin
Admin 2
performs
Teacher 1
performs
Add User
Teacher
performs
Teacher 2
performs
Evaluator
Evaluator 1
_
_
_
_
Test taker
performs
Student 1
_
_
_
_
performs
Student n
10 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
1.3.1. Add
The users are added for an organization in either of the modes mentioned below:
1.3.1.1.
Individual Add User

11 | P a g e
A single user when required to be added into the system, happens through Individual user
addition mode. During addition, the user profile along with the organization to which (s)he
belongs to, the role they perform in the organization and the credentials to login to the
system are also added. The Login ID / Username is the unique Id for any user created in the
system. The password for the user is well decided by the Admin.
Excelsoft Technologies Pvt. Ltd
Confidential
1.3.1.2.
Import Users:

1.3.1.3.
Bulk Add User:

12 | P a g e
Users in large numbers,around 4000-5000 users are added into the system through a
.csv file with the user details in a required format. If the users are added to a Batch
around 500 users can be imported at a single point in time.
Users joining the system in batches are added through bulk import. Can add up to 10
users at a time
Excelsoft Technologies Pvt. Ltd
Confidential
1.3.2. Edit

Change in any detail of an individual user is editable. However, the username(id to login to the
system) can be edited only if not existing in the system.
1.3.3. Delete

If the user has left the organization for any reasons, the user details can be deleted. The users
can be deleted individually or in bulk. Any user who is deleted will not have an access to enter
the system. However, the deleted user details are available in the database with ‘isdeleted’ bit
set to 1.
1.3.4. View Password

If in case the password is lost, the user can contact the Admin to get password. With this, the
Admin can search the particular user details and mail the password to respective user’s mail id.
1.3.5. Export

The user details can be exported to excel sheet.
13 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
1.4.

Manage Batch
Super Admin / Organization Admin can manage i.e., add, edit and delete batches or group of
users in the system. The grouping can be on the similar performing users / users of same subject
or course / or any others
1.4.1. Add

The groups/batches are added for an organization through ‘Add Batch’ feature. An empty group
can be created and the users can be tagged later. As well, the users can be grouped directly to
an existing group when the users are added in the system through ‘Manage Users’ feature.
The batches created have just single hierarchy. There can any number of users added to a batch.
A single user can exist in multiple batches.
1.4.2. Edit

The batches created can be edited for its details through ‘Edit Batch’ feature. The edited details
get reflected on the
1.4.3. Delete

The batches created can be deleted if the batch does not exist anymore through ‘Delete Batch’
feature. When the batch is deleted the users in the batch get untagged but not deleted and they
have an access to enter the system yet. However, the deleted batch details are available in the
database with ‘isdeleted’ bit set to 1.
1.4.4. Tag / Untag Users

1.5.

The new users to the system can be tagged to one or more batches. Likewise, the users who are
not part of the batch or moved to another batch can be untagged from the batch.
Manage Product
The Organization Admin manages (i.e, Add, Edit, Delete) the product under various categories
of programs / courses the users to be assessed on.
e.g.: under the main category ‘Certification’, the sub categories are Microsoft certifications,
Oracle certifications, Adobe certifications and so on. And under Microsoft certifications, various
products are MCTS, MCITP. Various exams are attached under each of these products.
14 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
It is must to manage the categories/sub-categories before managing the products. Based on the
organization’s needs, products can be used to manage the high stake or test prep exams. As
well, the licenses to conduct the examination over a product can also be managed.
15 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2. Content Management
2.1.

Manage Repository
Admin can manage i.e., add, edit, share and delete repositories. It also helps admin organize the
repositories of content in a required structure.
Organization A
User A1
Repository Structure
Digital
Assets
DigiAsset 1
Organization B
DA Child 1.1
Share
Add Repository
DA Child 1.2
User B1
DigiAsset n
Share
Item
Organization C
Item 1
Share
Item 1.1
User C1
Item 1.2
Item n
Test
Test 1
Test 1.1
Test 1.2
Test n
Share
User A2
The system has four staged repositories namely, Digital Assets, Item (Question), Test template,
Test. The content stored in digital asset repository is used in question management. Questions
are used to create the test template or used in creation of tests. Tests can also be directly
created from the questions picked from question repository.
16 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.1.1. Add Repository

The repositories are the structured folders to store the content like digital assets, questions or
items, test templates and tests. The repositories created are either based on the curriculum
structure of the school syllabi, or it could be on the Subjects, Topic, Sub-topic and so on
structuring or it could be the competency vs. skills categorization. It could also be on the target
audience. So it is left to the flexibility of the admin who defines the repository structure to
define it.
The repository treeis built to ‘n’ sub-level s. Repository at any level can have any number of data
in it.
The repositories created by organization admins are accessible by the application or the super
admin, but not to other organization admins.
For e.g., there are around 7000 no. of questions stored in one of the repositories used by one of
our customers (MGU)
The limit on number of nodes is set when building the repository structure. Repository activation period: The
repository life time are set, which as well means to be the life time of the questions in the repository
2.1.2. Edit Repository

The repository details added can be edited at any point in time.
2.1.3. Share Repository

The super admin can share the repositories to different organization on selection. Provided the
privilege, one organization admin can share the repositories of one organization to another
organization where the organizations cater similar services.
17 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.1.4. Delete Repository

The repository having content in it can be deleted at any point in time. However, double
confirmation happens on the repository to be deleted. If the main repository is deleted, all its
sub-repositories and contents are deleted.
If in case, the questions in repository used in tests, and the repository is deleted, there is no
effect on the test which is already created, or the test which is published or been taken by the
test takers and also in the results.
Only the repository will get deleted, but not the content wherever used. The deletion of
repository is soft/logical deletion.
2.2.
Manage Question
Subject Matter experts / Authors can manage i.e., create, edit,search, import, exportand delete
questions
Organization A
Author creates the
questions
Author
Go to Question
Management Area
Search
Questions
Metadata such as score,
hints, feedback, difficulty
level, classification are
selected for a question.
Move questions
across the
repository.
Author Qs
24 + 6
(programming
Q types) can
be added.
Web based :
Add Question
Digital
Assets
Image, audio, video or
flash file can be
selected and the same
can be added as a part
of the question
Question
Repository
End
Tag
workflows
to the Qs
Windows based : Import
(QTI compliance)
Questions. 5 Q Types
can be authored
2.2.1. Question Types
Questions created in SARAS system are compliant to QTI (Question and Test interoperability) standards
and are of version 1.2. SARAS supports creation of different types of questions including both objective
and subjective types.. Below is the list of supported question types.
18 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.
Objective question types
2.2.1.1.1.
Multiple choices static
o
Include


Question stem which has static content
Single correct answer and multiple distractors
User is to choose one choice as the response among the list of options.
19 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.2.
Multiple choices dynamic
o
Include


Question stem with certain variable content and the range of variables is as
defined by the question author
Single correct answer and multiple distractors
User is to choose one choice as the response among the list of options. Usually, used in creation of
simple math problem.
20 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.3.
Multiple responses static
o
Include


Question stem which has static content
Multiple correct answers and single or multiple distractors
User is to choose more than one choice as the answer. The max and min limit to choose the choices can
be set whilst its creation.
2.2.1.1.4.
Multiple responses dynamic
o
Include


Question stem with certain variable content and the range of variables is as
defined by the question author
Multiple correct answers and single or multiple distractors
User is to choose more than one choice as the answer. The max and min limit to choose the choices can
be set whilst its creation.
21 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.5.
Matching
o
Include


Two columns, in which the left hand column is, question column and the right
hand column is response column.
The no. of question and response content in the two columns are same in
number.
User is to choose one among the options available in the right hand column (dropdown). The question
column contains text / digital assets. But the response column has only text.
2.2.1.1.6.
True or False
o
Include



2.2.1.1.7.
Drag and drop
o
Include



22 | P a g e
A question statement
Options ‘Yes/No’ or ‘True/False’ or ‘Correct/Incorrect’
User is to choose either one of the options
Question statement
Background image
Dropping image(s)
Excelsoft Technologies Pvt. Ltd
Confidential
User drags and drops the response images on the background image.
2.2.1.1.8.
Fill in blanks
o
Include


Question statement
Defined with single or multiple blanks
User is supposed to fill in the blanks.
2.2.1.1.9.
Fill in blanks dynamic
o
Include


23 | P a g e
Question statement with certain variable content and the range of variables is
as defined by the question author.
Defined with single or multiple blanks.
Excelsoft Technologies Pvt. Ltd
Confidential
User gives the response by filling in the blanks. Responses vary according to the numeric variables
presented in the question.
2.2.1.1.10. Hotspot multiple choices
o
Include



Question statement
Background image
Single selection option on the image.
User is to spot single option as the response on the image. The spots are defined by the question author
whilst creation.
2.2.1.1.11. Hotspot multiple responses
o
Include


Question statement
Background image
User is to spot multiple options as the response on the image. The spots are defined by the question
author whilst creation.
24 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.12. Entry list static
o
Include


Question statement with static content
Sub-questions with a text box against each.
User is supposed to key in the responses in the blanks of the sub-questions.
2.2.1.1.13. Entry list dynamic
o
Include


Question statement with certain numeric variables
Sub-questions with a text box against each
User is supposed to key in the responses in the blanks of the sub-questions.
2.2.1.1.14. Likert scale
o
Include


Question statement which relates to psychometric
Default five options like Agree, Disagree, Strongly Agree, Strongly Disagree and
neither Agree nor Disagree (The options are changeable)
User is to mark the response on the degree of agreement on the question statement. This is completely
individual response based question.
25 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.1.15. Matrix
o
Include



Question statement
Sub-questions with single correct response and multiple distractors
Or Sub-questions with multiple correct responses and single/ multiple
distractors
User is to choose response(s) in the list of options.
2.2.1.1.16. Numeric
o
Include


Question statement
Blank to be filled with numbers only.
User is to key in the numeric responses only.
2.2.1.1.17. Pull down list: Similar to Matching type of question
o
26 | P a g e
Include
Excelsoft Technologies Pvt. Ltd
Confidential


Two columns, in which the left hand column is, question column and the right
hand column is response column.
The no. of question and response content in the two columns are not the same.
User is to choose one among the options available in the right hand column (dropdown). The question
column contains text / digital assets. But the response column has only text.
2.2.1.1.18. Ranking
o
Include



Question statement
List of events in form of statements which are not in the sequential order.
Dropdown of numbers against each statement
User is to sequence the events by picking the right number
2.2.1.1.19. Select a blank: Similar to fill in the blanks
o
Include


Question statement with single or multiple blanks
Blanks have pre-defined options
User is select one among the options listed to fill in the blank
2.2.1.1.20. Slider
o
Include


Question statement
Slider with set of values
User is to slide and set the correct value on the image for the question asked. This is mostly used in
questions with numbers.
2.2.1.1.21. Text match
o
Include


27 | P a g e
Question statement
Text area to key in the short text
Excelsoft Technologies Pvt. Ltd
Confidential
User enters the short texts in the text area provided. User is scored based on the keyword matching.
Keywords are defined by the question author whilst creation.
2.2.1.1.22. Connect the points
o
Include



Question statement
Background image
Multiple points on the image
User is to connect various points on the image as a response to the question. This requires Java Applet
to be pre-installed to run on the client machine.
2.2.1.2.
Subjective question types
2.2.1.2.1.
Essay
o
Include


Question statement
Text area
User keys in the descriptive answer in the text area defined.
28 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.2.2.
File upload
o
Include


Question statement
Space to upload files
User creates a document offline and later uploads it as the response. This type is used in test
assignments.
2.2.1.3.
Objective HTML5 based question types
2.2.1.3.1.
Fill in the blanks – Drag and Drop
o
Include


The option area where the fill-ups to be dragged and dropped is listed.
The question area where the blanks are defined
User is to drag and drop the fill-ups are to be dragged and dropped into the blanks defined.
29 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.3.2.
Horizontal sequencing - Single set & multiple set
o
Single Set type, Include


Question stem with a static content.
Horizontal display of the letters or digits or words or expressions
User is supposed to re-arrange the content to its correct form.
30 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Note: Though the samples relate to English language, these question types can be used for other
subjects and topics. E.g., In Math, to arrange the numbers in ascending order.
o
Multiple Set type, Include


Question stem with a static content.
Horizontal display of the letters or digits or words or expressions but with
multiple sets.
User is supposed to re-arrange the contents to its correct form.
31 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.3.3.
Vertical sequencing
o
Include
 Question stem has static content which is the instruction to follow for
answering the question.
 List of jumbled events/statements.
User has to rearrange events/statements in proper sequence.
Note: This is again not just restricted to English subject, but is extended to be used in arranging
the events of history / steps to write a computer program / steps to solve a math problem and
so on.
2.2.1.3.4.
Image labeling – Select and Match
o
Include
 Question stem has static content with Background image
 Area / parts of the image to be labeled
 Labels of the area / parts
User shouldclick and select theareas/parts on the image and the labels to connect between the
two.
32 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.3.5.
Image labeling - Drag and Drop
o
Include
 Question stem has static content with Background image
 Area / parts of the image to be labeled
 Labels of the area / parts
User has to identify and drag and dropthe labelsto its correct position.
33 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.3.6.
Connect the points
o
Include



Question statement
Background image
Multiple points on the image
User is to connect various points on the image as a response to the question.
34 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
35 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.1.3.7.
Matching -Drag & Drop
Text to Text
o
Include
 Question stem will have static content.
 Text and its descriptions under two columns.
User has to match the text with appropriate description.
36 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Image to Text
o
Include


Question stem will have static content.
Image and text under two columns which is interchangeable.
User has to match the text with its correspondingimage
37 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Image to Image
o
Include


Question stem will have static content
Images under both columns.
User has to match the two related images.
38 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.2. Add question - Web based authoring

In this type of Authoring, an interface is provided in the solution where in the Author can key in
the questions in an HTML editor. The HTML editor supports the rich text forms. Enables the
authors create questions in required form. All the various question types defined can be
authored through web based authoring.
2.2.3. Data about a question

Basically question has,

39 | P a g e
Question label: An identifier for every question which gets created in the system.
Excelsoft Technologies Pvt. Ltd
Confidential

Question content: Question content need not be just the text; instead can include
hyperlinks, audio clips, video clips, Images and flash objects which supplement the textual
content.

Correct and Incorrect answers: Everyquestion has a correct and an incorrect answer. Few
of the type of questions have incorrect answers to be defined. And for the others, if the
answer other than what is defined is answered, it becomes an incorrect answer.

Scores: Every question created in the system has a score set. Score for a question can have
value from 0 to 99. The score is positive value or a decimal value for correct answer and a
negative number or a zero for an incorrect answer. Negative scoring is mainly used during
the competitive exams, where in the elimination process gets easier.
Note: In multiple choice question type, the choices can have incremental value. The choice
having the max score is considered to be the best answer.
Option
O1
O2
O3
O4
Score
1
2
3
4
O4 is the best answer and O1 is the least likely answer.

Shuffle options:Enabling this option, does change the order of options or choices in the
question types such as multiple choice or multiple response. This reduces the chances of
responses being copied by two users answering the same question.
e.g., a question has 4 options: O1, O2, O3, O4 and the right answer is O2
User1 User2
1) O2
O4
2) O3
O3
3) O4
O2
4) O1
O1
User 1 copying and marking the answer as third option gets no mark.

Choice presentation layout:Based on the needs of the questions, the choices can be
either presented in horizontal (side by side) or vertical (one below the other) forms. This is
seen in question types such as true or false, multiple choice or multiple response.
Item Stem (Horizontal)
O1
O2
O3
O5
Item stem (Vertical)
O1
O2
40 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
O3
O4

Hints:Hints / clues are provided for every question. For learning assessments, providing
hints for a question during the test to the candidates enable them to answer the questions
in a better manner. Practice tests may also contain Hints as a part of questions. The
feedback is added by the Subject matter expert (SME) whilst its creation. The Hint can be
just a text or a video clip or an audio clip or an image or the mentioned digital assets
supplementing the textual content.

Feedback:During practicing, the users can get to know the explanation or solution on how
to get the answer of the question. The feedback is added by the SME whilst its creation. The
feedback can be just a text or a video clip or an audio clip or an image or the mentioned
digital assets supplementing the textual content.

Difficulty or complexity level:SME sets the difficulty level of a question as easy,
moderate, or difficult to understand how well a user has mastered the topic. If required the
levels of difficulty can be increased or decreased from back end.

Classification on Bloom’s taxonomy:SME classifies the question into one of the
classifications based on Bloom’s taxonomy i.e., knowledge, comprehension, application,
analysis, synthesis, evaluation to assess the users cognitive thinking.

Question time: The question can be set with a time or can be set with unlimited timing.

Activation period: Set the period for which the question has to be active. Based on this
period, the question will be available in the test. This holds good for the test created with
random pick of questions in a huge question bank.

Exposure limit:If for e.g., the exposure limit is set as 2, the question will be exposed
to two users who get this question in the test. This holds good for the test created
with random pick of questions resided in a huge question bank.

Hide question: SME can hide a question if he/she half completes the question creation and
does not wish to expose it to question bank.

Secure question: Questions which will be used for final tests is secured by the SME.
Secured questions will not be available for the users when they create ‘My tests’ i.e.,
practice tests.

41 | P a g e
Copyright: Gives the information on the organization to which the question belongs to
Excelsoft Technologies Pvt. Ltd
Confidential

Questions in Multiple languages:The SARAS solution supports multi languages or the
Localization feature. Questions in any language authored using Unicode fonts enables the
system display the questions in the respective language.

Custom Metadata: Apart from the metadata pre-defined in the system, there can also be
custom metadata defined for every question with a value across each.
42 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
43 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
44 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.4. Import Question - Offline Authoring

Offline or Windows based authoring is an easy authoring method. The SME /authors can author
the questions on the word document or an excel sheet. Large number of questions can be
authored, not depending on the network / internet connections. Authors have to just follow the
formatting template to author different question types in the word document or excel sheet.
2.2.4.1.

Word Authoring
Eight question types are authored through word based authoring.
The various question types supported include
 Multiple choice
 Multiple response
 True-false
 Essay
 Matching
 Pull down list
 Fill in the blanks
 Matrix
While authoring the question types the metadata of the question like the score, hints, feedback,
difficulty level, classification, wrong score, question id, time required to answer the question.Shuffling of
the choices is set for the questions (containing choices) authored in a word document. Images (only) can
also be added as a part of questions or choices in a word document.
45 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Once the questions are formatted in the word document, they are converted to importable form using
SARAS Word to QTI Converter tool. The output of conversion is the zip file containing the question QTI
xmlsand related digital assets. These zip packages are later imported into thequestion banks.
Pre-requisites to run the tool on the system where the conversion happens:
.Net Framework 3.0 ,MS Office.
The word document should be of 2003 or 2007 version.
46 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.4.2.

Excel Sheet Authoring
Excel sheet authoring supports authoring of two question types
 Multiple Choice
 Multiple Response
Here the questions are authored in an Excel sheet, with all the required metadata like question id, hints,
feedback, difficulty level, classification, score, time required to answer the question. Though tedious, if
required the images can be added with its path mentioned in the relevant excel cell.
Once the questions are formatted in the excel sheet, they are converted to importable form using
SARAS Excel to QTI Converter tool. The output of conversion is the zip file containing the question QTI
xmlsand related digital assets (if any). These zip packages are later imported into thequestion banks.
However, it is wise to use the Excel sheet authoring when the question content is textual.
2.2.5. Edit question

If there are any modifications in the question, the SME can edit the question.
47 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Assuming a question created is used in the test and has been taken by few students. During the
test taking period, if a question is observed to be modified, the test has to be republished. The
modified question will be reflected only to the test takers post re-publishing.
2.2.6. Question preview

Questions created by the authors are previewed to check the correctness before next actions.
2.2.7. Search & Advanced search

Ability to search questions in question banks by keywords, in label, question text, meta-tags like
complexity / classification / time / score. And also on topic names, author names, question
created date, the questions which are hidden or secured.
There can be certain actions performed on the questions searched like, preview and export or
delete the question if not up to the mark.
2.2.8. Export

The questions are exported onto the local system. The exported questions will be in the QTI
format and the same is uploaded in any QTI compatible systems / solutions.
2.2.9. Repository Preview

Instead of previewing each question of a repository, all the questions resided in a particular
question bank can be previewed at once. If any questions are found duplicate or not authored
correctly, they can be removed easily.
2.2.10. Duplicate Search
48 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential

This feature enables the SME to search those questions which are duplicatedwithin a selected
repository or between two repositories.
The SME can check for:
o content between two questions without any keyword entry for either 100% or 80% or
50% duplication in question text or options.
o specific keywords’ duplication within the question text / in the options.
This search is based on fuzzy logic.
2.2.11. View History

When the questions are correctly created by the SME in the very first attempt the question is
set with the version V1. If in case there are any updates to the question, a new version of the
question gets created which goes as V2, V3 and so on depending on the number of updates.
SME will have an idea of the changes or updates made in each version on comparison with the
feature ‘Item Compare’through ‘View History’.
The latest version of the question will be available in the item bank for using it in test creation.
49 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.2.12. Delete question

Those roles who have the privilege, can delete the questions. On deletion, the questions are not
found in the repository. And the question deletion is a soft/logical deletion where the status of
deleted questions is set to ‘isdeleted=1’ in the database.
The question can be deleted in the following cases:
o
o
o
o
o
o
50 | P a g e
Newly created questions
Question is created and changes are made i.e., edited
Question is used in test creation
Question is used in test and published and the test is not taken by any test takers yet.
Question is used in test and published and test is started by test takers
Question is part of workflow and is published to repository. In this case,only creator can
delete the question provided with‘Manage Item’ privilege.
Excelsoft Technologies Pvt. Ltd
Confidential
2.3.

Manage Digital Assets
Admin can manage i.e., add, edit, search, preview and delete the digital assets in the system.
2.3.1. Add asset

The assets can be uploaded either individually or in multiples. The assets are uploaded to
repositories organized through Manage Repository feature. The file(s) to be uploaded are
browsed from the local drive path of the system. The details like name and description are
added while uploading the asset for its identification.
Single asset upload:
Multiple assets upload:
51 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Note: Multiple assets upload does not mean, zipping various files like image1, video2, audio3
and uploading. This is not supported in the system.

The digital assets added in the system are used in various areas:
o Assets like video, audio, flash and images are used in question creation
o
Assets like document, excel sheets, text files, presentation files, pdfs are used as
supplementary resources or additional resources along with the Practice tests.
2.3.2. Preview asset

The uploaded asset can be previewed before it is used as part of the questions or as
supplementary resources.
2.3.3. Edit asset

52 | P a g e
Any changes in the asset details like name and description is possible through edit asset
feature. Also, the file can also be replaced if there any changes in the content. Edit happens
only on an individual asset.
Excelsoft Technologies Pvt. Ltd
Confidential
Note: If there are any changes in the asset content : As part of question creation, the assets
are first imported to the Digital Asset Library which gets stored in ‘Digital Asset Folder (DAF)’
of Database File System. When the same is used while authoring questions it gets stored in
‘Question / Test folder (Q/TF)’ of Database File System. When the asset is updated, it is
stored in DAF and not to Q/TF. Hence, the edited assets will not be directly visible in the
questions in which they are used.
2.3.4. Search asset

When the number of assets added increase in large number within a repository, search
functionality helps the Asset manager to search for the right asset for further actions like
edit or delete.
Asset can be searched by filtering it according to the type or with the name or description as
its search keyword.
2.3.5. Delete asset

If the asset is not up to the mark then the asset can be deleted from the Asset library. Single
or multiple unwanted assets can be deleted at a time.And the asset deletion is a soft/logical
deletion where the status of deleted asset is set to ‘isdeleted=1’ in the database
As described in ‘Edit asset’ the deletion of an asset does not delete it from the question in
which it is used.
2.3.6. Import asset

53 | P a g e
At cases, the digital assets are added as knowledge resources to be accessed from mobile
devices. If the assets are to be played on mobile devices, the raw content in the word
document is converted to QTI xml form and is imported to the system through ‘Import’
functionality.
With this the mobile devices need not have plug-in of word reader toview the content of a
document.
The conversion happens by SARAS Learning material converter tool.
Excelsoft Technologies Pvt. Ltd
Confidential
2.4.
Manage Workflow
SARAS Test and Assessment system supports question development via collaborative workflow. Each
question development workflow can be set up with a maximum of 5 stages i.e., (create, review, accept,
approve and publish) or a minimum of just 2 stages (write and publish).
Organization A
User who creates the
workflow
User A1
Tag to
Workflow 1
Question
Repository(any)
Scheduling
the workflow
for
Questions
O R
Acceptor
Creator
Reviewer
Create
T
Approver
Publisher
Tag to
A C
To Create
Test (Any)
The actors can
vary for different
workflows
To Accept
To Review
Creator
Workflow 2
Reviewer
_
_
_
Workflow n
Acceptor
To Publish
Publisher
To Approve
Approver
Published
Questions will
be available
while creation
of test
END
2.4.1. Add Workflow
The Workflow manager creates the workflow to get quality passed questions published in the question
bank for its use in test creation.
The various steps to set up an item development project/workflow are as described below along with
the screen captures:
o
54 | P a g e
Step 1: Set up workflow details
Excelsoft Technologies Pvt. Ltd
Confidential
o
Step 2: Decide the project group who will work on it (actual users who can be assigned to be
writers, reviewers, approvers, etc)
o
Step 3: Provide a blueprint which defines number of items, type of item and several meta
data of those items that the project group has to work on and finally
55 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
o
Step 4: The project plan to set start and end dates for each user in the workflow. Users can
be selected to play more than one role
The members who are involved in the workflow play the same role or play different roles in an
organization. There can be questions added to multiple subtopics but belonging to same topic, as part of
the same workflow process.
Once the question workflow is created by a Workflow manager, every stage of an item is recorded in the
system. At every stage, the appropriate workflow user who has to take action at that particular stage:
can add comments, make any changes and finally accept/reject the item, which will either move it to
next/back step in the workflow.
Every change made in the item is saved in terms of versions. Workflow usercan compare any 2 versions
of an item and check the evolution of an item.
56 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
The items are available in item bank and are accessible to the test constructor only after it is approved in
the last stage of the workflow process.
The system does not directly support the search of items at different stages when part of workflow.
However, the dashboard of a workflow provides clear information on the items at different stages i.e.,
the number of items at each stage of the workflow, progress of the task and items left for completion.
Each status message can be clicked to view the actual item to take action on it.
The Workflow manager who creates the workflow can know the status of the questions in various stages
only if part of the workflow.
Below is the list of workflow scenarios that work in the system:
o
o
o
o
There are 5 members in the workflow. Each have specific task to perform i.e., M1 (Create),
M2 (Review),M3 (Approve), M4 (Accept), and M5 (Publish).
Just 2 members in the workflow with specific tasks likeM1 (Create), M2 (Publish) to be
performed
There are 3 members in the workflow with multiple activities attached.i.e.,M1(Create) , M2
(Review and Approve), M3 (Accept and Publish)
Assuming there are 10 members, where multiple members are to perform one i.e., M1, M2,
M3 (Create), M4, M5 (Review) and so on…
Note: There cannot be one person who is set with the task to create the questions and is part of the
workflow. In such case, the question development should be outside workflow.
57 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Collaborative item authoring with review process
58 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
The process after the workflow creation is captured in the presentation and the video attached. Refer
the same.
Collaborative Item development Process.ppt (D:\New Year - 2013\Product News on my system)
https://www.dropbox.com/s/ow86maui3mccou8/CollaborativeItemDevelopment.zip
2.4.2. View Workflow

Allows the Workflow manager who created the workflow to have a view of the workflow for any
modifications in the details before the schedule start time.
2.4.3. Extend schedule date

If the workflow tasks are not complete within the set project plan, then the workflow manager
who created the workflow has the privilege to add a new project plan and extend the dates as
required to complete the task.
2.4.4. Delete Workflow

2.5.

The workflow can be deleted by the one who creates the workflow only before the schedule
start time. However, it cannot be deleted if the scheduled time of the workflow is started and
also if it has got expired. The deletion of workflow is a soft/logical deletion.
Manage Test Templates
Test constructors manage i.e., create, edit, view the availability of questions, and delete the test
templates.
What are Test templates? : When the volume of questions residing in a repository is huge, it
becomes a tedious process to handpick the questions while creating the test. Also same set of
questions will be displayed to all the candidates who will take the same test. In order to
overcome such a limitation, test templates are used to pick the questions randomly from a
repository / topic according to the criteria as definedin the template.
Test templates are the Blue prints whilst its use in the collaborative question development
process.
The usage of test templates is more effective, in High Stake exams to avoid mal practices during
the test taking activity at test centers.
2.5.1. Add Test Template
59 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential

The test templates are created by choosing various pre-defined question metadata like: Topic /
Repository of questions, Classification based on Bloom’s taxonomy, Level of question
complexity, Type of question, No. of questions and marks across each question. According to the
needs, the metadata can be extended.
A single test template can include multiple question selection criteria which help the
organization identify the performance of an individual in right manner.
Eg., if to understand the mastery of an individual on a particular topic, the template can be
designed in the way as mentioned below.
Topic
Taxonomy
Difficulty Level
Item Type
No of Q
Marks
English > Grammar
Knowledge
Easy
MCQ
10
1
English > Grammar
Knowledge
Moderate
MCQ
10
2
English > Grammar
Application
Difficult
Essay
2
5
However, the test template usage in test is dependent on the availability of the questions in the
respective topics / repositories.
60 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.5.2. View the availability of questions in Test Template

The test template view feature enables the Test constructors to check if enough questions are
available in the repository chosen for a test to be created.
2.5.3. Edit Test Template

The test templates can be edited and updated for various metadata details until the test
template is used in test creation and is published.
2.5.4. Delete Test Template

2.6.

The test templates cannot be deleted once if they are used in test creation. However the test
template deletion is a soft / logical deletion.
Manage Grade Scheme
Test constructors manage i.e., create, view, edit and delete grade schemes.
Grade schemes are used in test construction with categorization of score to know the
performance of an individual test taker.
This helps the education institutions to improve the students’ with lower grades, the corporates
to provide the certification for individual’s areas of expertise.
Grades are assigned in letters for example, A, B, C, D, or E with the range of scores defined
between 0 to 100 and the description as feedback like excellent, great, good, satisfactory, needs
improvement to each of the grade levels.
61 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.6.1. Add Grade Scheme

The Grade schemes are added by the test constructors as shown
2.6.2. View Grade Scheme

The grade scheme once added is viewed to check if it is fine to be included in test construction.
62 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.6.3. Edit Grade Scheme

If the grade scheme viewed requires any changes, it can be edited using the feature ‘Edit’ grade
scheme.
If the grade scheme is used in test and is scheduled or published or test already taken or its
results available, the edited grade scheme will not be reflected.
2.6.4. Delete Grade Scheme

When the grade scheme created is not suitable, it can be deleted using the feature ‘Delete’
grade scheme.
The deletion of the grade scheme will not affect if is used in test and is scheduled or published
or test already taken or its results are available. The deletion is soft/logical deletion.
2.7.

Manage Test
Test constructor/administrator can manage i.e., create, preview, view details, copy, edit and
delete tests. Also Print the test.
Tests arecreated for test types such as High stakes, Preparatory, DRT with or without templates:
 NON-TEMPLATE BASED: In this case,the questions are manually picked from the
repository based on the test constructor’s choice.
The same set of questions will be picked and presented to all the test takers.
However, the order of the question can be changed.
e.g.,The test having 5 questions Q1, Q2, Q3, Q4, and Q5 is presented to test takers
U1, U2, U3 the order of questions is as follows.
U1 > Q1, Q2, Q3, Q4, Q5
U2 > Q1, Q2, Q3, Q4, Q5
U3 > Q1, Q2, Q3, Q4, Q5
Check the logic
 TEMPLATE BASED: In this case, the test is createdfrom the Test Templates managed.
The tests are presented in different ways as mentioned below:
 Same set of items to test takers, by random pick of items by the system
based on the test template criteria.
 Same set of items to test takers, by manual select of items based on the test
template criteria.
 Different items to test takers, by random pick of items by the system based
on the test template criteria.
63 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
A single test form (set) or multiple sets when the tests have to be more secure can be
generated.The sets are automatically generated by the system based on the availability of
questions based on the test template criteria or as defined by the test constructor.
2.7.1. Test Construction or Test creation
Test creation in SARAS system is followed by six easy steps. These steps include:
 Test Details: Adding basic information of test such as Test name (Title displayed
when the test taker takes a test), Test details, selection of type of test to be catered,
selection of the category and products
 Setting the sections, selection of templates or questions in each of the sections
 Adding single page or multiple page instructions
 Choosing the Grade scheme
 Setting the preferences or rules
 Applying the style sheet or test player theme
Below gives the information on test creation with ability to automatically let the system pick
items based on a template, along with the ability to manually replace items to ensure test
overall meets item statistics targets.
o
64 | P a g e
A) Select ‘Generate sets’ check box if you wish to create single or multiple sets (forms) of a
test
Excelsoft Technologies Pvt. Ltd
Confidential
i) System generates the sets automatically based on the test template criteria Vs. items available
in the item bank.
The system generates X no. of sets (forms) automatically based on a logic for the items
available in the pool.
[e.g. in a pool of 9 items (satisfying the test template criteria), template was set to pick 4 items.
There were 4 sets generated automatically.
The formula used to generate the sets is as follows:
No of questions in item pool or item bank that satisfy the test template criteria
No of questions set to be picked in test template
2
Fraction is rounded off to nearest whole number and then multiplied by 2]
Note: On scheduling a test to user, the option ‘multiple set’ has to be selected. This will enable
our delivery system to randomly pick a form for the student
ii) Enter the number of sets to be generated
The test administrator defines the number of sets (forms) to be generated. The system
automatically picks the items and generates the defined number of sets.
65 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
iii) Generate sets choosing preferred items
A preferred item here refers to manually selected items by the test form
creator/administrator.
2 ways available for the user to choose preferred items (manually select items)
A: The items desired by the test creator can be handpicked/manually selected by selecting the
Details link > Preferred items, which is available after completion of the test wizard.
Or
B: Set test rules (Displayed by default with ‘Generate Sets’ option unselected)
Under test rules setting there are three options:
i) Presents same set of items to students, by random pick of items by the system based on the
test template criteria.
Example: If the test template is created with the criteria to pick 5 items out of pool of 20
items. On selecting this option, the system generates a set of random items i.e., I1, I5, I6, I9, I20.
This randomly picked set (the same set) is presented to all the test takers.
ii) Presents same set of items to students, by manual select of items based on the test template
criteria.
66 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Example: If the test template is created with the criteria to pick 5 items out of pool of 20
items. On selecting this option, the test administrator is provided an option to hand pick
(manually select) the items from the item bank chosen in the test template.
The selection of items is manual and the same set (form) is presented to all the test
takers.
Note: The items preferred for the test are handpicked by selecting the Details link > Preferred
items post completion of test creation wizard.
iii) Presents different items to test takers, by random pick of items by the system based on the
test template criteria.
Example: The test template is created with the criteria to pick 5 items out of pool of 20
items of specific meta data (that can be defined in the template). On selecting this option, the
system generates a set of random items, such that the probability of the same items appearing
to the users is as less as possible (Determined by overall size of item pool)
The selection of items is completely randomized and the test takers are presented with
different set of items.
Note: The output of setting rules i) and ii) look similar, but the process of selection differs.

Once the test basic detailing is done, the test sections are set. A test can contain any number of
sections and each section can contain any number of questions in it.
67 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential

Apart from this, the questions in the section can be shuffled if manually picked from test
template. Also the time can be set for every section in the test.

Next step is in providing the instructions which is either single page or multiple pages.
The instructions could be:
o
o
o
o
o
68 | P a g e
The information about the test such as, no. of sections/questions in the test, test
duration etc.,
The learning objective / learning outcome of the test
The way the test takers are supposed to navigate when they enter the test taking page.
The NDA, terms and conditions to accept before taking the test added in multiple pages.
The instructions for tests online and on paper differ. Hence the system provides space
to the test constructor to add instructions if the tests are printed for offline tests.
Excelsoft Technologies Pvt. Ltd
Confidential

Next is to attach a grade scheme to the test created. The grade schemes are managed under
‘Manage Grade Scheme’ feature in the system.

Later is to attach the preferences for the test created. Preferences under various levels such as
Test Presentation, Test Rule, Enforcing time, Test status and Test Results can be set for the test.
The detailing is done under the sub-heading ‘Test Preferences’

Lastly is to select a test player theme or style sheet. The test constructor is allowed to choose
the pre-defined style sheets. Any new style sheets can be added … how??
2.7.2. Test Preferences
Show hints
Allow backward navigation
Hints / clues are provided for a/every question while it is authored. A max
of three hints can be presented to a test taker.
Hints are presented when:
- The questions are used in tests as part of learning or practicing of a topic
- The questions are difficult, and to make the test takers catch the answers
Test taker is allowed to navigate across various sections of the test.
If this option is not checked, the test taker will not be allowed to move
69 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
back to the previous sections to review the answers before submission.
However, the navigation of questions (back and forth) within a section is
possible.
Allow bookmark in tests
Enabling this option helps the Test-taker flag or bookmark questions for
which they are not clear on the answers. This could be because the
question is time consuming or difficult to answer. Instead of wasting time,
test-taker can quickly re- visit the marked question later, before
submitting the test
Apply Negative marking
The questions when authored can be set with negative marks for wrong
answers.
Every wrong score can be set with different negative marks. More nearer
to the answers, less deduction in the scores.
Applying negative marks drive the test takers towards answering the
questions correctly. This is possible only if the test takers have mastered a
topic.
This option helps the evaluators understand the level of mastery on a
topic of every test taker and in the faster filtration of the test takers by
performance.
Clear Answers
This preference enables the test taker to clear the unsure answers.
When the test taker answers a particular question and if not sure of the
correct answers, they can clear the answers and choose another option or
leave it unanswered.
This is quite useful when there is negative marking included for the test.
However, the preference ‘All questions should be answered’ should not be
enabled with this preference.
Enable Item panel
Item panel is the display of numbers for the questions in a section / test.
This appears to the left-hand side of the test player where it consumes
part of the question content area.
With this option enabled, the test taker can have a quick look on the total
questions available /questions attempted/questions un-attempted as well
collapse the panel to increase the content area for proper question view.
Enable buzzer before time Buzzer or an alert is set for a test for the test takers to revise, before the
time ends for the test. The buzzer time can be set to a max of 59 minutes.
Number of items per page This preference helps the test constructor to decide on the number of
questions to be displayed / page of the test player.
This helps the test taker look into the questions at a stretch and answer
them accordingly.
Assuming a test of 10 questions is set with 5 questions display / page.
When there is power failure or network failure, the responses of only the
last question will be resumed on continuing the test post network or
power re-gain. Hence, this option is not preferable to be selected.
Number
of
attempts Number of times the test can be re- visited before submission. This option
before submission
has to be enabled, to ensure the test taker submits the test without any
loss in the responses to power or network fluctuations.
Allow participants to view Submit button is displayed only after the test takers have spent the time
submit button at time level defined.
in %
e.g., If the total duration of the test is 1 hour and the time level defined is
70 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
50%, the candidates will see the submit button only after spending 30
minutes in the test.
This is to make sure that the test takers spend a minimum time in the test
and are not allowed to leave the exam hall until the defined time, once the
exam is commenced.
Display score for question
With this option checked, the score of every question is displayed when a
test it played. The score for every question is displayed while it is created.
This helps the test taker,
- know the score for each question and respond accordingly
- also calculate the final scoring
All questions should be With this option checked, every question in the test has to be answered.
answered
Test takers will be able to submit only after all questions are attempted
with or without skipping the questions.However, if the time elapses, the
test is auto-submitted.
This becomes important
- during question analysis
- knowing the performance of test takers under various topics included in
the test
Enable grouping passage Reading / listening / visual comprehension questions contain a common
questions
comprehensive content and the related questions.
While such questions are authored, the common content is tagged to all
the related questions and is saved individually.
This option is enabled, to make the questions display as a group for a
common comprehensive content.
When this option is enabled, the common content is displayed on the lefthand side and the related questions are displayed on the right-hand side
of the test player (i.e, Test player is split vertically).
This saves the test takers’ time by enabling them go through the content
once and answer the questions accordingly.
Allow skipping of questions With this option, the test takers are allowed skip the questions within the
test. It is not mandatory to answer all questions or in sequence. This helps
test takers score better when the negative scoring is attached to the
questions.
Shuffle questions
With this, the questions are shuffled (change in order of the same set of
questions)when the same test is presented to different users. However, if
any power or network fluctuations, the order of the questions remain
same as presented for the first time.
This reduces the chance of users copying the answers, as the questions are
not presented in the same order.
Save the response at the With this option enabled every action of the user is saved for every 2 secs
end of each page
and details are updated in the database. This makes the users resume the
test with regards to theresponses, time and position of the testif there is a
power / network failure or fluctuation during their test taking activity.
When the test is taken anytime, anywhere and if there are any
fluctuations or failure in network experienced, the user gets information
71 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
on the non-availability and is forced to close the test. Once the network is
regained, the user has to re-login to the SARAS system and continue with
the resumed test. More is the fluctuations or failures, more are the relogins.
Enable Test Utilities
On marking this option, the Test utilities such as calculator and/or notepad
are enabled in the test player for test takers to use.
Calculator helps the test takers in solving the difficult mathematical
problems in a faster way.
The notepad can be used to make notes or do rough calculations and/or
make an outline of the answer.
e.g., While answering an essay question, make notes on the points to be
covered based on your ideas, organize and complete the essay.
This avoids the revision, for multiple times.
Allow participants to view This allows the test takers to view the test submit button only when they
submit button at last
reach the last question of the test.
This is to make sure that the test taker at least goes through all the
questions in the test.
Enforce timing at various The test created is set with timing at various levels i.e., Test, section,
levels
question and no limit depending on the type of test.
Timing at ‘Test’ level: Defines the total duration of the test and allows the
user to answer the questions according to their pace. However, the
usercan stay at the same question for the whole test duration.
Timing at ‘Section’ level: Defines the time for every section within a test.
Once the time for the section completes, the system automatically takes
the user to the next section. The user is not allowed to navigate back to
the previous sections. However, the user can stay in the same question for
the whole section duration. In this case, the test duration is the sum of
sections duration. The section time is defined when a section is added for
a test.
Timing at ‘Question’ level: The system automatically takes the user to the
next question once the time set for a question elapse. The time for every
question is defined under the metadata ‘time required to answer the
question’ during question creation. The test duration is the sum of
questions duration.
On selection of ‘None’ option the test is set with no time limit. The user
can take the test for any longer until submission. This is set for practice
tests where the users have to master a topic.
Enable online proctoring
Essay Evaluation Mode
Enable review question
72 | P a g e
Evaluation based on text mode
Evaluation based on image mode
Evaluation based on correction
Review questions helps test taker view all questions /No. of questions
attempted/ questions un-attempted/book marked before test submission.
Excelsoft Technologies Pvt. Ltd
Confidential
Test taker can revisit the questions and has privilege to change / modify
the questions before test submission
Enable review response
Show grade
View solution
Test Submit Result view
Accept feedback
student
Configure
summary
Test taker will not have privilege to change / modify the response posttest submission.
With this option enabled, the test player is set to view only mode where
the test taker only views the responses which they have answered.
This enables the user view their ‘grade’ soon after test submission. The
score to grades are managed under ‘Manage Grade scheme’ feature.
Every question when authored can be added with a solution which
explains how the answer is obtained or deduced.
The solution could just be the text/image/video clip/audio clip which
explains in detail.
With this option enabled,post test submission, the test taker will be
allowed to view the solution for the question. The solution could be for
the wrong answers or is an alternate path from the test taker’s way of
analyzing the question.
Allow student to view report in the test
Allow students to view progress report in the test
Detailed summary
Test summary in paragraph
Based on the organization or examination needs, the users are allowed to
either view their results in detail including the scores orjust the
information on the number of questions they have attempted.
And/Or Permit the users to view their responses they answered posttest
submission with or without the correct responses.
from The tests presented are not of the same complexity to each individual test
taker. It becomes important to know how complex or how clear the test
was. This is made possible by getting the feedback from test takers either
at item level or at test level.
Accepting the feedback at item level, helps the test constructors in
deciding whether the questions have to be the same or to be changed.
Also, helps in analyzing the performance/success rates of the item
authors.
The test evaluators can set a time limit to accept the feedback from the
test takers.
Results The summary of results for the test / sections / questions in the test can
be configured. On check of the type of summary, the test takers will be
able to view post test submission.
These preferences can be configured, saved and used based on the type of the test created.
73 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
e.g., for high stake tests, the preferences such as bookmarking, clear answers, Buzzer, display of scores,
view of submit button, online proctoring, display of test summary are set and saved. When the need
changes, the preferences can be set accordingly and updated.
2.7.3. Non-Template based test creation Vs. Template based test creation
Non-template based
Template based
On selection on non-template option during test
On selection of non-template option during test
creation, it allows the generation of multiple sets
creation, it does not allow the generation of
or forms
multiple sets (forms)
It is always a single set which is generated.
The test constructor can allow the system to
74 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
generate the sets / forms automatically.
One can enter the number of forms to be created
Also, the items selected on the form can be
automatically picked by the system OR manually
picked by the user. Note that in both cases, they
need to conform to the item meta data defined
in the template
Once the test is created, there can be changes Once the test is created, there can be changes
(addition or removal or update) in the following (addition or removal or update) in the following
parameters (before scheduling the test)
parameters (before scheduling the test)
 The test details
 The test sections (addition or deletion of
the sections)
 The no. of items selected for a section in
the test (eg: section had 10 Qs, increased
to 15 Qs)
 Add/replace/delete items on the test
 Re-publish
a
test,
which
will
automatically make any item edits to be
reflected in the test
 The test details (Test name, Test code
and Test details)
 The test sections (addition or deletion of
the sections)
 Changes to meta-data in the test
template (updating the test template)
 Updating items that will be picked on a
form
2.7.4. Edit Test

Any modifications in the test with respect to test details or tagged items or any other test data
can be updated. Tests can be edited only before it is scheduled to the test takers.
While editing, the system checks for any updates in the questions tagged to the test. The test
constructor can decide whether to retain the same version or get the latest version of the
questions. However, the test has to be republished when the latest version of the questions is
chosen.
75 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.7.5. Preview Test

The test once created has to be confirmed for its correctness before it is scheduled to the test
takers. The ‘Preview’ feature enables the test constructor to preview the test and tryout as if a
student.
The test constructor can preview the test starting from instructions to submission, including the
test preferences set, except for the results.
2.7.6. View Details

‘Details’ feature enables the test admin to quickly understand the details of a test.
This includes the information such as Test name, Duration, No. of sections, Total number of
item(s), selection mode (template / non-template).
Further the details of the section include Section names, Distribution of items based on
complexity & classification.
Also information on total number of users who are scheduled, who have started, yet to start,
users who have submitted the test is displayed.
Apart from the above details, the test-republish and IRT processing happens here.
76 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.7.7. Copy Test

The test is duplicated by ‘Copy’ test feature.
There may be cases where the same test with very few changes in the preference has to be
scheduled for two groups. E.g., Users with normal mental behavior are set with x time to answer
the test. The same test when presented to the users with special needs would require more
time(x + extra time) to answer. In this case, the time information alone changes and the other
details remain same.
2.7.8. Print Test
77 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential

If there is poor / no network /power availability, test admin can print the test that are managed
online and conduct paper pen exams.
On printing the test created online, the information such as instructions, sections and questions
with serial number and score across each is displayed. Along with the test paper, the answers
are also printed to assist the markers who mark the scores manually.
Extending to this the scores of every individual test taker manually marked is put back to the
system through the ‘Score Editor’ feature.
2.7.9. Delete Test

Those roles who have the privilege, can delete the tests.
The tests which are editable i.e., the tests which are created and not yet published / taken by
the users can be deleted. On deletion, the tests are deleted from the repository.
The deletion is a soft/logical, where the status of deleted tests is set to ‘isdeleted=1’ in the
database.
2.7.10. Test Types
1. High Stake Tests

The high stake tests are those which lead to take decisions on, movement to next grade,
placement to higher education, placement to the corporate industries or it could also be used to
evaluate the teachers/trainers.
The major features of High Stake Test delivery are:
o
o
o
o
o
o
o
o
o
o
78 | P a g e
Collaborative Item Authoring
Generation of forms or sets during test management
Candidate Verification through biometric devices
Test availability for a specific duration
Centralized or distributed delivery (explained in next pages of the document)
Secure test delivery - Lock down browser
Monitoring of tests through Live dashboard
Admin control of test takers activities
Audit trail
Test set with objective type questions (However, the subjective questions included
have to undergo manual evaluation process. Otherwise, as per a case-study they are
used to know the candidates comprehensive capabilities during foregoing steps of
the evaluation process)
Excelsoft Technologies Pvt. Ltd
Confidential
Apart from this in recent days, the high stake tests are not conducted in exam centers alone;
instead the candidates can take the test anywhere. In such cases, the ‘Remote proctoring’ of
test candidates happen.
2. Test Prep

Tests are created and presented to the candidates to enable them learn and master a topic /
subject/ program as part of learning process.
The major features of Prep Tests delivery are:
o
o
o
o
o
o
o
o
o
o
o
79 | P a g e
Item authoring with combinations of complexity and classification
Tests set with one/multiple attempts for practicing
Tests at topic/subject/program level
Test availability for long duration / until all the attempts complete
Centralized delivery (explained in next pages of the document)
Support anytime, anywhere test delivery, without any loss in the responses
View the progression of the test for various attempts
View detailed report
View the solution/explanation on how to obtain the answers helping answer the
next attempts better
Quick view of results in graphical representation
Present a summative test post practicing
Excelsoft Technologies Pvt. Ltd
Confidential
o
Test set with objective type questions (However, the subjective questions included
have to undergo manual evaluation process and this might cause delay in the
learning process as the learners have to until the essay is evaluated. If organized
properly the subjective questions can also be supported for learning.)
3. DRT

DRT represents
Diagnose, Remediation, Test. The users are diagnosed at granular level of a
subject/program with one or multiple tests, for their strong areas and areas of improvement.
Post diagnosis, the users are provided with remediation to improve the weak areas. Once the
user views progression, they take the Mock test to know their final like results. This kind of test
model is quite useful to those who are preparing for the competitive exams.
The major features of DRT Tests delivery are:
o
o
o
o
o
o
o
o
o
o
o
o
Item authoring with combinations of complexity and classification
Item bank of questions with granular level structuring
Test availability?
Centralized delivery (explained in next pages of the document)
Support anytime, anywhere test delivery, without any loss in the responses
View the strong area and areas of improvement report
Remediation could be solution or explanation for every question/ connect to
sessions / read the study material tagged at topic or subject level
View progression and detailed report during remediation
Quick view of results in graphical representation
Mock tests are run-through of the real tests
Mock test results viewed as if the real results, helps know the position or ranking
Test set with objective type questions
4. Survey

Survey test is used to gather the opinions or suggestions which could be on an organization/an
event/a subject/a program.
Survey test created does not require any authentication if presented for public opinion. Such
tests need not be scheduled, the same is accessed by a URL and the users need not use the login
credentials to take the survey test. Instead they enter their details to take the surveys and give
their opinions.
However, the Surveys can be presented to a closed group within an organization and this
requires authentication.
Survey can contain objective questions where the user is allowed to choose and subjective to
express their thoughts.
80 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
5. Adaptive test

The Adaptive test created in SARAS system is based on the grade scheme. Test templates are
managed and tagged at various grade levels.
Initially a set of questions (randomly from a base test template) is presented to the user. Based
on their performance or grade obtained the next set of questions (templates tagged to the
respective grades) are presented.
The test templates and the grades are managed and mapped manually by the Test constructor.
The objective question types alone are used in SARAS Adaptive tests for the instant response
processing happens for every set of questions, identify the grade and present the next relevant
template.
Creating Adaptive Tests using IRT theory is part of SARAS Test and Assessment product
roadmap.
6. Assignment

2.8.

Assignments are used when the responses are expected to be more elaborative or descriptive
with supporting resources or content. The users are required to use the file resources such as
image/document/excel sheets/power point presentations as defined by the test constructor.
For the same, the users work offline on any of the files and later upload it as a part of response
for the question. Only ‘File Upload’ questions are used for assignment. Assignments are usually
set with duration in terms of days.
Schedule Tests
The tests which are created and have (have not) passed through the review process are assigned
to users either individual or in batch, to be taken on a particular date if high stakes and time or
for a specific duration if for preparatory. The flexibility is provided for the candidates when the
test is scheduled. The schedule of a test is dependent on the type of test, and the delivery mode
i.e, centralized or distributed.Also, the test scheduling is based on the UTC time system which
enables scheduling to user groups across different geographical areas.
81 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Below screen capture indicates the search user facility available during test scheduling.
Explained with an example are the scenarios of scheduling
Assuming
Test duration: 3 hours;


82 | P a g e
Test start time: 9:00 am;
Test end time: 12:00 pm
All users start test exactly at 9:00 am and end the test at 12:00 pm.
Users appear to the test anytime between 9:00 am to 12:00 pm and complete
the test for the remaining schedule time. i.e, user starting test at 9:00 am will
have complete 3 hours while, if starts at 11:00 am user will have just an hour’s
duration to complete the test.
Excelsoft Technologies Pvt. Ltd
Confidential
Tests available to group of users at specific date and time
o
o
o



Candidates are already in the system and the tests are scheduled.
Tests are scheduled for anunknown list of users and login information is generated,
which is used by the candidates while taking high stake tests. With this the candidates
need to enter their information before taking the test.
On Fly Schedule – where in the test is created and is available for the users who are
registered into the solution.
While scheduling for the practice tests, number of attempts is mentioned. This would enable
thecandidates to take a practice test for n number of times. The same test would be available
with the same set of questions but in a shuffled manner
When large number of users have to be scheduled,the data management happens through excel
sheet containing the details of users, date time, test.
The schedules tests can be viewed for the details as shown below.
2.8.1. Test Priority

At times, the users are assessed not by just one test, but with multiple tests. When multiple sets
are scheduled, it is left to the user to choose the test they prefer to answer first. Otherwise, if
the order of the test has to be followed by all the users then the arrangement of test becomes
important. This may also be made dependent on the previous tests’ results. To make tests more
secure the access code for a schedule can be generated by the test admin.
e.g. The users are set to take 2 tests, with Test X first and Test Y later. Users can move to Test Y
only if they score 50% in Test X.
2.9.

Candidate Verification / Registration
Particularly High Stake tests are conducted in Test centers. The candidates to attend the test
would have registered online individually or through the organization. In order to verify and
confirm the candidates to take test in the test centers, candidate verification process is carried
out by the test center admin orproctor on the test day,
83 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
The various mechanisms used for verification are:



Photo Capture and Match: The candidates are supposed to upload their photographs
during the process of registration to the organization or to the test. On the test day, the
test center admin takes the photograph of the test attendee and manually matches the
two photographs.
Finger Print Verification: This happens similar to photo capture as mentioned above
where finger print capture device is used.
User Details verification: The candidate would have entered the details while
registration process. On the test day, the candidate is verified for the online registered
details manually against the supporting documents.
The biometric verifications like photo and finger print requires the supporting software
installations on the canter admin machine.
Only if the candidates are verified, the center admin register the candidates to take the test.
2.10. Reports
2.10.1. Data Forensics
The below mentioned data of SARAS Test and Assessment system are captured in the database. Based
on the need and the type, the reports are customizable.
Data about Test taker
Login credentials
E-mail address
Test taker First Name, Last Name
Other Test taker demographic information like Gender, DOB, Photo snap, Organization, Batch they belong to
Post Test taking data : Score and percentage obtained , No. of questions attempted , correctly / wrongly
answered, No. of questions un-attempted and unseen, No of times test is resumed before submission due to
power or n/w failure, time spent on every item, time spent on the test, start time of the test, end time of
the test.
Information about Items
Item Label
Item score: Score for each question which can have +ve numbers for correct score and -ve / 0 / decimal
score for wrong answers,
Answer key or correct answer
Item type (e.g., multiple-choice, true or false, …)
Item language type
Item response time
Clear responses while taking test
Order in which the item was presented
84 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Maximum score for each item
Preferences of question like complexity, classification, time allotted (optional), copyright information, item
activation period, item exposure limit, shuffle choices
Item is scored or not
The item bank from which the item is picked from
Item Author, How many times this item was rejected,
Item used in how many tests, Item Rubrics, used in what kind of tests, how many users answered it correct,
how many users answered it incorrect, how many times this item was presented, how many users have seen
this , not seen this..
Information about the Test
Test identifier
Test details like Test name, No. of sections, No. of Questions, Test Duration, Test Max score, Test
Instructions, selection of selected questions or randomized questions
Cut-score for pass/fail decision
The preferences set to the test like, display score, allow bookmark, Enable Buzzer, Save responses, allow
backward navigation, enforce answering all questions, view test summary immediately after test submission
or not, allow test takers to view Submit button after certain test time, allow participants to view submit
button at last question
Theme of the test player
Data about the Test Schedule
Date of test
Test score
Time of day test was administered
Duration of the test schedule
Test delivery method (e.g., online / distributed )
No. of students assigned to the test
Information about the Test center / location
Test site or location code
Location information like, Country, state, city
Proctors tagged to the center

Below is the list of standard reports available in the system. However, based on the need of the
organization or the exam, the reports are customizable. The reports generated are easily
exportable to Excel sheet, Word document and HTML file format. Also, can be printed.
2.10.2. Pre Exam Report
Scheduled User details
85 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
86 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2.10.3. During Exam Report
Test Monitoring Dashboard
Following the above figure, ‘Total candidates’ details
87 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Submitted candidates details
2.10.4. PostExam Reports
1. Participant Report
88 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
2. Score List Report
89 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
3. Transcript Report
90 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
4. Participant Analysis Report
5. Participant Consolidated Report
91 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
6. Test Results by Participants
92 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
7. Attendance and Absent Report
93 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
8. Score Report
9. Response Report
94 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
10. Summary Report
95 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
11. User-wise Performance test
96 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
12. Individual score report
97 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
13. Advanced Report of Individual Score report
14. IRT Reports

The IRT Reports Item Information function (IIF), Item Characteristic Curve (ICC) and test information
function generate are based on the Discrimination (a), Difficulty (b) and Guessing factor(c) values.
o
98 | P a g e
Item Information function (IIF):The information function of a given item will be at its
maximum for individuals whose ability is at or near the value of the difficulty parameter.
Item information functions tend to look bell-shaped. Highly discriminating items have tall,
narrow information functions; they contribute greatly but over a narrow range. Less
discriminating items provide less information but over a wider range.
Excelsoft Technologies Pvt. Ltd
Confidential
o
99 | P a g e
Item Characteristic Curve (ICC): is the basic building block of Item Response Theory. This plot
is drawn for each item (item). Many terminologies derived in IRT depend on this curve. The
x-axis indicates examinee (student) ability and y-axis indicates probability of answering the
item.
Excelsoft Technologies Pvt. Ltd
Confidential
o
The Test information function(TIF): is simply the sum of the information functions of the
items on the exam. Using this property with a large item bank, test information functions
can be shaped to control very precisely. Summation of all the item information functions,
Index of how much information a test is providing a given trait level , The more items at a
given trait level the more information is obtained.
100 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.1. Offline Test
An option is provided for the users to download a test and play the same in an offline mode. For an
instance an Admin can download the test and provide the downloaded package to the candidate for
taking the test. The candidate who is taking the test will have no access to internet. They can play the
test in an offline mode and proceed with the answering of the questions. The responses are saved in an
xml file, whichis later uploaded by the admin into the SARAS T and A solution to update the results of
the candidate.
14.2. Test Delivery Modes
14.2.1. Centralized

The Centralized mode of delivery is chosen where a centralized server is used to author items ,
manage tests, manage users/batch, manage schedules , verify/permit the users to take test,allow
users take test and view reports.

This mode of delivery includes various components such as:
–
–
101 | P a g e
Controller of Examination CoE : The activities like authoring questions, manage
templates, manage customer, manage tests, scheduling, batches and users are
performed
Data Exchange Server: Registering the test center from CoE, Validate the Test Center by
accepting its MACID, Provide spaces for CoE to upload packages, Data Center
Centralized to download packages.
Excelsoft Technologies Pvt. Ltd
Confidential
–
Data Center – Centralized: Centralized packages will be downloaded, via FTP from Data
Exchange Server. Later the packages are extracted and data is loaded into the database.
Then administrators can register the candidate and allow them to take test and view the
reposts post submission.

Below diagram shows the centralized mode of delivery process through different components.

Below diagram depicts the functional architecture of Centralized test delivery
102 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.2.2. Distributed

In Distributed mode of delivery, the Load on the single centralized server is distributed
acrossmultiple servers at various test centers. This enables huge concurrency since the load is
distributed on each Test Center.Interim reporting servers enableadmin to view the report of the
tests of distributed delivery mode. And at EOD, the whole reportsare available in Centralized report
interface.

This mode of delivery includes various components such as:
–
–
–
103 | P a g e
Controller of Examination CoE : The activities like authoring questions, manage
templates, manage customer, manage tests, scheduling, batches and users are
performed
Data Exchange Server: Registering the test center from CoE, Validate the Test Center by
accepting its MACID, Provide spaces for CoE to upload packages, Data Center
Centralized to download packages.
Data Center – Centralized: Distributed packages will be downloaded, via FTP from Data
Exchange Server. Later the packages are extracted and data is loaded into the database.
The reports of distributed events can be viewed here.
Excelsoft Technologies Pvt. Ltd
Confidential
–
–
Data Center – Distributed: An interim reporting server where reports for the distributed
events are viewed.
Test Center: Distributed packages will be downloaded, via FTP from Data Exchange
server. Later, the packages will be extracted and data will be loaded into the database.
Test center administrators register the candidate of the distributed batch and allow
them to take test.Results packages will be generated and then be uploaded, via FTP to
Data exchange server.

Below diagram shows the distributed mode of delivery process through different components

Below diagram depicts the functional architecture of Distributed test delivery
104 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential

Test Center Architecture
105 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.3. Monitoring Dashboard
A dashboard is available for the Admin to monitor the High Stake exams. The dashboard provides
information on the status of the registration for candidates, how many of them have started the test,
how many of them have submitted etc.
This also has a feature of extending the schedule end time if required. I.e. the Admin can change the
end time of the schedule and the test will be available for the candidates till the updated end time of
the schedule.
106 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.4. Test player features
Below are the features of the SARAS test player:
Feature
Save Response
Bookmark
Loading of Questions
107 | P a g e
Description
If Save Response option is enabled, in case of power /network failure
the responses are saved for the questions which are attempted by the
candidate, once the connection and system are resumed the
candidate can attempt the remaining questions and then submit the
test.
It is an option available on the test player which helps the Candidate
flag or bookmark questions for which they are not clear on the
answers, while taking test. Candidate visits the marked question later
before submitting the test
When a test is presented to the end user, the questions/ images/
audio/ video content first gets loaded onto the test player and then
the test time starts ticking. So, there is no time lost for the Candidate
during loading the questions.
Excelsoft Technologies Pvt. Ltd
Confidential
Mandatory answering of all The Candidates can be forced to answer all the questions with or
the questions
without skipping the questions and then submit the test. This is
configurable
Question navigation panel
The Candidates can navigate through the questions in the test player
through the question navigation panel available on the test player
Question attempted or not - The test player gets the questions highlighted for the questions which
attempted
are attempted in the question navigation panel. Also, the number of
the questions attempted will be displayed
Timer
The count-down timer is displayed in the test player. This ticks initially
only after all the questions have been downloaded. The timer starts
from where it was left out when there is network / power failure.
Providing
more
Question The Candidates can collapse the question navigation panel, which
content Area
makes more space for the question content
Short Cut Keys
The navigation to the questions in the test player is also enabled with
the shortcut keys.
Sections/Blocks for a test
The test player supports the section wise test i.e. blocks which has a
section name or a topic name and in which the respective questions
related to the section is presented.
Max number of questions
There can be a maximum of 100 Questions played per section. And a
total of 360 questions played per test
Maximum number of Sections There can be a maximum of 9 sections
in a Test
Questions in single page or Questions can be displayed in single page or multiple pages for a test.
multiple pages
Max number of questions
A restriction can be set to enforce Candidates attempt maximum
number of questions in a test and only then allow test submission.
Multi Language Support
Test player supports multi languages and hence the questions in
various languages can be presented in the test.
Auto submission on test time Enabling question level time enforcement for tests moves the
elapse
Candidates to the next questions once the present question time is
up.
Similarly, the test player automatically submits the test once the test
duration set is complete
Screen Display
The test is displayed in the test player in full screen and it’s not
possible to maximize or minimize the screen till the test is submitted
unless there is a power failure.
Menu options on the Browser
The Menu options on the browser are disabled. This would restrict
the user to use any of the options available on the browser such as
Back, Refresh etc
Disable Keys
Disabling key functions such as right click options, tab keys, control
keys, when the test is being taken by the candidate on a test player.
Copy / paste options would also be disabled.
Print Screen Option Disabled
The print screen option will not be working when the test taking
activity is going on.
View Test Summary
Test summary report will be displayed to the candidates after the test
is submitted.
Browser Compatibility
Test Players compatible with IE6, IE 7 and Mozilla 2.0 and 3.0
108 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Resolution Compatibility
Single User Login
Test players can run in any resolution on the desktop system
A login credential of a candidate used to take the test is just for the
single user login. No two users can use the same credentials to login
from different locations.
Backward Navigation
The candidates are allowed to go to the previous section in the test
player. This is configurable.
Registration Page
For the tests scheduled for Walk in users, a Mandatory Information
form is provided in the test player before the candidate takes the
test. Only after filling in the required details in the page the walk-in
candidate can proceed with the test taking activity.
Accessibility
Depending on the target users, the font of the questions is decided
during its authoring. The varied font feature in the test player helps
user increase or decrease the font during test taking for more clarity
during test taking.
Exam Utilities
The exam utilities such as calculator or/and notepad are used by
users for easy and fast solving of problems.
Filtration of questions
During test taking, the user can quickly filter the questions which have
been bookmarked / attempted/ yet to be attempted / All
View Solution
When users take practice tests, if the questions are set with solutions,
the solutions can be viewed post-test submission.
Provide Feedback with time On Test submission, the users can provide the feedback either at item
set
or test level. This is configurable.
Instruction page
The Instruction page appears before the users actually enter the test
taking page.
Navigation buttons
User is enabled with easy navigation with the Next, Previous
navigation buttons
Built on HTML5
This enables various revamped questions types on SARAS like Drag
and Drop/Connect the points to be played without the Java plugin.
Personal information of user
The personal information of user such as Name and photograph is
displayed.
 Screen Capture of During Test Taking features
109 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
110 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
 Screen Capture of Post Test Submission features
111 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
112 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.5. Customer Account Settings

The SARAS Test and Assessment system caters to various E-learning organizations such as
Educational institutions, Test-Prep Organizations, High Stake Exam conducting organizations,
Corporates.
Every such organizationhas its own business requirements. All the features and functionalities in
the system may not be useful. Hence, based on the needs, the customers’ account is managed
under ‘Customer Account settings’ feature.
113 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Each customer account has a variety of settings which has to be configured when an
organization is created.
The settings could be on selection of the type of questions or the preferences of the item or the
fields to be displayed while an organization is created and so on.
This is also extended in configuring the General controls for the selected customer.
114 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
14.6. Personalization

The personalization varies from Admin to the end user in the system.
The Admins can change their passwords at any point in time. Also, set the default paging size for
the listing pages such as Manage user. Apart from this, the Admin can decide the language the
application to be presented for their customers’ who are geographically distributed.
At the user level, the personalization is set with changing the passwords only.
14.7. Online Proctoring

The word ‘Proctor’ means supervising an exam. Any exam which is held in an examination hall or
the test center, needs proctoring. Proctoring is required for there are chances of some of the
test takers cheat and pass their examinations with good scores which brings down the scores of
the genuine hard working test takers.
When it comes to proctoring done physically by a proctor or invigilator, they can easily identify
the person cheating and check/allow them to resume the test once the copy materials are taken
/ snatch the papers and end the test for the test taker.

As most of the examinations in recent days are online, it’s important to monitor and control the
activities of the test takers online. This is possible in SARAS Test and Assessment system through
‘Online Proctoring’ feature.
The Admin is created with a privilege to proctor and control the online test taker activities.
The proctor enters the details of all the users and the test they are taking online. In the same
hall there can be users who take the same test or different test. (e.g., at schools, students of
various classes are grouped to take exams).
115 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential
Proctor views the total no. of questions in the test, and can perform the activities on a cheating
test taker, which includes:
Pause: Pause the test for selected test taker. Test taker is stopped from taking the test and
views a time counting down to zero, post which the test is resumed. The timer stops when test
is paused.
Resume: Proctor allows the test taker to resume the test with regards to time and the questions
responded.
Suspend: Proctor stops the test taker from taking the test. Results are generated only for the
responses before suspension.
Add time: Proctor provides additional time if any test taker requires. The same gets reflected in
test taker reports as well.
Status: Displays test taking status such as ‘started’, ‘in progress’, ‘submitted’
Page refresh: Page refreshes automatically once in every 30 seconds to retrieve the test status.
Or the page can be refreshed manually.
Clear list: The list of all the test takers will be cleared to view the new list of users.
116 | P a g e
Excelsoft Technologies Pvt. Ltd
Confidential