Affordable Software Simulations For
Teaching Legal Practice
Presentation by Scott Chamberlain
To PERL Workshop
16 March 2017
Overview
•
•
The Problem of e-Simulations
The ANU LRP Platform:
–
–
–
–
–
–
•
Overview
Simulations
Roles
Courses
Feedback
Multi-tenanted
Benefits of ANULRP Platform
2
The Problem of e-Simulations
•
Simulating legal work face-to-face is not easy:
–
•
Simulating legal work online is not cheap:
–
•
Existing methods for simulating legal work are resource intensive, often requiring face-to-face participation
from students and a wide range of teachers and professional mentors. Standardising this experience
(including standardised clients, feedback and assessment) is challenging.
Technology, including VR, promises to overcome many of the difficulties in simulating legal work, but the
cost is often prohibitive and there are institutional barriers (need for budget constraints, elongated approval
processes, need for different disciplines –IT and Lecturers - to work together) to projects getting off the
ground and/or delivering practical benefits.
Easy, Affordable, and Rigorous Online Simulations:
–
Our LRPS aims to gain the benefits of simulating legal work online without the attendant costs and barriers.
3
What is the ANU LRP Simulator?
An online e-learning tool:
•For Lecturers: Allows them to convert real-life matters into online single or
multi-player Role Plays as learning tools for Students;
•For Students: An engaging, self-paced and managed-paced experiential
learning opportunities as a safe place to develop their legal skills
•For Researchers: with quality data to determine what works and what does
not.
•For Universities: available to all Universities to provide an affordable, flexible
and easy-to-integrate platform for teaching legal skills
4
Overview of System
•
•
•
•
•
•
The Scenario Centre: Allows Teachers to create, test, edit, clone Simulations.
The Role Play Centre: Allows Students to play Simulations in Courses and allows Teachers to take part in Role
Plays in their Courses as Players or as Judges or Mentors or Clients or Non-Player Roles.
The Student Centre: Allows Students to view and access their Courses, to manage their account; to view and
access their Role Plays, to view their Scores, League Tables, Reputations, Game Records and Learning
Materials, to interact with their Teachers in their Courses, and to contact Admin.
The Teacher Centre: Allows Teachers to view and set permissions for their Simulations and access the Scenario
Centre, to view and manage their Courses, to attach Scenarios to the Courses, to interact with Students and
assign Students to Role Plays within their Courses, to assign Non-Player Roles to Teachers within their Course, to
upload Learning Modules and attach Learning Modules to their Courses.
The Administration Centre: Allows the ANU administration staff to create and manage Teacher accounts, to
create and manage Student accounts, to create Courses and to assign Teachers and Students to Courses.
The Reports Interface: Allows Teachers to extract data for the purposes of reports for research.
5
Web page title
http://www.anulrp.com
Legal Role Play
Home
Courses
Logged in as
[email protected]
Scenarios
Log Off
Home / Scenarios / Manage Scenarios
Teacher can
clone scenarios
Manage
Scenarios
Once scenario
created its
default visibility
set to Private.
New
search
Scenario
Title
Scenario 1
Scenario
Type
Exercise
Scenario 3
Game
Scenario 4
Exercise
Scenario 4
Game
Scenario 4
Exercise
Scenario 3
Game
Owner
Jordan
Bryan
Jordan
Bryan
Michael
Oher
Kate
Hudson
Kate
Hudson
Jordan
Bryan
Visibility Playe
r
Roles
Non Player
Roles
Private
1
2
Round
s
4
Period
Edit
Clone
Delete
Edit
Delete
Clone Unpublish
Edit
Clone
Delete
Edit
Delete
Clone
Edit
Delete
Clone
Publish
12 Hours
Shared
3
2
5
6 Hours
Shared
4
3
3
1 Day
Shared
3
1
5
6 Days
Public
2
1
4
12 Hours
Shared
5
2
7
6 Hours
Unpublish
Clone
Edit
Delete
Web page title
http://www.anulrp.com
Legal Role Play
Home
Courses
Scenarios Modules
Role Plays
My Profile
League Tables
Home / Courses / LAWS1202 - Lawyers, Justice and Ethics
LAWS1202
Lawyers, Justice and Ethics
Course Details
Teachers
-
Students
search
Student ID
LAW_001
LAW_002
LAW_003
LAW_004
LAW_005
LAW_006
Role Plays
Name
Dan Murphy
Katrina John
Geena Dias
Alexander Xavier
Sue Chan
Hobart Herold
Email
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
[email protected]
Logged in as [email protected] Log Off
Web page title
http://www.anulrp.com
Home
Legal Role Play Tables
From the Spec:
6.8 LEARNING
MODULES
As a Student I
want to be able
to readily access
the Learning
Modules
attached to my
Courses.
Courses
Role Plays
My Profile
League
Logged in as [email protected]
Log Off
Home
LAWS1202
Lawyers, Justice and Ethics
1. Students can see
Learning materials
with “Public”
setting
2. Students can
download learning
materials
Course Details
Teachers
Students
-
Learning Modules
Modules
Reference Materials
Lecture Notes
Owner
Jordan Bryan
Kate Hudson
Units
Chapters
Michael Oher
Ornella Winston
Download
Download
Download
Download
Web page title
http://www.anulrp.com
Home
Tables
Legal Role Play
Courses
Role Plays
My Profile
League
Logged in as [email protected]
Home > Role Plays
1. Available
Panel will be
expanded by
default
From the Spec:
6.1 ROLE PLAYS
As a Student I want
to be able to see
the Role Plays I am
playing, a summary
of the current state
of the Game,
whether there are
any alerts for me in
relation to that
Game, and to
access the
Game.
Role Plays
-
Available
Course Code
Role Play ID
Role Play Name
LAWS1202
LAWSRP1290
Climate Change Negotiation Role-Play
Joined, Awaiting Players
Active
Finished Awaiting Ratings
Completed
Log Off
Join
More About Simulations
•
•
•
•
•
•
Text and image based – No AI (in phase 1)
Multi-player (One to infinite number of Roles)
Rely on interaction between Students (players) and Faculty (non-players)
Role plays use combination of Items, Issues, Decisions and Events to
model reality
Allows for objective scores, no scores, or scores determined by polling of
players and/or non-players.
Lecturers can design simulations without IT/Programming Skills
10
Web page title
http://www.anulrp.com
Legal Role Play
Home
Courses
Scenarios
Logged in as [email protected]
Log Off
Home
New Scenario
Scenario Details
Player Roles
Non Player Roles
Items
Decisions
Trading Rules
Events
Payoff Matrices
Survey
Poll
Debrief
Scenario Details panel is
the only section that will
be enabled when user
landing to this page to
create new scenario.
After saving basic
Scenario Details other
panels get enabled.
Web page title
http://www.anulrp.com
New Decision
Name
Description
Owner
Status
Available
Visibility
Shared
Availability
Set Availability Rule - Score
Status : Available
and Not Available.
‘Taken’ is not set
here, as it will be
automatically set
while the game is
on.
Lawyer
Judge
Client
+
This Decision IS NOT
Available when
score equals 100 AND round equals 2 +
OR
score equals 200 AND round equals 6 +
+
When the “plus” icon
is clicked, the system
will show the game
state selection pop –
Score
Visibility :
Public
Private
Shared  Role
Hidden
100
equals
Ok
1
Equal
Not Equal
Less than
Less than or Equ
Greater than
Greater than or
Cancel
Set Availability Rule - Communication
Communication between Lawyer
AND Judge
is
Open
Ok
Open
Close
Cancel
x
x
Score
Communication
Round
Item
Decision
Event
2
Continued in the next
slide
Web page title
http://www.anulrp.com
Legal Role Play
Home
Tables
Courses
Role Plays
Player
s
Item
s
Decision
s
Role Play 1
1
5
01: 30:
25
Role Play Name
Corporate Decision-Making Negotiation Role-Play
Scenario
Corporate Decision Making Scenario
Duration
3 days – 3 Rounds
Description
Two-team, multi-issue collective bargaining contract negotiation
between 3 union representatives and 3 management representatives for
a telephone company.
My Role
Lawyer 1
Lawyer 2
Non Player Roles
Client
Proposal
s
My Brief
Instructions for the Role Play should be displayed under this section
View Brief
Log Off
Lawy
er 1
Lawyer 2
i
Player Roles
Polls
Logged in as [email protected]
Role Play Details
My
Score
Surveys
League
3
Role
Play 1
Round 1
Game
Info
My Profile
Type Here!
More About Roles
• Students undertake Player Roles – they are active participants who
receive the different types of feedback arising from the simulations
• Teachers can be assigned to undertake Non-player roles which
include:
– Judge: Can make in-game decisions affecting the “game state” of a Simulation
– Client: Can only communicate with their “lawyer” (Student)
– Mentor: Can communicate with one or more Students and “see” their Simulation
as so be able to offer guidance/mentoring
14
Web page title
http://www.anulrp.com
Legal Role Play
Home
Courses
Role
Play 1
Round 1
Scenarios
Role Plays
My Profile
League Tables
Logged in as [email protected]
3
Judgement View
1
5
01: 30:
25
Game Info
Lawyer 2
Players
Items
i
Lawyer 1
View Reputation
Lawyer 2
View Reputation
Scores
Proposals
Survey
s
Polls
Judg
e
Lawyer 1
Judge (Myself)
Decisions
Log Off
Type Here!
More About Courses
• Courses are groups of students playing one or more Simulations in
a defined order overseen by a Course Convener and Teachers;
• Courses can be:
– self-paced – students undertake Simulations at own pace and
self-match with Students simultaneously looking to undertake
Simulation
– managed paced – Course Convener assigns Students to
Simulations and determines when they will start and end.
16
Web page title
http://www.anulrp.com
Legal Role Play
Only convener can see the
Publish, Un-publish, Edit,
delete buttons.
“Game Record” button will
appear for all the role
plays which have Started
or Completed.
All The Teachers in this
course can see the “Game
Records” of all the Role
plays in that course.
When clicked on the
“Game Record” will get
navigated to slide 47-67
in student centre mockup
Home
Courses
Scenarios Modules
Role Plays
My Profile
League Tables
Logged in as [email protected]
Home / Courses / LAWS1202 - Lawyers, Justice and Ethics
LAWS1202
Lawyers, Justice and Ethics
-
Role Plays
Search by
Student Name
New
search
Role
Scenario1
Play1
Player
Non Player
Roles
NPR1: Teacher1
Roles Student1
PR1:
PR2: Student2
PR3: Student3
Game Record
Mode: ManagedPaced
State : Started
NPR2: Teacher2
Edit
Delete
Show More
Log Off
Web page title
http://www.anulrp.com
Legal Role Play
Home
Courses
Scenarios
Modules
Role Plays
Logged in as [email protected]
Home / Courses / LAWS1202 - Lawyers, Justice and Ethics / Edit
Assign Students
Demo Self-Paced
Editing a
Role Play which is
already started
Except for the
name, rest of the
role play details are
read only.
Name
Demo Self-Paced
Scenario
Wintel Scenario
Mode
Self-Paced
Players
Students
Assigned Students
Student 5
Student 6
Student 7
Student 8
Student 1
Student 2
Student 3
Student 4
+
Student 1
Student 2
Student 3
Student 4
Assign Teachers
Non-Players
+
Teacher 1
Teacher 4
Save
Cancel
Teachers
Assigned Teachers
Teacher 3
Teacher 2
Teacher 5
Teacher 1
Teacher 4
Log Off
More About Student Feedback
Students receive:
•
•
•
•
•
•
A Ranking: which is the point score from the Role Play expressed as a % of lower
scores achieved by any student for that role in any previous role plays
A Reputation: a peer assessment of soft skills and perceptions;
League Tables: showing students with highest Rankings and Reputations by
Scenario, and by Last Five Games and All Games;
Game Records: post-game access to all records from each Player’s POV;
Debriefs: text, images and links explaining what a Student should have done to do
well in a Role Play;
Learning Modules which can be accessed inside the Simulations.
19
Web page title
http://www.anulrp.com
Legal
Legal Role
Role Play
Play
Home Courses
Role Plays
My Profile League
League
Home
My Profile
Tables
Tables Courses Role Plays
Logged in as [email protected]
Log Off
Home > Role Plays > LAWSRP1290 Game Record for <Student Name>
LAWSRP1290 Game Record for <Student
Name>
-
Role Play Details
Role Play ID
LAWSRP1290
Scenario
Role Play Name
Corporate Decision-Making
Negotiation Role-Play
Corporate Decision-Making
Negotiation
Duration
3 days – 3 Rounds
Course Code
LAWS1202
Course
Lawyers, Justice and Ethics
Course Convener
Jordan Bryan
Roles
Briefs
Debriefs
History Logs
Description
Two-team, multi-issue collective
bargaining contract negotiation
between three union
representatives and….
Details section is
expanded by
default
Web page title
http://www.anulrp.com
Legal Role Play
Home
Tables
Courses
Role Plays
My Profile
League
Logged in as [email protected]
Home > Role Plays > LAWSRP1290 Game Record for <Student Name>
LAWSRP1290 Game Record for <Student
Name>
Role Play Details
Roles
Briefs
Debriefs
-
History
Items>>
Actions>>
Payoff Matrix>>
Messages>>
Chats>>
Proposals
Agreements >>
Surveys>>
Polls>>
Points >>
Log Off
Web page title
http://www.anulrp.com
Legal Role Play
From the Spec:
6.4 RANKING
As a Student I want to be able to
view my Ranking by each Game,
Average of last 5 Role Plays, or
All Role Plays.
My Game Ranking is the % of
players whose raw score was less
than mine for the same
Role.
My Average Ranking is the average
% of the % of Players whose raw
score was less than
mine for the same Role for each of
my last 5 completed Role Plays.
(So: 20% + 30% + 40%
+ 50% + 60% = 200%/5 Role Plays
= Average Ranking of 40%)
My Overall Ranking is average % of
the % of Players whose raw score
was less than mine
for the same Role for each one of
my completed Role Plays.
As a Student I want to see how my
Average and Overall Rankings have
changed over time.
Home
Tables
Courses
Role Plays
Logged in as [email protected]
My Rating
And
Reputation
My Ranking
Role Play5
My Game Ranking
40%
5 Completed RoleRanking
MyLastAverage
20%
30%
40%
50%
60%
35.72%
All Completed Role Plays
Role Play 1
Role Play 2
Role Play 3
Role Play 4
Role Play 5
Role Play 6
Role Play 7
League
My Ranking
Home > My Ranking
Plays
Role Play 3
Role Play 4
Role Play 5
Role Play 6
Role Play 7
My Profile
20%
30%
20%
30%
40%
50%
60%
My Overall Ranking
Role : Role1
40%
Log Off
Web page title
http://www.anulrp.com
Home
Tables
Legal Role Play
Courses
Role Plays
My Profile
League
Logged in as [email protected]
My Ranking
Home > My Ratings and Reputation
My Rating
And Reputation
My Ratings and Reputation
1. First Box shows
the average value
of 6 attributes for
the Last 5
completed Role
plays
1
Average Reputation
Likeability
Empathy
Competence
Trustworthiness
Competitiveness
Reputation
Ruthlessness
2
LAST 5 ROLE PLAYS
<Role Play
Name>:<RoleName>
Likeability
Log Off
Role Play 1 : Role 2
Role Play 2 : Role 6
Likeability
Likeability
Role Play 3 : Role 1
Likeability
Empathy
Empathy
Empathy
Empathy
Competence
Competence
Competence
Competence
Trustworthiness
Trustworthiness
Trustworthiness
Trustworthiness
Competitiveness
Competitiveness
Competitiveness
Competitiveness
Ruthlessness
Ruthlessness
Ruthlessness
Ruthlessness
Reputation
Comment
from Role 2
text
Reputation
Comment
from Role 1
text
Reputation
Comment
from Role 1
text
Reputation
Comment
from Role 2
text
Reputation
Comment
from Role 3
text
Reputation
Comment
from Role 3
text
Reputation
Comment
from Role 3
text
Reputation
Comment
from Role 3
text
Reputation
Comment
text
Reputation
2. Second section
“Last 5 Role
Plays”
summarizes the
Ratings given by
each role of a
particular role
play
Continued in
next slide
Web page title
http://www.anulrp.com
Home
Tables
Legal Role Play
Courses
Role Plays
My Profile
League
Logged in as [email protected]
Home > League Tables
From the Spec:
6.9 LEAGUE
TABLES
As a Student I
want to be able
to see league
tables showing:
League Tables
Role Play
1
1. For each
game, the ten
highest ranked
Usernames for
each Role
2. The ten
highest
Usernames by
Average Ranking
3. The ten
highest
Usernames by
Overall Ranking
(excluding
students who
have not played
at least 5 Role
Plays).
Role1
Role2
Role3
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
Nellie Bland
Kelsie Kmetz
Louise Mcguffin
Harold Marcinek
Theodore Markert
Maida Gaughan
Karlyn Zhao
Spring Chenail
Gerri Selzer
Hyman Fikes
Highest Average Rankings 1.
2
2.
3.
4.
5.
6.
7.
8.
9.
10.
Nellie Bland
Kelsie Kmetz
Louise Mcguffin
Harold Marcinek
Theodore Markert
Maida Gaughan
Karlyn Zhao
Spring Chenail
Gerri Selzer
Hyman Fikes
Nellie Bland
Kelsie Kmetz
Louise Mcguffin
Harold Marcinek
Theodore Markert
Maida Gaughan
Karlyn Zhao
Spring Chenail
Gerri Selzer
Hyman Fikes
Nellie Bland
Kelsie Kmetz
Louise Mcguffin
Harold Marcinek
Theodore Markert
Maida Gaughan
Karlyn Zhao
Spring Chenail
Gerri Selzer
Hyman Fikes
Highest Overall Rankings 1.
3
2.
3.
4.
5.
6.
7.
8.
9.
10.
Nellie Bland
Kelsie Kmetz
Louise Mcguffin
Harold Marcinek
Theodore Markert
Maida Gaughan
Karlyn Zhao
Spring Chenail
Gerri Selzer
Hyman Fikes
Log Off
More About Multi-Tenanted
System Is Not Just For ANU
•Available to All: System will be useable by all Universities, not just ANU
•Share Simulations: Lecturers will be able to share their Simulations so that other
lecturers can include their Simulations in their courses;
•Multi-Uni Courses: System will have “public” course settings which will mean students
in one course could undertake self-paced simulations with students in other courses
being undertaken at other universities.
25
Benefits – Cost Effectiveness
The software overcomes enables self-paced learning from students
with limited oversight from teaching staff.
Even very complex scenarios can be realistically modelled with limited
oversight from teach staff;
Assessment is a real-time/automated, making it highly scalable as
teaching staff are relieved of the need for constant marking.
27
Benefits - Education
To develop skills requires safe opportunities to
practice and develop those skills, with feedback.
The software overcomes these limitations,
enabling realistic opportunities for skills practice
and development.
28
Benefits - Research
The system will also collect and store data from
Role Plays:
• an unparalleled store of data from which to
undertake research on negotiation skills and
legal practice;
• allow for realistic automation/bot-driven role
plays, obviating need for multiple players.
29
When?
Currently in development
Beta – Late 2017
Publically Available – Mid-Late 2018
30