(and post-editor’s)
^
Reviewer’s Workbench
Harnessing ITS Metadata to Improve the
Human Review Process
Phil Ritchie, CTO, VistaTEC
Presented by Mel Howes, VistaTEC
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Context
XLIFF
Terminology
Post
Edit
Segment
ITS
Quality
Check
Extract
HTML5
CMIS
HTML5
CMIS
RDF:
The MultilingualWeb-LT Working Group receives funding by the
European
Commission (project name LT-Web) through the Seventh
PROV
NIF
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Current Approach
Reviewer is often
instructed on how
much time to spend or
amount of content to
review.
This amounts to a
random, human
judgement on what to
look at.
This amounts to a
process which is
statistically unlikely to
discover errors.
Risk increases the
larger the volume.
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Current Practice
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Audit Trail
MT
Auto-QA
Post-edit
Deliver
Review
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Reviewer’s Workbench
Demonstration
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Scenario
•Agent provenance
available
Automated
QA Check
•Checkmate, QA
Distiller or similar
•Review Sentinel
•“Nonconformance”
scores added
Text
Classification
Translation
•
•
Review
•Human review
using Reviewer’s
Workbench
•Linked Data
queries
Business
Intelligence
•Trends to inform
future approach
Conversion to
RDF
Provenance (human and automated agents)
Localization Quality Issue
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Reviewer’s Workbench
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Business Value – Review Process
• Review Process
– Single reviewing environment
• No double transcription of errors
– “Informed” focus of attention
• Greater efficiency
– Full audit trail
– Import into enterprise QA database possible
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Business Value – BI and DS
• Business Intelligence and Decision Support
– Cross silo queries
• Join metadata gathered by client at authoring stage with
translation review metadata
• Discover new relationships/correlations between source
and target; agents
• New forms of inferential queries and data visualisation
– Better up-front and real-time business decision
support
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
BI Visualisation
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.
Run-time Intelligence
The MultilingualWeb-LT Working Group receives funding by the European Commission (project name LT-Web) through the Seventh
Framework Programme (FP7) in the area of Language Technologies. Grant Agreement No. 287815.