TS 103 246-5 V0.0.5 (2015-01)
TECHNICAL SPECIFICATION
Satellite Earth Stations and Systems (SES);
GNSS-based Location Systems;
Part 5: Performance Test Specification

2
TS 103 246-5 V0.0.5 (2015-01)
Reference
DTS/SES-00349
Keywords
GNSS, location, MSS, navigation, performance,
receiver, satellite, system, terminal
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute yyyy.
All rights reserved.
DECTTM, PLUGTESTSTM, UMTSTM and the ETSI logo are Trade Marks of ETSI registered for the benefit of its Members.
3GPPTM and LTE™ are Trade Marks of ETSI registered for the benefit of its Members and
of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3
TS 103 246-5 V0.0.5 (2015-01)
Contents
Contents .............................................................................................................................................................. 3
Intellectual Property Rights ................................................................................................................................ 4
Foreword............................................................................................................................................................. 4
Introduction ........................................................................................................................................................ 4
1
Scope ........................................................................................................................................................ 4
2
References ................................................................................................................................................ 5
2.1
2.2
3
3.1
3.2
3.3
Normative references ......................................................................................................................................... 5
Informative references ....................................................................................................................................... 5
Definitions, symbols and abbreviations ................................................................................................... 6
Definitions ......................................................................................................................................................... 6
Symbols ............................................................................................................................................................. 6
Abbreviations ..................................................................................................................................................... 6
4
General ..................................................................................................................................................... 7
5
Horizontal Position Accuracy .................................................................................................................. 7
5.1
5.2
5.2.1
5.2.2
5.2.3
Test Objectives & Case definitions .................................................................................................................... 7
Method of Test ................................................................................................................................................... 7
Initial conditions........................................................................................................................................... 7
Procedure ..................................................................................................................................................... 7
Pass/fail criteria ............................................................................................................................................ 7
6
Vertical Position Accuracy....................................................................................................................... 8
7
GNSS Time Accuracy .............................................................................................................................. 8
8
Time-to-First-Fix (TTFF)......................................................................................................................... 8
9
Position Authenticity ................................................................................................................................ 9
9.1
9.2
9.2.1
9.2.2
9.2.3
Test purpose ....................................................................................................................................................... 9
Method of test .................................................................................................................................................... 9
Initial conditions........................................................................................................................................... 9
Test procedures ............................................................................................................................................ 9
Test pass/fail criteria .................................................................................................................................. 11
10
Robustness to Interference ..................................................................................................................... 11
11
GNSS Sensitivity ................................................................................................................................... 11
12
Position Integrity (Protection Level) ...................................................................................................... 11
History .............................................................................................................................................................. 25
ETSI
4
TS 103 246-5 V0.0.5 (2015-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://ipr.etsi.org).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This Technical Specification (TS) has been produced by ETSI Technical Committee Satellite Earth Stations and
Systems (SES).
Introduction
The increasing proliferation of location-based services is based on several trends in user applications and devices; these
include notably the widespread adoption of multi-functional smart-phones etc., and the wider adoption of tracking
devices (e.g. in transport). This need for new and innovative location-based services is generating a need for
increasingly complex location systems. These systems are designed to deliver location-related information for one or
more location targets to user applications.
The wide spectrum of technical features identified in [i.1] calls for a new and broader concept for location systems,
taking into account hybrid solutions in which GNSS technologies are complemented with other technology sensors to
improve robustness and the performance.
Hence a set of standards for GNSS-based Location systems is defined as follows, of which the present document is
part 5:
ETSI TS 103 246-1: GNSS-based Location Systems; Part 1: Functional requirements [1]
ETSI TS 103 246-2: GNSS-based Location Systems; Part 2: Reference Architecture [i.2]
ETSI TS 103 246-3: GNSS-based Location Systems; Part 3: Performance Requirements [2]
ETSI TS 103 246-4: GNSS-based Location Systems; Part 4: Requirements for Location Data Exchange Protocols [i.3]
ETSI TS 103 246-5: GNSS-based Location Systems; Part 5: Performance Test Specification.
1 Scope
This document specifies the procedures for testing conformance of a GNSS-based Location System (GBLS) with the
Performance Requirements specified in [2].
The tests specified are of a complete GBLS, considered as “Black Box” i.e. the tests are made at outputs of the system
in response to stimuli applied at the inputs.
The tests are defined for laboratory testing only, and not in the “field”.
ETSI
5
TS 103 246-5 V0.0.5 (2015-01)
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE:
While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
[1] ETSI TS 103 246-1: “GNSS-based Location Systems; Part 1: Functional requirements”.
[2] ETSI TS 103 246-3: “GNSS-based Location Systems; Part 3: Performance Requirements ”
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI TR 103 183 “Satellite Earth Stations and Systems (SES); Global Navigation Satellite Systems (GNSS)based applications and standardisation needs”.
[i.2] ETSI TR 101 593 “Satellite Earth Stations and Systems (SES); Global Navigation Satellite System (GNSS)based location systems; Minimum performance and features”.
[i.3] ETSI TS 103 246-2: “GNSS-based Location Systems; Part 2: Reference Architecture”
[i.4] ETSI TS 103 246-4: “GNSS-based Location Systems; Part 4: Requirements for Location Data Exchange
Protocols ”
[i.5]
ETSI
6
TS 103 246-5 V0.0.5 (2015-01)
3 Definitions, symbols and abbreviations
With the exception of those below which are specific to this document, definitions, symbols and abbreviations are given
in Part 1 of this specification.
3.1 Definitions
For the purposes of the present document, the following terms and definitions apply:
Accuracy: the difference between the estimated value and its real value.
3.2 Symbols
3.3 Abbreviations
ETSI
7
TS 103 246-5 V0.0.5 (2015-01)
4 General
The following clauses define the test procedures required to test conformance with each of the performance Features
defined in [2].
These Features are:
1.
Horizontal Position Accuracy
2.
Vertical Position Accuracy
3.
GNSS Time Accuracy
4.
Time-to-First-Fix (TTFF)
5.
Position Authenticity
6.
Robustness to Interference
7.
GNSS Sensitivity
8.
Position Integrity (Protection Level).
In the following for each feature: complete test procedure, environments, test case for implementation profile based on
ref architecture.
Complete procedure with exhaustive list of steps for each feature.
Foe each feature, system profile with applicable no. of steps.
Pass/fail criteria.
5 Horizontal Position Accuracy
Kevin………..
5.1 Test Objectives & Case definitions
Test cases are combinations of implementation profile, static/dynamic conditions and operational environment.
Limited to GNSS + relevant sensor type for the feature.
5.2 Method of Test
Single procedure preferred with specific test cases and configurations
5.2.1 Initial conditions
5.2.2 Procedure
[duration of the test / number of trajectories / minimum number of samples / initialisation phase shall be specified]
5.2.3 Pass/fail criteria
For all cases/architecture:
ETSI
8
TS 103 246-5 V0.0.5 (2015-01)
Filter the initial conditions, procedure steps and criteria according to their applicability and test cases (large table).
6 Vertical Position Accuracy
Kevin………..
This Feature is the maximum error of the vertical position of a Location target reported by the GBLS.
7 GNSS Time Accuracy
Kevin………..
The GNSS time accuracy is the difference between the true GNSS time (as implemented in the GNSS system timing
facility) and the time restituted by the GNSS processor based on the PVT solution.
8 Time-to-First-Fix (TTFF)
Define the place where reacquisition is launched.
Paolo could propose test procedure as an example
ETSI
9
TS 103 246-5 V0.0.5 (2015-01)
9 Position Authenticity
9.1 Test purpose
The purpose of this test is:

to verify the performance of the GBLS in avoiding alarms under nominal GNSS signal conditions and no
interfering signals (Clear scenario);

to verify the performance of the GBLS in detecting a spoofing attack (Threat scenario).
9.2 Method of test
This test considers the block diagram of the GBLS reported in B.1, and assumes as applicable GNSS those defined in
the Annex A of [2], in open sky conditions. Furthermore, this test considers the threat scenarios defined in the Annex B
of [2].
9.2.1 Initial conditions
If the test is performed in an anechoic room:
1. Set up the equipment as illustrated in Figure 12.1;
2. If needed, set the PC or the system used to collect data at the output of the positioning module under test;
Otherwise, if the test is performed with wired connections:
1. Set up the equipment as illustrated in Figure 12.2. A RF signal combiner is used to combine signals generated by
the GSG, and the RF spoofer. Connect:
o
the RF signal output of the GSG to the port 1 of the RF signal combiner;
o
the RF signal output of the RF spoofer to the port 2 of the RF signal combiner;
o
the sum port of the RF signal combiner to the GNSS sensor antenna connector.
2. If needed, set the PC or the system used to collect data at the output of the positioning module under test;
9.2.2 Test procedures
In the clear scenarios, the GNSS sensor receives authentic GNSS signals only The RF spoofer remains switched off.
In the interference spoofing scenario, if the GSG is able to generate shadowed spoofing attacks, the RF spoofer is not
needed, because both authentic and false signals are generated by the GSG.
9.2.2.1 Test case “Clear scenario”, Moving location target
1. Set the GSG parameters in order to generate GNSS signals as defined in the Annex A of [2], in open sky
conditions;
2. Set the GSG parameters in order to generate GNSS signals as seen by the GNSS sensor in the initial position at
longitude = 7°03'12" East and latitude = 43°37'00" North (i.e.: coordinates expressed in the WGS84 system) and
moving on a straight trajectory at uniform speed of 50Km/h;
3. Activate the RF signals at the output of the GSG and switch on the GNSS sensor. Wait until the scenario preconditions are verified (i.e.: (i) the GNSS sensor tracks the satellite signals generated by the GSG, (ii) the GNSS
sensor provides valid PVT estimates).
ETSI
10
TS 103 246-5 V0.0.5 (2015-01)
4. Collect statistically independent measurements at the output of the Location Authentication module, over a
predefined time window sufficient to collect at least 104 values;
5. Compute the test the pass/fail criteria.
9.2.2.2 Test case “Interference Spoofing Scenarios M-1, M-2 and M-3”, Moving location
target
1. Set the GSG parameters in order to generate GNSS signals as defined in the Annex A of [2], in open sky
conditions;
2. Set the GSG parameters in order to generate GNSS signals as seen by the GNSS sensor in the initial position at
longitude = 7°03'12" East and latitude = 43°37'00" North (i.e.: coordinates expressed in the WGS84 system) and
moving on a straight trajectory at uniform speed of 50Km/h;
3. Set the RF spoofer parameters in order to generate false GNSS signals according to the scenario under test (i.e.:
M-1, M-2, or M-3) defined in clause B.1.1.1 of [2];
4. Activate the RF signals at the output of the GSG and switch on the GNSS sensor. Wait until the scenario preconditions are verified (i.e.: (i) the GNSS sensor tracks the satellite signals generated by the GSG, (ii) the GNSS
sensor provides valid PVT estimates).
5. Activate the RF signals at the output of the RF spoofer;
6. Collect statistically independent measurements at the output of the Location Authentication module, over a
predefined time window sufficient to collect at least 103 values;
7. Compute the test the pass/fail criteria.
9.2.2.3 Test case “Clear scenario”, Static location target
1. Set the GSG parameters in order to generate GNSS signals as defined in the Annex A of [2], in open sky
conditions;
2. Set the GSG parameters in order to generate GNSS signals as seen by the GNSS sensor in a static position with
coordinates expressed in the WGS84 system equal to longitude = 7°03'12" East and latitude = 43°37'00" North;
3. Activate the RF signals at the output of the GSG and switch on the GNSS sensor. Wait until the scenario preconditions are verified (i.e.: (i) the GNSS sensor tracks the satellite signals generated by the GSG, (ii) the GNSS
sensor provides valid PVT estimates).
4. Collect statistically independent measurements at the output of the Location Authentication module, over a
predefined time window sufficient to collect at least 2104 values;
5. Compute the test the pass/fail criteria.
9.2.2.4 Test case “Interference Spoofing Scenarios S-1, S-2 and S-3”, Static location
target
1. Set the GSG parameters in order to generate GNSS signals as defined in the Annex A of [2], in open sky
conditions;
2. Set the GSG parameters in order to generate GNSS signals as seen by the GNSS sensor in a static position with
coordinates expressed in the WGS84 system equal to longitude = 7°03'12" East and latitude = 43°37'00" North;
3. Set the RF spoofer parameters in order to generate false GNSS signals according to the scenario under test (i.e.:
S-1, S-2 or S-3) defined in clause B.1.1.1 of [2];
ETSI
11
TS 103 246-5 V0.0.5 (2015-01)
4. Activate the RF signals at the output of the GSG and switch on the GNSS sensor. Wait until the scenario preconditions are verified (i.e.: (i) the GNSS sensor tracks the satellite signals generated by the GSG, (ii) the GNSS
sensor provides valid PVT estimates).
5. Activate the RF signals at the output of the RF spoofer;
6. Collect statistically independent measurements at the output of the Location Authentication module, over a
predefined time window sufficient to collect at least 103 values;
7. Compute the test the pass/fail criteria.
9.2.3 Test pass/fail criteria
TBC
Expressed as performance consolidated over all defined test cases : “fault free performance” + “threat scenario#1
performance + “” …
10 Robustness to Interference
11 GNSS Sensitivity
12 Position Integrity (Protection Level)
ETSI
12
TS 103 246-5 V0.0.5 (2015-01)
Annex A (normative):
A.1
General Test conditions
A.1.1
GNSS test conditions
A.1.2
Other Sensors……………..
A.1.3
Dynamic test conditions
A.1.4
Magnetic test conditions
Annex B GBLS Implementation profiles
This clause defines a number of typical implementations of the overall GBLS architecture.
Referred to above?
Typical GBLS architectures are .
9.
LTE terminal, connected via IP to a SUPL Location server disseminating GNSS assistance data, and providing
data to a local or distant application
10. RTK-compatible terminal, mounted on a farming vehicule, receiving RTK corrections from a reference station,
and providing location-related information to an automatic guidance device,
11. Standalone GPS+GALILEO receiver, embedded in a personal navigation device, and providing positionrelated information to the device navigation software application,
12. Automotive built-it navigation terminal, elaborating location-related information from multi-sensor
information (GNSS, odometer), and providing it to the car navigation software application.
13. Network of GNSS bandwidths monitoring stations, all connected to a central processing facility, with the
objective to provide location-related information of possible interference sources to an external client
14. Multisensor terminal mounted on road vehicules usager providing hybridized location-related information to
dedicated billing facility in the frame of electronic fee collection application
ETSI
13
B.1
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #1
Typical architecture for standalone, multiconstellation GNSS receiver. The GBLS is then limited to a positioning
module, embedded on a navigation terminal.
ETSI
14
B.2
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #2
Typical architecture for Electronic Fee Collection terminal. The GBLS is then limited to a positioning module,
embedded on an on-board charging unit.
ETSI
15
B.3
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #3
Typical architecture mapped to the usual GSM, UMTS, LTE or OMA framework. The GBLS embeds the various
components involved in the LCS provision from infrastructure point of view (SMLC, GMLC), and the application
module(s) on-board the handset(s) (MS, UE).
ETSI
16
B.4
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #4
Typical architecture for can on-board navigation device (e.g eCall). The GBLS is then limited to a positioning module,
embedded on an on-board navigation system.
B.5
Implementation Profile #5
Typical architecture for DGNSS-based or RTK-based GBLSs used as a support for precision farming guidance systems.
The GBLS is then composed of a reference station (central facility), and one or several positioning modules embedded
in the farming vehicles.
ETSI
17
B.6
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #6
Typical architecture for GBLS operating in constrained electro-magnetic environment, and seeking for reliability of
computed position.
ETSI
18
B.7
TS 103 246-5 V0.0.5 (2015-01)
Implementation Profile #7
Typical architecture for a personal navigation device. The GBLS is then limited to a positioning module, embedded on
a navigation terminal.
ETSI
19
TS 103 246-5 V0.0.5 (2015-01)
Annex C (informative)
Connection diagrams
Definition of terms
GNSS Signal Generator (GSG): A device or system, that is capable of generating simulated GNSS satellite
transmissions in order to create the required test environment for the GNSS sensor under test.
RF spoofer: A device or system, that is capable to deceive GNSS receivers, through the generation and the
transmission of false GNSS signals.
Figure 12.1: System set up for position authenticity minimum performance requirements test in anechoic room
Figure 12.2: System set up for position authenticity minimum performance requirements test with wired
connections
ETSI
20
ETSI
TS 103 246-5 V0.0.5 (2015-01)
21
TS 103 246-5 V0.0.5 (2015-01)
Annex D Recommended Test Case Applicability
The applicability of each individual test versus the implementation profiles reported in the Annex A is identified in the
tables reported in this section. Each table corresponds to a specific performance feature. This is just a recommendation
based on the purpose for which the test case was written.
The columns in the following tables (from Table 12.1 to Table 12.8) have the following meaning:
Clause
The clause column indicates the clause number in Section 4 of this document, that contains the test body.
Title
The title column describes the name of the test and contains the clause title as defined in Section 4 of this document,
that contains the test body.
Applicability
TBC
Comments
This column contains additional comments to the test and conditions if applicable.
ETSI
22
TS 103 246-5 V0.0.5 (2015-01)
Table 12.1: Applicability of tests and additional information for testing horizontal position accuracy
Clause
Title
Applicability
Comments
Table 12.2: Applicability of tests and additional information for testing vertical position accuracy
Clause
Title
Applicability
Comments
Table 12.3: Applicability of tests and additional information for testing GNSS time accuracy
Clause
Title
Applicability
ETSI
Comments
23
TS 103 246-5 V0.0.5 (2015-01)
Table 12.4: Applicability of tests and additional information for testing TTFF
Clause
Title
Applicability
Comments
Table 12.5: Applicability of tests and additional information for testing position authenticity
Clause
Title
Applicability
Comments
9.2.2.1
“Clear scenario”, Moving location target
IP1, IP5, IP6, IP7
TBC
9.2.2.2
“Interference Spoofing Scenario M-1”
IP1, IP5, IP6, IP7
TBC
Error! Reference source not
found.
“Interference Spoofing Scenario M-2”
IP1, IP5, IP6, IP7
TBC
Error! Reference source not
found.
“Interference Spoofing Scenario M-3”
IP1, IP5, IP6, IP7
TBC
9.2.2.3
“Clear scenario”, Static location target
IP1, IP2, IP3, IP4, IP5, IP6, IP7
TBC
9.2.2.4
“Interference Spoofing Scenario S-1”
IP1, IP2, IP3, IP4, IP5, IP6, IP7
TBC
Error! Reference source not
found.
“Interference Spoofing Scenario S-2”
IP1, IP2, IP3, IP4, IP5, IP6, IP7
TBC
Error! Reference source not
found.
“Interference Spoofing Scenario S-3”
IP1, IP2, IP3, IP4, IP5, IP6, IP7
TBC
ETSI
24
TS 103 246-5 V0.0.5 (2015-01)
Table 12.6: Applicability of tests and additional information for testing robustness to interference
Clause
Title
Applicability
Comments
Table 12.7: Applicability of tests and additional information for testing GNSS sensitivity
Clause
Title
Applicability
Comments
Table 12.8: Applicability of tests and additional information for testing horizontal position integrity
Clause
Title
Applicability
ETSI
Comments
25
ETSI
TS 103 246-5 V0.0.5 (2015-01)
26
TS 103 246-5 V0.0.5 (2015-01)
<Text>
History
Document history
V0.0.1
June 2014
First Draft
V0.0.2
August 2014
Update of Annex Headings and corrected scope, introduction etc.
V0.0.3
Oct 2014
Update of TOC etc. following STF meeting.
V0.0.4
Dec 2014
Update of doc number etc..
V0.0.5
Jan 2015
Inclusion of test for Position Authenticity
ETSI