DETAILED INVESTIGATIONS OF THE STATISTICAL TEST RESULTS AND CORRELATION TO PARAMETERS

1
DETAILED INVESTIGATIONS OF THE STATISTICAL TEST
RESULTS AND CORRELATION TO PARAMETERS

• Mate Gaal BAM Berlin, Germany
• Christina Mueller BAM Berlin, Germany
• Adam Lewis JRC ISPRA, Italy
• Dieter Guelle ITEP ISPRA, Italy
• Peter-Th. Wilrich FU Berlin, Germany
• Martina Scharmach BAM Berlin, Germany
• Sylke Baer BAM Berlin, Germany
• Kurt Osterloh BAM Berlin, Germany
• Uwe Ewert BAM Berlin, Germany

2
Goals of the Trials

• to optimise the testing procedure proposed in CEN
  Workshop Agreement CWA 147472003

• to determine the contribution of conditional
  factors to detector performance
• conditional factors from the soil
  characteristics to the operators performance

3
Reliability Tests (Blind, In-Field Tests)
In-Air In-Soil Measurements
correlation

• Maximum Detection Distance

• Detection Rate DR (POD)
• False Alarm Rate FAR

• combined in ROC diagrams
• DR as a function of depth

Do we need reliability tests?
4
Soil MesurementsDetection Distance Measurements
5
Detection Capability Curves
6
Soil Measurements
7
Detection Distance Measurements

8
Maximum Detection Distance
18
16
14
12
10
PMA-S
Maximum Detection Distance (cm)
PMA-2
8
6
4
2
0
X
U
Z
Y
Detectors
9
Ground Reference Height and Magnetic Viscosity
10
Detection Reliability Tests
11
Different Detectors in Obrovac soil
(all PMA mines grouped together)
1
0,9
0,8
0,7
0,6
POD
Detection Rate
0,5
detector U
detector X
0,4
detector Y
0,3
detector Z
0,2
0,1
0
0
5
10
15
20
25
Depth (cm)
12
Detector U in Sisak Soil
1
0,8
PMA-1A
0,6
Detection Rate
PMA-2
0,4
PMA-3
0,2
0
0
5
10
15
20
25
Depth (cm)
13
Results for PMA-S (PMA-2 surrogate)
1
0,8
Soils
0,6
uncooperative
Detection Rate
neutral
0,4
neutral
0,2
0
0
5
10
15
20
Maximum Detection Distance (cm)
14
Results for PMA-2
1
0,8
0,6
Detection Rate
uncooperative
0,4
neutral
uncooperative, heterogeneous
0,2
0
0
5
10
15
Maximum Detection Distance (cm)
15
Different Detectors in Benkovac Soil
16
Detector Y in Different Soils
17
Detections in All Soils for Different Detectors
(Only PMA Mines)
18
The Influence of Soil
19
Overall Performance of Detectors
20
Oberjettenberg Overall Performance
16
10
1
0,8
0,6
November trials
Detection Rate
May trials
0,4
human factor improved
0,2
0
0
0,2
0,4
0,6
0,8
1
FAR
21
Results for Different Deminers
1
currently active as deminers
0,9
A
0,8
B
0,7
C
0,6
Detection Rate
D
0,5
E
0,4
F
0,3
G
H
0,2
0,1
0
0
0,5
1
1,5
2
FAR
22
Influence of Experience
currently active
23
Oberjettenberg Results for Different Detectors
24
Conclusions
Reliability tests lab measurements are a
powerful tool
Detectors are distinguishable
Influence of application factors like soil and
human factors can be measured
The main influence comes from

• depth of the mines

• soil type

• operators experience