DECART Quality Measurement Tools DECART Quality

DECART Quality Measurement Tools DECART Quality

ICIST
DECART
DECART
Quality
Quality Measurement
Measurement Tools
Tools
João
JoãoMatos,
Matos,Alexandre
AlexandreGonçalves,
Gonçalves,
Ricardo
RicardoSousa,
Sousa,Jaime
JaimeMartins
Martins
Instituto
InstitutoSuperior
SuperiorTécnico
Técnico
ICIST
MOTIVATION
MOTIVATION
0
ICIST
TO
TOILLUSTRATE
ILLUSTRATETHE
THEAPPLICABILITY
APPLICABILITYOF
OFTHE
THE
CONCEPTS
CONCEPTSIN:
IN:
19113
19113–– Quality
QualityPrinciples;
Principles;
19114
19114–– Quality
QualityEvaluation
EvaluationProcedures.
Procedures.
TO
TOPRESENT
PRESENTAN
ANEXPLORATORY
EXPLORATORYSTUDY
STUDYON
ON
THE
THESTRUCTURE
STRUCTUREOF
OFA
AGENERIC
GENERICQUALITY
QUALITY
EVALUATION
EVALUATIONSOFTWARE
SOFTWARE..
ICIST
OBJECTIVES
OBJECTIVESFOR
FORA
AGENERIC
GENERICQUALITY
QUALITY
EVALUATION
EVALUATIONSOFTWARE
SOFTWARE
EXEMPLIFICATION
EXEMPLIFICATIONFOR
FORREAL
REALCASES
CASES
PROTOTYPE
PROTOTYPEOF
OF“DECART”
“DECART”IN
INA
ACAD
CAD
ENVIRONMENT
ENVIRONMENT
PROTOTYPE
PROTOTYPEOF
OF“DECART”
“DECART”IN
INA
AGIS
GIS
ENVIRONMENT
ENVIRONMENT
OBJECTIVES
OBJECTIVES FOR
FOR A
A
GENERIC
GENERIC QUALITY
QUALITY
EVALUATION
EVALUATION
SOFTWARE
SOFTWARE
1
ICIST
CONFORMANCE
CONFORMANCETO
TO19113,19114
19113,19114
USE
USEOF
OFTHE
THEQUALITY
QUALITYELEMENTS
ELEMENTSAND
AND
SUBQUALITY
SUBQUALITYELEMENTS
ELEMENTS
COMPLETENESS
COMPLETENESS
CONSISTENCY
CONSISTENCY
POSITIONAL
POSITIONALACCURACY
ACCURACY
TEMPORAL
TEMPORALACCURACY
ACCURACY
THEMATIC
THEMATICACCURACY
ACCURACY
ICIST
CONFORMANCE
CONFORMANCETO
TO19113,19114
19113,19114
USE
USEOF
OFTHE
THECONCEPTS
CONCEPTS
QUALITY
QUALITYEVALUATION
EVALUATIONMETHOD
METHOD
DIRECT
DIRECTEVALUATION
EVALUATION
--EXTERNAL
EXTERNALEVALUATION
EVALUATION
--INTERNAL
INTERNALEVALUATION
EVALUATION
REPORTING
REPORTINGAS
ASMETADATA
METADATAOR
ORQ.E.
Q.E.REPORT
REPORT
ICIST
OPERATIONAL
OPERATIONALISSUES
ISSUES
SIMPLE
(NOTDEPENDENT
DEPENDENTOF
OFEXPENSIVE,
EXPENSIVE,
SIMPLEMEASUREMENTS
MEASUREMENTS (NOT
UNAVAILABLE
UNAVAILABLEOR
ORCOMPLEX
COMPLEXREFERENCE
REFERENCEMEASUREMENTS)
MEASUREMENTS)
AUTOMATION
AUTOMATION
EASYNESS
EASYNESSOF
OFREPORTING
REPORTING
INTEGRATION
INTEGRATIONON
ONTHE
THEPRODUCT
PRODUCTLIFECYCLE
LIFECYCLE
ICIST
OPERATIONAL
OPERATIONALCONSTRAINTS
CONSTRAINTS
DEPENDENCY
DEPENDENCYON
ONAN
ANUNDERLYING
UNDERLYING
SOFTWARE
SOFTWARE
DEPENDENCY
DEPENDENCYON
ONMETADATA
METADATAAPPLICATION
APPLICATION
ICIST
OPERATIONAL
OPERATIONALCONSTRAINTS
CONSTRAINTS
MANY
MANYRESULTS
RESULTSARE
ARELIKELY
LIKELYTO
TONEVER
NEVERBE
BE
REPORTED
e.g.SOME
SOMETOPOLOGICAL
TOPOLOGICALCONSISTENCY
CONSISTENCY
REPORTED ((e.g.
RESULTS,
RESULTS,FORMAT
FORMATCONSISTENCY
CONSISTENCY).
).
QEP
QEPCAN
CANLEAD
LEADTO
TOA
AREPORT
REPORTOR
ORTO
TOTHE
THE
EXECUTION
EXECUTION OF
OF THE
THE PROCEDURES
PROCEDURES LEADING
LEADING
TO
TOTHE
THECONFORMANCE
CONFORMANCE
ICIST
INTERNAL
INTERNAL
EVALUATION
EVALUATION
2
ICIST
SPECIFICATIONS
SPECIFICATIONS
LINES
LINESIN
INLAYER
LAYER“abc”
“abc”SHOULD
SHOULDFORM
FORMCLOSED
CLOSEDPOLYGONS
POLYGONS
LINES
LINESIN
INLAYER
LAYER“def”
“def” SHOULD
SHOULDFORM
FORMAACONNECTED
CONNECTEDGRAPH
GRAPH
LINES
LINESIN
INLAYER
LAYER“ghi”
“ghi” ARE
ARERED
REDAND
ANDWITH
WITHLINETYPE
LINETYPECONTINUOUS
CONTINUOUS
ALL
ALLPOLYGONS
POLYGONSOF
OFTHE
THETHEME
THEMEHOUSES
HOUSESSHOULD
SHOULDHAVE
HAVEAASPOT
SPOT
HEIGHT
HEIGHTINSIDE
INSIDE
RAILWAYS
RAILWAYSDO
DONOT
NOTINTERSECT
INTERSECTHOUSES
HOUSES
ELEVATIONS
ELEVATIONSARE
AREALLWAYS
ALLWAYSHIGHER
HIGHERTHAN
THAN00AND
ANDLOWER
LOWERTHAN
THAN
2000M
2000M
CONTOURS
CONTOURSARE
AREHORIZONTAL
HORIZONTALLINES
LINES
......
ICIST
ICIST
ICIST
EXTERNAL
EXTERNAL
EVALUATION
EVALUATION
3
ICIST
De validação da carta 1/1000 de Lisboa.
Completeness Coefficient
Qr
*100
C=
Qo + Qr
ICIST
Q r - r e p r e s e n t e d quantity
Qo - ommited quantity
De Estudo para Validação da Carta 1/1000 de Lisboa (PROET).
COUNT
ICIST
Result of counting the number of objects or components
Zona
Método
Comprimento
nº de Pontos
(m)
A
Área
Nº Polígonos
Nº de linhas
(ha)
I
121241
5689
6768
33
82
II
118836
2139
6749
31
70
III
121686
2843
6777
36
134
ICIST
ZONA
O M ITID O
nºentidades
área omitida
R EPRESENTADO
perímetro
nº entidades
área total
perímetro total
I
16
961
491
2352
119213
53960
II
13
4226
983
2399
162675
71902
III
5
113
94
2522
282084
90018
IV
4
64
59
4034
203210
96345
V
4
771
253
1341
153376
58991
Q u a d r o 1 - O m i s s õ e s e m e n t i d a d e s d o t i p o p o l í g o n o ( á r e a e m m 2 e perím e t r o e m m ) .
ICIST
ZONA
O M ITID O
nºentidades
REPRESENTADO
comprimento
nº entidades
comprimento
I
8
115
1781
15185
II
8
83
887
86805
III
2
25
807
27773
IV
0
0
957
25866
V
5
244
1341
33839
ICIST
ZONA
C
nº
área
perímetro
I
99,3
99,20
99,10
II
99,5
97,47
98,65
III
99,8
99,96
99,90
IV
99,9
99,97
99,94
V
99,7
99,5
99,57
ICIST
BUFFERS
ICIST
Measurement of length inside the
buffer
M étodo
10m
20m
50m
II-I
51%
84%
99%
II-III
63%
92%
99%
III-I
43%
77%
100%
A
A
ICIST
^~B
~A
^
B
B
B: A
^
B
A: A
^
B
ICIST
POSITIONAL ACCURACY X OMISSION
ICIST
1
2
OBJECT X GRAPHICAL ELEMENT
1
2
ICIST
ICIST
1
2
PHOTOGRAMMETRIC SURVEY
GROUND SURVEY
ICIST
De estudo para validação da carta 1/1000 de
Lisboa (PROET/LTE).
DIFFERENCE VECTORS
( MAGNIFIED)
DISTANCE BETWEEN LINES
ICIST
MEAN OF THE DISTANCES IN VERTICES
HAUSDORFF DISTANCE
(
(
= (sup (inf
))
d ( x , y ) ))
D A → B = sup x∈A inf y∈B d ( x , y )
D A →B
y ∈B
x∈ A
DH = Max = (D A → B , D B → A )
INNER AREA DISTANCE
ICIST
ICIST
Different importance between
systematic and random errors .
100m
De estudo para a digitalização da REN (ICN).
TRANSFORMATION GAIN
Diferença (Teste-Objecto)
ICIST
26
24
22
20
18
16
14
12
10
8
6
4
2
0
∑(
n
G=
1
n
p ' i − p i − p 'i − p " i
i =1
5
10
15
20
25
30
35
40
45
50
55
60
65
70
)
>70
Diferença (m)
Transformação de 3º Grau
Transformação de 1º Grau
26
24
22
20
18
16
14
12
10
8
6
4
2
0
26
24
22
20
18
16
14
12
10
8
6
4
2
0
5
10
15
20
25
30
35
>35
5
10
15
Diferença (m)
20
25
30
35
Diferença (m)
x
σx
y
σy
d
σd
Objecto -Teste
9.6
12.1
15.0
19.6
24.1
16.1
Objecto-P 1 (Teste)
0.0
8.8
0.0
11.9
11.9
8.5
Objecto-P 3 (Teste)
0.0
7.9
0.0
10.7
11.0
7.4
More
ABSOLUT ERROR DIAGRAM
RELATIVE ERROR DIAGRAM
ICIST
ICIST
Mangualde
Abs-ori
0 - 10
10 - 20
20 - 50
50 - 100
100 - 210
Mangualde
Abs-Rel-Ori
-150 - -50
-50 - -25
-25 - 0
0 - 25
25 - 50
50 - 150
ICIST
Mangualde
Abs-Grau3
0 - 10
10 - 20
20 - 50
50 - 100
100 - 220
Mangualde
Abs-Rel-Grau3
-150 - -50
-50 - -25
-25 - 0
0 - 25
25 - 50
50 - 150
ICIST
THE
THE SOFTWARE
SOFTWARE
4
ICIST
INTERNAL
INTERNALEVALUATION
EVALUATION
BASED
BASEDON
ONSPECIFICATIONS
SPECIFICATIONS
AUTOMATED
AUTOMATED
100%
100%INSPECTION
INSPECTION
PASS/FAIL
PASS/FAIL
ICIST
EXTERNAL
EXTERNALEVALUATION
EVALUATION
REFERENCE
REFERENCEDATA
DATAIS
ISREQUIRED
REQUIRED
NOT
NOTENTIRELY
ENTIRELYAUTOMATED
AUTOMATED
INSPECTION
INSPECTIONBY
BYSAMPLING
SAMPLING
ICIST
RESULTS:
RESULTS:CORRECTION/REPORTING
CORRECTION/REPORTING
CORRECTION
CORRECTIONTOOLS
TOOLSAVAILABLE
AVAILABLE
REPORTING
REPORTINGTOOLS
TOOLS