Skip to main content

DNV January 2023 upload

Observation​

  • The videos are in different format from the previous uploaded videos (.m4v not .mp4)
  • The quality of the videos are not as good as the previous uploaded videos.
  • The defect annotation is done using different software. The types of software vary between videos.
    • From checking a few video so far, there are two types.
  • The defect coding standard are not the current PACP coding standard
    • For example, Junction is used instead of Tab to code the connection.
    • Encrustation at Joint is used instead of Attached Deposits Encrustation (DAE)
  • The way the inspector annotated the defect is different from the previous uploaded videos.
    • The previous uploaded videos (2022 video), the perspective view of the defect is provided with the defect annotation.
    • The newly uploaded videos (older year), the pan in view of defect is provided with the defect annotation.
  • There are four main types of annotation software:
    • texts are bounded in black boxes
      • distance is followed by M.
      • distance is at top left.
      • Defect is reported using abbreviation.
    • texts are bounded in boxes
      • distance is followed by m.
      • distance is at the bottom right.
      • Defect is reported using full text with clock position and other value such diameter.
    • texts are in white font and not bounded in boxes
      • distance is followed by m.
      • distance is at bottom left.
      • defect is reported using full text.
        • some videos the defect is reported to the left of the screen. Have some spaces between the distance
        • some videos the defect is reported just on top of the distance.
    • texts are in black font and not bounded in boxes.
      • distance is at the upper left.
      • distance is followed by M.
      • defect is reported using abbreviation.

CCTV Details​

  • for 406 DNV PACP videos

    • SANMN01126_17.mp4:
      • the tap is found right at the beginning at 0.7 meter. However, it was not visible in the frame that has distance of 0.7. It was only visible when the camera was panned upward. The distance displayed on the video also increase to 1.7 m as the camera panned upward.
      • Should we create only consider only structural defect and operation and maintenance and exclude the construction features (such as TAP and ACCESS POINT)
    • SANMN00692_49.mp4:
      • MMC occurs at 16.0m not 21.5
      • D stands for Deformed group. However, the current PACP version requires description and modifier if it is flexible pipe. D should be DFE (Deformed Flexible Elliptical)

  • CCTV_details_for_image_labelling.csv and CCTV_Details_sorted_by_jobnumber_distance_code.csv have the original values of the defect code and distance provided by DNV.

  • CCTV_details_for_image_labelling_edit.csv and CCTV_Details_sorted_by_jobnumber_distance_code_edit.csv are edited by Vannary

    • For JOBNUMBER = SANMN00692_49.MPG
      • The distance column of MMC changed from 21.5 to 16.0
      • Code D is changed to DFR because the current PACP standard requires the Deformed group to have a description and modifier for the flexible deformed pipe.
    • For JOBNUMBER = SANMN02175_132.MPG
      • Code D is changed to DFR because the current PACP standard requires the Deformed group to have a description and modifier for the flexible deformed pipe.

GIS​

  • for 406 DNV PACP videos:
    • There are 380 unique pipe id.
    • 377 out 380 are matched with SanMain shape file.
    • SANMN02787A, SAN01219, and SANMN02304 are not found in the SanMain shape file
    • SAN01219_442.mp4:
      • pipe_id = use SANMN01219 to match with shape file
      • Size = 200 mm
      • MAT = PVC
      • Use = SS
      • STAW80D to STAW80E, PROSPECT RD.
    • SANMN02787A_389.mp4:
      • pipe_id = use SANMN02787 to match with shape file
      • Size = 200 mm
      • MAT = CP? (MAT = AC in shape file)
      • Use = SS
      • AIND105A to AIND106, RW S of Greenbriar way
    • SANMN02304_513.mp4:
      • pipe_id =
      • size = 150 mm
      • MAT = PVC
      • Use = SS
      • EDGB2185A to EDGB2245, EDGEMONT BLVD
      • Sanfitting shape file doe not have EDGB2185A manhole.

406 PACP videos dataset​

Histogram of 406 PACP videos dataset​

  • Top 3 labels:
    • ND (No-Defect) 89484 images
    • SRI (Surface Roughness Increased) 86641 images
    • DAE (Attached Deposits Encrustation) 11870 images

Without ND​

without ND

With ND​

with ND

406 videos vs 80 videos dataset​

80 videos406 videos
number of extracted frames~60K~300K
number of labelled images45,830211,436
number of PACP codes4570

Labels found in images from 80 videos vs 406 videos​

labels80 videos406 videos
AMH19126067
AOC141146
B1386
BSV22091
BVV86
CC161862
CL29756
CM183
CS43
D (Deformed)42
DAE54711870
DAGS79761573
DAZ110
DFE48
DSC77
DSF37
DSGV6821614
DSZ105
FC472003
FL594
FM5441
FS77
H1150
HSV835
HVV114
ID819
IDC110
IDJ57
IG16
IR892
IRJ106
IS202
ISC155
ISGT181
ISJ1394
ISSR246
ISZ29
IW6174
JOL28
JOM179388
JSL14
JSM180651
LD191155
LL43240
LR222118
LU2
MMC6672065
ND2515189484
OBB92
OBJ13317
OBN131281
OBP40
OBR12920
OBZ311
RBJ214
RFB16362
RFC107
RFJ211851
RFL1713
RMB68248
RMC48
RMJ193
SAM288
SAP9492
SAPM45
SAV816881
SCP111
SMW1
SRI184886641
SSS2987208
SZ230
TB36712256
TBA4211522
TBB149
TBC218
TBD1706
TBI522102
TF18765558
TFA341923
TFC158657
TFD351

Issues with current labeling process​

  • From SANMN00874_503 video, RMB was coded at distance 12.4m. Alt text

  • Then, the camera moved forward and found that the pipe was broken at the same location where the root infiltrated. The inspector then moved the camera back showing the frame with RMB before entering B for broken pipe. Because the camera had moved forward, the distance was displayed as 13.1 m not 12.4 m even though the defects were found in the same location. Alt text

  • In condition data table, the distances of the two defected also were entered based on screen values. Alt text

Tags:
Last updated on by Vannary