Skip to main content

To-Do List

Tasks​

  1. Look into VTK book
    • Look into VTK (Visualization Toolkit) Book.
    • Document findings and potential solutions.
  1. Send a Message for Presets to Rijul
    • Draft a message to Rijul regarding the presets.
  1. Scooping Tool GitHub Issues
    • add GitHub issues for the scooping tool.

Additional Notes​

  1. Concept: Automatic Segmentation with Certain Presets
    • Develop a concept for automatic segmentation using specific presets.
    • Move the cropping tool to capture images.
    • Run the segmentation process on the captured images.
    • Implement functionality to move along the axis during segmentation.

7/15/2024 :

task

  • change the behaviour of the existing cropping widget

Locate and Modify the Shader:

  • Locate the VolumeMapper shader in the vtk.js source code.

  • Modify the fragment shader to handle inverse cropping.

  • Integrate the Shader Changes:

  • Ensure the modified shader is used in your vtk.js example.

  • Pass the cropping planes to the shader.

  • post the question in forum

  • vtk macro? explore track my progress

7/16/2024 :

01_GIS+Prediction_DNV_mapping_defects_version_2.ipynb

SHAPE_FILE_DIR

sanmain = '/home/gqc/git/gqc/gqc-utility-notebooks/data/shapefiles/SanMain_shp/SanMain.shp'
sanfitting = '/home/gqc/git/gqc/gqc-utility-notebooks/data/shapefiles/SanFitting_shp/SanFitting.shp'
sanmainhist = '/home/gqc/git/gqc/gqc-utility-notebooks/data/shapefiles/SanHistMain_shp/SanHistMain.shp'

PACP & WRC

PACP_videos = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/list_730_PACP_videos_in_CCTV_Details.csv'
all_conditions_wrc_1066 = '/media/gqc/T7/cctv/dnv/data/wrc_1066/temp/all_conditions.csv'

CONDITION_DATA csv

cctv_header = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/CCTV_Headers.csv'
cctv_detail = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/dnv_B_C_condition_data_with_remarks_col.csv'
cctv_detail_full = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/CCTV_Details_sorted_by_jobnumber_distance_code_edit.csv'
cctv_header_81 = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/combined_pipe_properties_84videos.csv'
cctv_detail_81 = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/dnv_pacp_A_81_condition_data.csv'

list of videos

list_81_videos = pd.read_csv('DNV_PACP_81videos_edit.csv')
list_videos = pd.read_csv('DNV_PACP_711_out_5238videos.csv')

OUTPUT_SHAPE_FILE_DIR

DNV_81_code_points = '/home/gqc/git/gqc/gqc-utility-notebooks/data/output_shape_files/defect_location_version_2/DNV_81_pacp_code_points.shp'
DNV_B_C_code_points = '/home/gqc/git/gqc/gqc-utility-notebooks/data/output_shape_files/defect_location_version_2/DNV_B_C_pacp_wrc_code_points.shp'

inspection info csv

inspection_info_DNV_A_ '/home/gqc/git/gqc/gqc-utility-notebooks/data/feature_engineering_data/inspection_info_DNV_A_version_2.csv'
inspection_info_DNV_B_C_version_2  '/home/gqc/git/gqc/gqc-utility-notebooks/data/feature_engineering_data/inspection_info_DNV_B_C_version_2.csv
condition_data_DNV_B_C_version_2   '/home/gqc/git/gqc/gqc-utility-notebooks/data/feature_engineering_data/condition_data_DNV_B_C_version_2.csv'

assign_pacp_group_labels(code):

  • Assigns PACP group labels to defect codes.

assign_wrc_group_labels(code):

  • Assigns WRc group labels to defect codes.

assign_stmh_fnmh_from_upmh_dnmh(header_df, upstream_col, downstream_col, direction_col):

  • Determines start and finish manholes based on inspection direction.

assign_upmh_dnmh_from_stmh_fnmh(header_df, startmh_col, finishmh_col, direction_col):

  • Determines upstream and downstream manholes based on start and finish manholes.

assign_upmh_dnmh_from_stmh_fnmh_with_nan_direction(header_df, manhole_shapefile, startmh_col, finishmh_col, direction_col, manhole_col):

  • Assigns upstream and downstream manholes when direction is missing, using manhole invert elevations.

rename_columns(header_df, list_column_name, list_new_column_name):

  • Renames columns in the DataFrame.

get_upstream_and_downstream_pipes_via_mh(header_df, manhole_shapefile, sanitary_shapefile, manhole_col, sanitary_col, pipe_id_col, upstream_col, downstream_col):

  • Determines upstream and downstream pipes using manhole positions.

get_upstream_and_downstream_pipes_via_video_name(header_df, sub_header_df, sanitary_shapefile, sanitary_col, pipe_id_col, direction_col, addition_shape):

  • Determines upstream and downstream pipes using video names.

assign_case_for_defect_dist(direction, upstream_pipe, downstream_pipe, startmh, finishmh, sanmain, sanmain_col):

  • Determines the case for defect distance calculation based on inspection direction and pipe positions.

list_pipe_segments_corresponding_to_condition_data(report_name, end_survey_dist, CASE, start_pipe, start_manhole, sanmain, sanfitting, sanmain_col, sanfitting_col, multi_pipes, debug):

  • Lists pipe segments corresponding to condition data for defect mapping.

dist_from_current_pipe_first_point(CASE, defect_dist_from_first_manhole, pipes_length):

  • Calculates the distance from the current pipe's first point to the defect.

pipe_segment_material_dist(mmc, end_survey_dist, distance_col, prev_material_col, new_material_col):

  • Determines pipe segment material distribution along the surveyed distance.

create_defect_point(header_df, subheader, detail_df, sanmain, reference_id_col_header, reference_id_col_detail, direction_col_header, code_col_detail, distance_col_detail, sanmain_col, multi_pipes):

  • Creates defect points based on the header and detail data.

02_GIS+Prediction_prepare_data_for_defect_prediction_version_2.ipynb

Mainline

mainline = '/home/gqc/git/gqc/gqc-utility-notebooks/data/shapefiles/SanMain_shp/SanMain.shp'
mainlinehist = '/home/gqc/git/gqc/gqc-utility-notebooks/data/shapefiles/SanHistMain_shp/SanHistMain.shp'

DATA A

defect = '/home/gqc/git/gqc/gqc-utility-notebooks/data/output_shape_files/defect_location_version_2/DNV_81_pacp_defect_points.shp'

all_codes_save = '/home/gqc/git/gqc/gqc-utility-notebooks/data/output_shape_files/defect_location_version_2/DNV_81_pacp_code_points_material_edit.shp'

DATA B

cctv_detail = '/home/gqc/git/gqc/gqc-utility-notebooks/data/condition_data/dnv_pacp_A_81_condition_data.csv'

cctv_detail_B = '/home/gqc/git/gqc/gqc-utility-notebooks/data/feature_engineering_data/condition_data_DNV_B_C_version_2.csv'

defect_B = '/home/gqc/git/gqc/gqc-utility-notebooks/data/output_shape_files/defect_location_version_2/

DNV_B_C_pacp_wrc_defect_points_material_edit.shp'

header_B = '/home/gqc/git/gqc/gqc-utility-notebooks/data/feature_engineering_data/inspection_info_DNV_B_C_version_2.csv'

03_GIS+Prediction_lightGBM.ipynb

Feature engineer data CSV

Last updated on by Viraj