Python Package

post_gce_qc contains second level quality checks and other quality assurance methods for precipitation data collected at H.J. Andrews Experimental Forest. First level QAQC is performed by the Matlab GCE toolbox, generating provisional data multiple times a week. This package takes post-GCE data and does additional periodic processing to assign a final flag value and event code.

Some of the key checks performed by this package include:

• Rain calculated during gauge drains

• Rain calculated during weather station reboots

• Constant repeating values

• Anomalous spikes

• Cross probe clog analysis

Modules

• data_transfer
  • AddNotesdbEvents
    • AddNotesdbEvents.get_date_end()
    • AddNotesdbEvents.get_date_start()
    • AddNotesdbEvents.set_notes()
    • AddNotesdbEvents.set_probecode()
    • AddNotesdbEvents.set_sitecode()
  • LoadProvisionalData
    • LoadProvisionalData.load_ppt_data()
    • LoadProvisionalData.pivot_on_probe()
  • ProvisionalDataFormat
    • ProvisionalDataFormat.find_probe()
  • WriteProvisionalData
    • WriteProvisionalData.create_file_header()
    • WriteProvisionalData.format_str_columns()
    • WriteProvisionalData.get_probe_height()
    • WriteProvisionalData.is_exists_file()
    • WriteProvisionalData.is_new_file()
    • WriteProvisionalData.melt_ppt_data()
    • WriteProvisionalData.set_expected_probes()
    • WriteProvisionalData.write_df_to_file()
    • WriteProvisionalData.write_file_per_WY()
• qaqc
  • ApplyFlags
    • ApplyFlags.affirm_CLOG_flagged_UC()
    • ApplyFlags.affirm_NaN_flagged_M()
    • ApplyFlags.affirm_only_one_flag()
    • ApplyFlags.affirm_zero_flagged_E()
    • ApplyFlags.apply_0_val()
    • ApplyFlags.apply_GCE_flags()
    • ApplyFlags.apply_NAN_val()
    • ApplyFlags.apply_QaRules_flags()
    • ApplyFlags.apply_final_flags()
    • ApplyFlags.apply_flags_as_str()
    • ApplyFlags.apply_manual_flags()
    • ApplyFlags.create_flag_log()
    • ApplyFlags.get_flagged_days()
    • ApplyFlags.import_provisional_data()
    • ApplyFlags.plot_flagged_day()
    • ApplyFlags.prorate_precip_during_tank_flux()
    • ApplyFlags.read_manual_flags()
    • ApplyFlags.remove_GCE_E_flags()
    • ApplyFlags.remove_GCE_F_flags()
    • ApplyFlags.rolling_accumulate_increment()
    • ApplyFlags.round_precip_to_min_increment()
  • QaRules
    • QaRules.calc_dly_precip()
    • QaRules.calc_dly_tank_change()
    • QaRules.calc_rolling_mean()
    • QaRules.calc_run_avg_rainfall()
    • QaRules.drain_recharge_flagging_wrap()
    • QaRules.find_drops()
    • QaRules.find_duplicate_precip()
    • QaRules.find_neg_delta()
    • QaRules.find_over_accum()
    • QaRules.find_tank_flux()
    • QaRules.flag_double_precip()
    • QaRules.flag_drains()
    • QaRules.flag_empty_tank()
    • QaRules.flag_over_intensity()
    • QaRules.flag_overaccum_precip()
    • QaRules.flag_precip_during_tank_flux()
    • QaRules.flag_propagate_EM_from_tank()
    • QaRules.flag_recharge()
    • QaRules.flag_repeating_val_precip()
    • QaRules.flag_tank_overflow()
    • QaRules.round_to_precision()
    • QaRules.set_drain_event()
• cross_probe_qc
  • BuildXTable
    • BuildXTable.assemble_cross_table()
    • BuildXTable.assemble_wy_acc()
    • BuildXTable.calc_wy_acc()
  • Probe2ProbeXQc
    • Probe2ProbeXQc.clog_pair_flagging_wrap()
    • Probe2ProbeXQc.flag_clog_delayed_accum()
    • Probe2ProbeXQc.flag_clog_undercatch()
    • Probe2ProbeXQc.import_QaRules_data()
    • Probe2ProbeXQc.set_clog_event()
  • XProbesQc
    • XProbesQc.calc_accum_ratio()
    • XProbesQc.calc_ratio()
    • XProbesQc.flag_x_clogs()
    • XProbesQc.get_Probe2ProbeXQc_inst()
    • XProbesQc.get_weight_x_clog()
    • XProbesQc.plot_clog_wind_thresholds()
    • XProbesQc.plot_wy_start()
    • XProbesQc.plot_x_clogs()
    • XProbesQc.set_accum_ratio()
    • XProbesQc.set_x_clogs()
• main
  • apply_all_flags()
  • load_data()
  • main()
  • qc()
  • qc_cross_probe()
  • qc_provisional()
  • write_output_data()