close Warning: Can't synchronize with repository "(default)" (/work/source/svn/csep does not appear to be a Subversion repository.). Look in the Trac log for more information.

Opened 6 years ago

Closed 6 years ago

#258 closed defect (fixed)

Add support for two types of PearsonResiduals evaluation test output - "P.residual" or "raw.residual"

Reported by: liukis Owned by: liukis
Priority: major Milestone: CSEP Version 11.7.0
Component: DataTypes Version: 11.1.0
Keywords: Cc:

Description (last modified by liukis)

PearsonResiduals diagnostics test failed processing of RELM-mainshock-aftershock group for 2011-05-02 on csep-cert server:

> inputCatalog="/home/csep/operations/SCEC-natural-laboratory/RELM-mainshock-aftershock-models/catalogs/2011-05-02/2006-01-01catalog.nodecl.dat"
> inputForecast="/home/csep/operations/SCEC-natural-laboratory/RELM-mainshock-aftershock-models/shen_et_al.geodetic.aftershock-fromXML.dat"
> forecastPeriodProportion=1.06630136986
> magnitudeRange=c(4.95, 10)
> resultFile="/home/csep/operations/SCEC-natural-laboratory/RELM-mainshock-aftershock-models/results/2011-05-02/dTest_RP-Test_shen_et_al.geodetic.aftershock-fromXML_result.dat"
> source("/usr/usc/cruise/projects/CSEP/checkout/src/DiagnosticsTests/pearson_residuals.R")

Since Python 2.7 is using column names to access loaded from ASCII file data, it reported that 'P.residual' entry is not found. Output file contained 'raw.residual' as last column instead. According to Robert "It looks like 205 bins have forecasts of 0, but have masking set to 1, so because of this the "Pearson residual" is undefined for this forecast, and instead the "raw residual" is calculated"

Need to add support for both types of last column name in output, and reflect the name in proting of test results.

Change History (4)

comment:1 Changed 6 years ago by liukis

  • Description modified (diff)

comment:2 Changed 6 years ago by liukis

  • Description modified (diff)

comment:3 Changed 6 years ago by liukis

  • Owner set to liukis
  • Status changed from new to accepted

comment:4 Changed 6 years ago by liukis

  • Resolution set to fixed
  • Status changed from accepted to closed
Note: See TracTickets for help on using tickets.