Opened 2 years ago

Closed 2 years ago

#345 closed defect (fixed)

Replace 'urllib2' with 'requests' Python module for all data retrieval

Reported by: liukis Owned by: liukis
Priority: major Milestone: CSEP Version 15.1.0
Component: Toolkit Version: 14.10.0
Keywords: Cc:

Description (last modified by liukis)

It was observed on csep-cert image that retrieval of CMT catalog sometimes results in truncated data. To avoid incomplete catalog retrieval, re-try data retrieval. Software should throw an exception if less than expected data file is retrieved.

After many attempts to address the problem using 'urllib2' module, we still see truncation error in CruiseControl? builds now and then. User groups recommend to switch to 'requests' Python model which is "HTTP for humans". 'urllib2' is not robust and seems to be broken (the problem does not propagate itself on operational server though).

Change History (4)

comment:1 Changed 2 years ago by liukis

  • Version changed from 14.4.0 to 14.10.0

comment:2 Changed 2 years ago by liukis

  • Owner set to liukis
  • Status changed from new to accepted

comment:3 Changed 2 years ago by liukis

  • Description modified (diff)
  • Summary changed from Re-try catalog retrieval to avoid truncated data to Replace 'urllib2' with 'requests' Python module for all data retrieval

comment:4 Changed 2 years ago by liukis

  • Resolution set to fixed
  • Status changed from accepted to closed
Note: See TracTickets for help on using tickets.