Replace 'urllib2' with 'requests' Python module for all data retrieval
|Reported by:||liukis||Owned by:||liukis|
|Priority:||major||Milestone:||CSEP Version 15.1.0|
Description (last modified by liukis)
It was observed on csep-cert image that retrieval of CMT catalog sometimes results in truncated data. To avoid incomplete catalog retrieval, re-try data retrieval. Software should throw an exception if less than expected data file is retrieved.
After many attempts to address the problem using 'urllib2' module, we still see truncation error in CruiseControl? builds now and then. User groups recommend to switch to 'requests' Python model which is "HTTP for humans". 'urllib2' is not robust and seems to be broken (the problem does not propagate itself on operational server though).
Change History (4)
comment:3 Changed 2 years ago by liukis
- Description modified (diff)
- Summary changed from Re-try catalog retrieval to avoid truncated data to Replace 'urllib2' with 'requests' Python module for all data retrieval