aboutsummaryrefslogtreecommitdiff
path: root/youtube_dl/utils.py
AgeCommit message (Collapse)Author
2015-12-28[utils] Remove Content-encoding from headers after decompressionYen Chi Hsuan
With cn_verification_proxy, our http_response() is called twice, one from PerRequestProxyHandler.proxy_open() and another from normal YoutubeDL.urlopen(). As a result, for proxies honoring Accept-Encoding, the following bug occurs: $ youtube-dl -vs --cn-verification-proxy https://secure.uku.im:993 "test:letv" [debug] System config: [] [debug] User config: [] [debug] Command-line args: ['-vs', '--cn-verification-proxy', 'https://secure.uku.im:993', 'test:letv'] [debug] Encodings: locale UTF-8, fs utf-8, out UTF-8, pref UTF-8 [debug] youtube-dl version 2015.12.23 [debug] Git HEAD: 97f18fa [debug] Python version 3.5.1 - Linux-4.3.3-1-ARCH-x86_64-with-arch-Arch-Linux [debug] exe versions: ffmpeg 2.8.4, ffprobe 2.8.4, rtmpdump 2.4 [debug] Proxy map: {} [TestURL] Test URL: http://www.letv.com/ptv/vplay/22005890.html [Letv] 22005890: Downloading webpage [Letv] 22005890: Downloading playJson data ERROR: Unable to download JSON metadata: Not a gzipped file (b'{"') (caused by OSError('Not a gzipped file (b\'{"\')',)); please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on how to update. Be sure to call youtube-dl with the --verbose flag and include its complete output. File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/extractor/common.py", line 330, in _request_webpage return self._downloader.urlopen(url_or_request) File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/YoutubeDL.py", line 1886, in urlopen return self._opener.open(req, timeout=self._socket_timeout) File "/usr/lib/python3.5/urllib/request.py", line 471, in open response = meth(req, response) File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 773, in http_response raise original_ioerror File "/home/yen/Executables/Multimedia/youtube-dl/youtube_dl/utils.py", line 761, in http_response uncompressed = io.BytesIO(gz.read()) File "/usr/lib/python3.5/gzip.py", line 274, in read return self._buffer.read(size) File "/usr/lib/python3.5/gzip.py", line 461, in read if not self._read_gzip_header(): File "/usr/lib/python3.5/gzip.py", line 409, in _read_gzip_header raise OSError('Not a gzipped file (%r)' % magic)
2015-12-20Rename error_to_str to error_to_compat_strSergey M․
2015-12-20[utils] Add encode_compat_strSergey M․
2015-12-20[utils] Add error_to_strSergey M․
2015-12-19[utils] Support alternative timestamp format in TTMLYen Chi Hsuan
Fixes #7608
2015-12-19[utils] Fix TTML conversionYen Chi Hsuan
Tolerate invalid timestamps (closes #7909)
2015-12-14[utils] Add remove_quotesSergey M․
2015-11-29[utils] Refactor handle_youtubedl_headers for future extensionYen Chi Hsuan
2015-11-29[utils] Correct docstring of YoutubeDLHandlerYen Chi Hsuan
2015-11-29[utils] Separate codes for handling Youtubedl-* headersYen Chi Hsuan
2015-11-23Rename compat_urllib_request_Request to sanitized_Request and move to utilsSergey M․
2015-11-22[utils] Check ext with trailing slash against the list of known extensionsSergey M․
2015-11-22[utils] Improve determine_ext (Closes #7593)Sergey M․
2015-11-21[utils] Improve encode_dictSergey M․
2015-11-16[utils] StyleSergey M․
2015-11-16[utils] Skip invalid/non HTML entities (Closes #7518)Sergey M․
2015-11-02[utils] unified_strdate: Return None if the date format can't be recognized ↵Jaime Marquínez Ferrándiz
(fixes #7340) This issue was introduced with ae12bc3ebb4cb377c2b4337ec255e652b36f5143, it returned 'None'.
2015-11-02[utils:sanitize_path] Disallow trailing whitespace in path segment (Closes ↵Sergey M․
#7332)
2015-10-31Merge pull request #7296 from jaimeMF/xml_attrib_unicodeSergey M
Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (…
2015-10-31[utils] Make unified_strdate always return unicode stringSergey M․
2015-10-31[utils] Support list of xpath in xpath_elementSergey M․
2015-10-28[utils] Improve parse_iso8601Sergey M․
2015-10-26[compat] compat_etree_fromstring: also decode the text attributeJaime Marquínez Ferrándiz
Deletes parse_xml from utils, because it also does it.
2015-10-25Use a wrapper around xml.etree.ElementTree.fromstring in python 2.x (#7178)Jaime Marquínez Ferrándiz
Attributes aren't unicode objects, so they couldn't be directly used in info_dict fields (for example '--write-description' doesn't work with bytes).
2015-10-20[utils:js_to_json] Fix bad escape in double quoted stringsSergey M․
2015-10-18[letv] Fix extractionYen Chi Hsuan
Using data URIs for passing the decrypted M3U8 manifest, which is supported by ffmpeg only.
2015-10-14[utils] Return default on fail in int_or_noneSergey M․
2015-10-14[utils] Do not fail in float_or_none on non-numeric dataSergey M․
2015-10-14[utils] Do not fail in int_or_none on non-numeric data (Closes #7175)Sergey M․
2015-09-20[utils] Fix kwargs on old python 2 (Closes #6905)Sergey M․
2015-09-06[utils] Comment cookie processing until result from travis and some more testingSergey M․
2015-09-06[utils] Simplify cookie processorSergey M․
2015-09-06[utils] Add encode_dictSergey M․
2015-09-06[utils] Add issue URL in comment for #6457Sergey M․
2015-09-06[utils] Add cookie processor for cookie correction (Closes #6769)Sergey M․
2015-09-05[utils] Generalize cli option convertersSergey M․
2015-09-05[utils] Improve xpath_textSergey M․
2015-09-04[utils] Relax attribute key assertSergey M․
2015-09-04[utils] Add xpath_element and xpath_attrSergey M․
2015-09-02[utils] Strict HTTP responses (Closes #6727)Sergey M․
2015-08-07[utils] Percent-encode redirect URL of Location header (Closes #6457)Sergey M․
2015-08-06[YoutubeDL:utils] Move percent encode non-ASCII URLs workaround to ↵Sergey M․
http_request and simplify (Closes #6457)
2015-08-01[utils] Make value optional for find_xpath_attrSergey M․
This allows selecting particular attributes by name but without specifying the value and similar to xpath syntax `[@attrib]`
2015-07-26Remove redundant (and wrong) class parametersRaphael Michel
2015-07-22[utils] Improve parse_durationYen Chi Hsuan
Now dots are parsed. For example '87 Min.'
2015-06-28[utils] Add default value for xpath_textSergey M․
2015-06-27[utils] Add ISO3166UtilsYen Chi Hsuan
2015-06-21[utils] Support ttaf1 namespace in TTMLYen Chi Hsuan
It's found in bbc.co.uk. See #6038
2015-06-21[utils/ffmpeg] Move ISO 639 related codes to utilsYen Chi Hsuan
2015-05-19[yahoo] Add support for closed captions (closes #5714)Yen Chi Hsuan