aboutsummaryrefslogtreecommitdiff
path: root/youtube_dl/extractor/common.py
AgeCommit message (Collapse)Author
2014-02-09[youtube] Correct invalid JSON (Fixes #2353)Philipp Hagemeister
2014-01-31Fix extraction of og content in single quotesdst
2014-01-29[bloomberg] Fix ooyala url extractionJaime Marquínez Ferrándiz
Added a helper method to InfoExtractor for searching the ‘twitter:player’ meta property. Now the OoyalaIE also recognizes the ‘ec’ parameter in the url as the embed code.
2014-01-27Throw an error if no video formats are foundPhilipp Hagemeister
2014-01-27[huffpost] Add supportPhilipp Hagemeister
2014-01-25[extractor/common] Encode the url when calculating the md5 with ↵Jaime Marquínez Ferrándiz
`—write-pages` option This doesn’t cause any problem in python 2.*, but on python 3 the `md5` function only accepts bytes.
2014-01-23[youtube] Add new formats (Fixes #2221)Philipp Hagemeister
2014-01-22Merge branch 'youtube-dash-manifest'Philipp Hagemeister
Conflicts: youtube_dl/extractor/youtube.py
2014-01-21[extractor/common] Clarify when and when not we generate the filenamePhilipp Hagemeister
2014-01-21Deal with implicitly UTF-16 decoded webpagesPhilipp Hagemeister
These webpages don't specify an encoding and rely on the BOM
2014-01-19[youtube] Download DASH manifestPhilipp Hagemeister
If given, download and parse the DASH manifest file, in order to get ultra-HQ formats. Fixes #2166
2014-01-17[extractor/common] Limit --write-pages filename to 200 charsPhilipp Hagemeister
This avoids problems with very long URLs.
2014-01-07[pornhub] Use centralized sortingPhilipp Hagemeister
2014-01-07[khanacademy] Add support (Fixes #2066)Philipp Hagemeister
2014-01-06[orf] Use new extraction method (Fixes #2057)Philipp Hagemeister
2014-01-03[jpopsuki] SimplifyPhilipp Hagemeister
2014-01-01[wistia] Prefer original video format above all othersPhilipp Hagemeister
We could also set up a formula which would weigh filesize/bitrate and vcodec/acodec (say, 1GB h264 < 3 GB MPEG2 < 2 GB h264), but that would get really messy real soon.
2013-12-26Document that format_id field should be presentPhilipp Hagemeister
2013-12-25[yahoo] Use centralized sorting, and add tbr fieldPhilipp Hagemeister
2013-12-24[zdf] Use centralized sortingPhilipp Hagemeister
2013-12-24[spiegel] Use centralized sortingPhilipp Hagemeister
2013-12-24Add temporary _sort_formats helper functionPhilipp Hagemeister
2013-12-24Add a resolution field and improve general --list-formats outputPhilipp Hagemeister
2013-12-23[myvideo] Use RTMP instead of RTMPT (Fixes #2032)Philipp Hagemeister
2013-12-23[bliptv] Remove support for direct downloadsPhilipp Hagemeister
This is now handled by the generic IE
2013-12-20[aparat] Add support (Fixes #2012)Philipp Hagemeister
2013-12-19[generic] Detect ooyala videos (fixes #2013)Jaime Marquínez Ferrándiz
2013-12-17[youtube] Do not warn for videos with allow_rating=0Philipp Hagemeister
This fixes #1982 Test video: http://www.youtube.com/watch?v=gi2uH3YxohU
2013-12-16_search_regex's "isatty" call fails with Py2exe'sItay Brandes
_search_regex calls the sys.stderr.isatty() function for unix systems. Py2exe uses a custom Stderr() stream which doesn't have an `isatty()` function, leading to it's crash. Fixes easily with checking that it's a unix system first.
2013-12-16Reorder info_dict documentationPhilipp Hagemeister
2013-12-16Document duration fieldPhilipp Hagemeister
2013-12-10[mtv] Fixup incorrectly encoded XML documentsPhilipp Hagemeister
2013-12-09Add fatal=False parameter to _download_* functions.Philipp Hagemeister
This allows us to simplify the calls in the youtube extractor even further.
2013-12-05[9gag] Like/dislike count (#1895)Philipp Hagemeister
2013-12-02[smotri] SimplifyPhilipp Hagemeister
2013-11-28[zdf] Use _download_xmlPhilipp Hagemeister
2013-11-25Merge branch 'opener-to-ydl'Philipp Hagemeister
2013-11-25Remove quality_name field and improve zdf extractorPhilipp Hagemeister
2013-11-25[zdf/common] Use API in ZDF extractor.Philipp Hagemeister
This also comes with a lot of extra format fields Fixes #1518
2013-11-24Merge branch 'master' into opener-to-ydlPhilipp Hagemeister
2013-11-24[collegehumor] Encode the xml before calling ↵Jaime Marquínez Ferrándiz
xml.etree.ElementTree.fromstring (fixes #1822) Uses a new helper method in InfoExtractor: _download_xml
2013-11-22Match --download-archive during playlist processing (Fixes #1745)Philipp Hagemeister
2013-11-22Move the opener to the YoutubeDL object.Philipp Hagemeister
This is the first step towards being able to just import youtube_dl and start using it. Apart from removing global state, this would fix problems like #1805.
2013-11-20Add support for tou.tv (Fixes #1792)Philipp Hagemeister
2013-11-16Add automatic generation of format note based on bitrate and codecsPhilipp Hagemeister
2013-11-15Don't accept '>' inside the content attribute in OpenGraph regexesJaime Marquínez Ferrándiz
2013-11-15Improve the OpenGraph regexJaime Marquínez Ferrándiz
* Do not accept '>' between the property and content attributes. * Recognize the properties if the content attribute is before the property attribute using two regexes (fixes the extraction of the description for SlideshareIE).
2013-11-12[common] Simplify og_search_propertyPhilipp Hagemeister
2013-11-05Fix AssertionError when og property not foundMarcin Cieślak
On tvp.pl some webpages contain OpenGraph metadata and some don't. If og property is not found, _og_search_description fails with WARNING: unable to extract OpenGraph description; please report this issue on http://yt-dl.org/bug Traceback (most recent call last): File "/usr/home/saper/bin/youtube-dl", line 18, in <module> youtube_dl.main() File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 766, in main _real_main(argv) File "/usr/home/saper/sw/youtube-dl/youtube_dl/__init__.py", line 719, in _real_main retcode = ydl.download(all_urls) File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 715, in download videos = self.extract_info(url) File "/usr/home/saper/sw/youtube-dl/youtube_dl/YoutubeDL.py", line 348, in extract_info ie_result = ie.extract(url) File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 125, in extract return self._real_extract(url) File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/tvp.py", line 56, in _real_extract info['description'] = self._og_search_description(webpage) File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 331, in _og_search_description return self._og_search_property('description', html, fatal=False, **kargs) File "/usr/home/saper/sw/youtube-dl/youtube_dl/extractor/common.py", line 325, in _og_search_property return unescapeHTML(escaped) File "/usr/home/saper/sw/youtube-dl/youtube_dl/utils.py", line 494, in unescapeHTML assert type(s) == type(u'') AssertionError The patch allows me to use: try: info['description'] = self._og_search_description(webpage) info['thumbnail'] = self._og_search_thumbnail(webpage) except RegexNotFoundError: pass
2013-11-03Add the 'webpage_url' field to info_dictJaime Marquínez Ferrándiz
The url for the video page, it must allow to reproduce the result. It's automatically set by YoutubeDL if it's missing.
generated by cgit v1.2.3 (git 2.26.2) at 2024-11-09 17:29:11 +0000