aboutsummaryrefslogtreecommitdiff
path: root/yt_dlp/extractor/common.py
AgeCommit message (Collapse)Author
2021-07-20[youtube] Extract more thumbnailspukkandan
* The thumbnail URLs are hard-coded and their actual existence is tested lazily * Added option `--no-check-formats` to not test them Closes #340, Related: #402, #337, https://github.com/ytdl-org/youtube-dl/issues/29049
2021-07-16[generic] Extract previously missed subtitles (#515)Felix S
* [generic] Extract subtitles in cases missed previously * [common] Detect discarded subtitles in SMIL manifests * [generic] Extract everything in the SMIL manifest Authored by: fstirlitz
2021-07-14[extractor] Allow extracting multiple groups in `_search_regex`felix
From #497, Authored by: fstirlitz
2021-07-11[utils] Add `variadic`pukkandan
2021-07-08Improve `extractor_args` parsingpukkandan
2021-07-07[extractor] Minor improvements (See desc)pukkandan
1. Allow removal of login hint - extractors can set their own login hint as part of `msg` 2. Cleanup `_merge_subtitles` signature
2021-07-07[extractor] Prevent unnecessary download of hls manifestspukkandan
and refactor `hls_split_discontinuity` code
2021-06-25Add `--extractor-args` to pass extractor-specific argumentspukkandan
2021-06-21[websockets] Add `WebSocketFragmentFD` (#399)pukkandan
Necessary for #392 Co-authored by: nao20010128nao, pukkandan
2021-06-13[pornhub] Extract `cast`pukkandan
Closes #406, https://github.com/ytdl-org/youtube-dl/pull/27384
2021-06-13[downloader/mhtml] Add new downloader (#343)felix
This downloader is intended to be used for streams that consist of a timed sequence of stand-alone images, such as slideshows or thumbnail streams This can be used for implementing: https://github.com/ytdl-org/youtube-dl/issues/4974#issue-58006762 https://github.com/ytdl-org/youtube-dl/issues/4540#issuecomment-69574231 https://github.com/ytdl-org/youtube-dl/pull/11185#issuecomment-335554239 https://github.com/ytdl-org/youtube-dl/issues/9868 https://github.com/ytdl-org/youtube-dl/pull/14951 Authored by: fstirlitz
2021-06-13Allow `images` formatspukkandan
Necessary for #343. * They are identified by `vcodec=acodec='none'` * These formats show as the worst in `-F` * Any postprocessor that expects audio/video will be skipped * `b*` and all related selectors will skip such formats * This commit also does not add any selector for downloading such formats. They have to be explicitly requested by the `format_id`. Implementation of a selector is left for when #389 is resolved
2021-06-08Release 2021.06.082021.06.08pukkandan
2021-06-06[common] Fix FourCC fallback when parsing ISM (#372)felix
In some DASH manifests, the FourCC attribute is actually present, but empty. We thus apply the same fallback to 'AACL' that we do when the attribute is entirely absent. Authored by: fstirlitz
2021-05-30[fancode] Add extractor (#316,#354)pukkandan
Closes #269, #363 Authored by: rmsmachine
2021-05-30[extractor] Functions to parse socket.io response as jsonpukkandan
Authored by: pukkandan, llacb47
2021-05-29[extractor] Allow `note=False` when extracting manifestspukkandan
2021-05-26[extractor] Always prefer native hls downloader by defaultpukkandan
When the manifest is not downloadable by native downloader, it already is able to detect it and switch to `ffmpeg`. So there doesn't seem to be a reason anymore to use ffmpeg as the preferred downloader
2021-05-23[extractor] Skip subtitles without URI in m3u8 manifestspukkandan
Closes #339 Authored by: hheimbuerger
2021-05-20[youtube] Better message when login requiredpukkandan
2021-05-19[cleanup] linter, code formatting and readmepukkandan
2021-05-17[extractor] Add `write_debug` and `get_param`pukkandan
2021-05-15Add field `name` for subtitlespukkandan
Co-authored by: pukkandan, tpikonen Based on: #310, https://github.com/ytdl-org/youtube-dl/pull/26112
2021-05-14Standardize `write_debug`pukkandan
2021-05-11[common] bugfix for when `compat_opts` is not givenpukkandan
2021-05-11Release 2021.05.112021.05.11pukkandan
* and some documentation improvements
2021-05-11Option `--compat-options` to revert some of yt-dlp's changespukkandan
* Deprecates `--list-formats-as-table`, `--list-formats-old`
2021-05-04[utils] Add `network_exceptions`pukkandan
2021-05-02[whowatch] Add extractor #292The Hatsune Daishi
closes #223 Authored by: nao20010128nao Modified from: https://github.com/nao20010128nao/ytdl-patched/blob/9e4a0e061a558cdb05a618e27f47ca0ac56ece94/youtube_dl/extractor/whowatch.py
2021-04-28[downloader/ism] Support muxing TTML subtitlesFelix S
2021-04-28[downloader/hls] Assemble single-file WebVTT subtitles from HLS segmentsFelix S
2021-04-28[extractor/common] Extend _extract_akamai_formats to also extract subtitle ↵Felix S
tracks
2021-04-28[extractor/common, downloader/ism] Extract SSTR subtitle tracksFelix S
_parse_ism_formats was extended into _parse_ism_formats_and_subtitles; all direct users were updated, though _extract_ism_formats was left as a compatibility wrapper. The SSTR downloader was also modified in order to prepare for muxing subtitle streams, although no support for any subtitle codecs was added in this commit.
2021-04-28[extractor/common] Extract DASH subtitle tracksFelix S
_extract_mpd_formats and _parse_mpd_formats were extended into _…_formats_and_subtitles; wrappers with old names are provided for compatibility.
2021-04-28[extractor/common] Extract HLS subtitle tracksFelix S
_extract_m3u8_formats is renamed to _extract_m3u8_formats_and_subtitles and extended to handle subtitle tracks instead of skipping them; a wrapper with the old name is provided for compatibility. _parse_m3u8_formats is likewise renamed and extended, but without adding the compatibility wrapper; the test suite is adjusted to test the enhanced method instead.
2021-04-28[extractor/common] Generalise _merge_subtitlesFelix S
This allows modifying a subtitles dictionary in-place.
2021-04-26[FormatSort] Fix for when some formats have quality and others don'tpukkandan
2021-04-17Add option `--ignore-no-formats-error`pukkandan
* Ignores the "no video format" and similar errors * Experimental - Some extractors may still throw these errors
2021-04-17Fix inconsistent use of `report_warning`pukkandan
2021-04-12[documentation] Improvementspukkandan
2021-04-10Update to ytdl-commit-4fb25ffpukkandan
[maoritv] Add new extractor https://github.com/ytdl-org/youtube-dl/commit/4fb25ff5a3be5206bb72e5c4046715b1529fb2c7 Except: [vimeo] improve extraction https://github.com/ytdl-org/youtube-dl/commit/3ae9c0f410b1d4f63e8bada67dd62a8d2852be32 [youtube:tab] Pass innertube context... https://github.com/ytdl-org/youtube-dl/commit/1b0a13f33cfb3644cc718d35951ea85bb1905459
2021-04-10Fix default of `dynamic_mpd`pukkandan
2021-04-04Fix some `m3u8` not obeying `--allow-unplayable-formats`pukkandan
2021-04-04Update to ytdl-commit-654b4f4pukkandan
[youtube] prioritize information from YoutubeIE for playlist entries https://github.com/ytdl-org/youtube-dl/commit/654b4f4ff2718f38b3182c1188c5d569c14cc70a
2021-04-01Fix some typos and linterpukkandan
2021-03-22[youtube] Show if video is `private`, `unlisted` etc in new field ↵Matthew
`availability` (#188) Closes: #185, https://github.com/ytdl-org/youtube-dl/issues/25631 Authored by: colethedj, pukkandan
2021-03-18[documentation] Add deprecated options and aliases in readmepukkandan
2021-03-15[formatSort] Fix `quality` being ignoredpukkandan
Closes #172
2021-03-15Update to ytdl-commit-3be0980pukkandan
https://github.com/ytdl-org/youtube-dl/commit/3be098010f667b14075e3dfad1e74e5e2becc8ea
2021-03-15[Youtube] Rewrite comment extraction (#167)Matthew
Closes #121 TODO: * Add an option for the user to specify newest/popular and max number of comments * Refactor the download code and generalize with TabIE * Parse time_text to timestamp