aboutsummaryrefslogtreecommitdiff
path: root/yt_dlp/extractor/common.py
AgeCommit message (Collapse)Author
2022-04-27[extractor] Update dash `manifest_url` after redirects (#3563)Elyse
Closes #2696 Authored by: elyse0
2022-04-18[compat] Split into sub-modules (#2173)felix
Authored by: fstirlitz, pukkandan
2022-04-12[cleanup] Sort importspukkandan
Using https://github.com/PyCQA/isort isort -m VERTICAL_HANGING_INDENT --py 36 -l 80 --rr -n --tc .
2022-04-12[cleanup] Upgrade syntaxpukkandan
Using https://github.com/asottile/pyupgrade 1. `__future__` imports and `coding: utf-8` were removed 2. Files were rewritten with `pyupgrade --py36-plus --keep-percent-format` 3. f-strings were cherry-picked from `pyupgrade --py36-plus` Extractors are left untouched (except removing header) to avoid unnecessary merge conflicts
2022-04-12[cleanup] Mark some compat variables for removal (#2173)pukkandan
Authored by fstirlitz, pukkandan
2022-04-12[cleanup] Remove unused code paths (#2173)felix
Notes: * `_windows_write_string`: Fixed in 3.6 * https://bugs.python.org/issue1602 * PEP: https://www.python.org/dev/peps/pep-0528 * Windows UTF-8 fix: Fixed in 3.3 * https://bugs.python.org/issue13216 * `__loader__`: is always present in 3.3+ * https://bugs.python.org/issue14646 * `workaround_optparse_bug9161`: Fixed in 2.7 * https://bugs.python.org/issue9161 Authored by: fstirlitz
2022-04-07[youtube] Fix uploader for collaborative playlists (#3332)coletdev
Authored by: coletdjnz
2022-04-05[cleanup] Misc fixespukkandan
Closes https://github.com/yt-dlp/yt-dlp/pull/3213, Closes https://github.com/yt-dlp/yt-dlp/pull/3117 Related: https://github.com/yt-dlp/yt-dlp/issues/3146#issuecomment-1077323114, https://github.com/yt-dlp/yt-dlp/pull/3277#discussion_r841019671, https://github.com/yt-dlp/yt-dlp/commit/a825ffbffa0bea322e3ccb44c6f8e01d8d9572fb#commitcomment-68538986, https://github.com/yt-dlp/yt-dlp/issues/2360, https://github.com/yt-dlp/yt-dlp/commit/5fa3c9a88f597625296981a4a26be723e65d4842#r70393519, https://github.com/yt-dlp/yt-dlp/commit/5fa3c9a88f597625296981a4a26be723e65d4842#r70393254
2022-04-04[cleanup] Use `_html_extract_title`pukkandan
2022-04-03[elonet] Rewrite extractor (#3277)Fam0r
Closes #2911 Authored by: Fam0r, pukkandan
2022-03-28[utils] Add `filter_dict`pukkandan
2022-03-24[docs] Minor improvementspukkandan
Closes #3127, Closes #3081, Closes #3177
2022-03-24Fix bug in 52efa4b31200119adaa8acf33e50b84fcb6948f0pukkandan
Closes #3173
2022-03-24[extractor] Allow control characters inside jsonpukkandan
Closes #3174
2022-03-18[extractor] Add `_perform_login` function (#2943)pukkandan
* Adds new functions `_initialize_pre_login` and `_perform_login` as part of the extractor API * Adds `ie.supports_login` to the public API
2022-03-12[extractor] Support merging subtitles with datacoletdjnz
Authored-by: coletdjnz
2022-03-08[cleanup, docs] Misc cleanuppukkandan
Closes #2828, closes #2734, closes #2802, closes #2937
2022-03-08[utils] Better traceback for `ExtractorError`pukkandan
2022-03-04[ant1newsgr] Add extractor (#1982)Zenon Mousmoulas
Authored by: zmousm
2022-03-04[FormatSort] Consider `acodec`=`ogg` as `vorbis`pukkandan
2022-03-04Fix doubling of `video_id` in `ExtractorError`pukkandan
2022-03-03[extractor] Support `--mark-watched` without `_NETRC_MACHINE` (#2939)coletdev
Authored by: coletdjnz
2022-02-23[nhk] Add support for NHK for School (#2850)Lesmiscore (Naoya Ozaki)
Authored by: Lesmiscore
2022-02-17[extractor] Fix for manifests without period durationpukkandan
Closes #2705 Authored by: dirkf, pukkandan
2022-02-11[extractor] Allow `http_headers` to be specified for `thumbnails`pukkandan
2022-02-11[downloader] Do not use aria2c for non-native `m3u8`pukkandan
Closes #2718
2022-02-03[cleanup,docs] Minor fixespukkandan
Closes #2541, #2484
2022-02-02[generic] Allow further processing of json_ld URLpukkandan
Closes #2578
2022-01-24[extractor] Allow non-fatal `title` extractionpukkandan
2022-01-24[extractor] Extract video inside `Article` json_ldpukkandan
Closes #2448
2022-01-24[extractor] Add convinience function `_yes_playlist`pukkandan
2022-01-21[cleanup] Minor fixespukkandan
Closes #2334
2022-01-21[youtube] Extract channel subscriber count (#2399)coletdjnz
Closes #2350 * Adds `channel_follower_count` field Authored-by: coletdjnz
2022-01-20[extractor] Improve `url_result` and relatedpukkandan
2022-01-20[extractor,cleanup] Use `_search_nextjs_data`pukkandan
2022-01-20[iq.com] Add extractors (#2354)MinePlayersPE
Closes #704 Authored by: MinePlayersPE
2022-01-11[digitalconcerthall] Add extractor (#1931)teridon
Authored by: teridon
2022-01-07[youtube:tab] Extract more playlist metadata (#2069)coletdjnz
* Add fields modified_date, modified_timestamp * Add field playlist_count * [youtube:tab] Extract view_count, playlist_count, modified_date Authored by: coletdjnz, pukkandan
2022-01-02[extractor] Extract chapters from JSON-LD (#2031)chris
Authored by: iw0nderhow, pukkandan
2022-01-02[extractor] Extract thumbnails from JSON-LD (#2195)nixxo
Authored by: nixxo
2022-01-01[extractor] Detect more subtitle codecs in MPD manifests (#2174)Felix S
Authored by: fstirlitz
2021-12-25[GameJolt] Add extractors (#2036)MinePlayersPE
Authored by: MinePlayersPE
2021-12-24[npr] Make SMIL extraction non-fatal (#2099)siddharth
Closes #1934 Authored by: r5d
2021-12-23[cleanup] Misc cleanuppukkandan
Closes #1942 #1976 #2020 #2058 #1984
2021-12-20[dash,youtube] Download live from start to end (#888)The Hatsune Daishi
* Add option `--live-from-start` to enable downloading live videos from start * Add key `is_from_start` in formats to identify formats (of live videos) that downloads from start * [dash] Create protocol `http_dash_segments_generator` that allows a function to be passed instead of fragments * [fragment] Allow multiple live dash formats to download simultaneously * [youtube] Implement fragment re-fetching for the live dash formats * [youtube] Re-extract dash manifest every 5 hours (manifest expires in 6hrs) * [postprocessor/ffmpeg] Add `FFmpegFixupDuplicateMoovPP` to fixup duplicated moov atoms Known issue: Ctrl+C doesn't work on Windows when downloading multiple formats Closes #1521 Authored by: nao20010128nao, pukkandan
2021-12-17[extractor] Support default implicit graph in JSON-LD (#1983)Zenon Mousmoulas
Original PR: https://github.com/ytdl-org/youtube-dl/pull/30229 Per W3C JSON-LD v1.1 ยง4.9 (non-normative ref): When a JSON-LD document's top-level structure is a map that contains no other keys than @graph and optionally @context (properties that are not mapped to an IRI or a keyword are ignored), @graph is considered to express the otherwise implicit default graph. Authored by: zmousm
2021-12-15[tiktok] Fix 53dad39e30b007feed4b6d4776bd15d28c27a96cpukkandan
2021-12-15[extractor] Standardize `_live_title`pukkandan
2021-12-15[FormatSort] Prevent incorrect deprecation warningpukkandan
Closes #1981
2021-12-07[extractor] Add `_search_nuxt_data` (#1921)The Hatsune Daishi
Authored by: nao20010128nao