aboutsummaryrefslogtreecommitdiff
path: root/yt_dlp/extractor/common.py
AgeCommit message (Collapse)Author
2025-04-06[utils] `_yield_json_ld`: Make function less fatal (#12855)sepro
Authored by: seproDev
2025-03-24[ie] Fix sorting of HLS audio formats by `GROUP-ID` (#12714)bashonly
Closes #11178 Authored by: bashonly
2025-03-21[cleanup] Misc (#12526)Simon Sawicki
Authored by: Grub4K, seproDev, gamer191, dirkf Co-authored-by: sepro <sepro@sepr0.com>
2025-02-23[core] Load plugins on demand (#11305)coletdjnz
- Adds `--no-plugin-dirs` to disable plugin loading - `--plugin-dirs` now supports post-processors Authored by: coletdjnz, Grub4K, pukkandan
2025-02-19[fd/hls] Support `--write-pages` for m3u8 media playlists (#12333)bashonly
Authored by: bashonly
2025-02-10[fd/hls] Support `hls_media_playlist_data` format field (#12322)bashonly
Authored by: bashonly
2024-12-02[cleanup] Bump ruff to 0.8.x (#11608)sepro
Authored by: seproDev
2024-11-27[ie] Handle fragmented formats in `_remove_duplicate_formats` (#11637)Simon Sawicki
Authored by: Grub4K
2024-11-17[cleanup] Misc (#11554)bashonly
Closes #6884 Authored by: bashonly, Grub4K, seproDev Co-authored-by: Simon Sawicki <contact@grub4k.xyz> Co-authored-by: sepro <sepro@sepr0.com>
2024-11-17[cleanup] Deprecate more compat functions (#11439)sepro
Authored by: seproDev
2024-11-15[ie] Allow `ext` override for thumbnails (#11545)bashonly
Authored by: bashonly
2024-11-04[cleanup] Misc (#11347)sepro
Closes #11361 Authored by: avagordon01, bashonly, grqz, Grub4K, seproDev Co-authored-by: Ava Gordon <avagordon01@gmail.com> Co-authored-by: bashonly <bashonly@protonmail.com> Co-authored-by: N/Ame <173015200+grqz@users.noreply.github.com> Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-10-30Fix `--netrc` empty string parsing for Python <=3.10 (#11414)bashonly
Ref: https://github.com/python/cpython/commit/15409c720be0503131713e3d3abc1acd0da07378 Closes #11413 Authored by: bashonly, Grub4K Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-10-26[ie] Resolve `language` to ISO639-2 for ISM formats (#11359)bashonly
Closes #11356 Authored by: bashonly
2024-10-22[cleanup] Misc (#11216)Simon Sawicki
- Add Python 3.13 to CI, finalize 3.13 support - Remove Python 3.8 from CI in preparation for removing 3.8 support - Document that PyPy3.8 and PyPy3.9 are no longer supported - Usual documentation fixes and code cleanup Closes #8248, Closes #11146, Closes #11149, Closes #11211 Authored by: Grub4K, grqz, DTrombett, KarboniteKream, bashonly, mikkovedru, seproDev Co-authored-by: N/Ame <173015200+grqz@users.noreply.github.com> Co-authored-by: DTrombett <d@trombett.org> Co-authored-by: =?UTF-8?q?Klemen=20Ko=C5=A1ir?= <klemen.kosir@kream.io> Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com> Co-authored-by: Mikko Vedru <mikko.vedru@gmail.com> Co-authored-by: sepro <sepro@sepr0.com>
2024-10-13Add extractor helpers (#10653)Simon Sawicki
Authored by: Grub4K
2024-09-29[ie/ApplePodcasts] Fix extractor (#10903)Corey Wright
Closes #10809 Authored by: coreywright
2024-09-27[cleanup] Misc (#10807)bashonly
Closes #10751, Closes #10769, Closes #10791 Authored by: bashonly, Codenade, pzhlkj6612, seproDev, coletdjnz, grqz, Grub4K Co-authored-by: Codenade <amadeus.dorian04@gmail.com> Co-authored-by: Mozi <29089388+pzhlkj6612@users.noreply.github.com> Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com> Co-authored-by: coletdjnz <coletdjnz@protonmail.com> Co-authored-by: N/Ame <173015200+grqz@users.noreply.github.com> Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-09-13[ie] Handle decode errors when reading responses (#10868)bashonly
Authored by: bashonly
2024-09-13[ie] Fix JW Player format parsing (#10956)sepro
Authored by: seproDev
2024-07-30[ie/learningonscreen] Add extractor (#10590)bashonly
Authored by: bashonly, Grub4K Co-authored-by: Simon Sawicki <contact@grub4k.xyz>
2024-06-20[ie/youtube] Extract all formats from multi-language m3u8s (#9875)Haxy
Authored by: clienthax, bashonly Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com>
2024-06-15[fd/hls] Apply `extra_param_to_key_url` from info dictbashonly
Authored by: bashonly
2024-06-12[cleanup] Add more ruff rules (#10149)sepro
Authored by: seproDev Reviewed-by: bashonly <88596187+bashonly@users.noreply.github.com> Reviewed-by: Simon Sawicki <contact@grub4k.xyz>
2024-05-27[ie] Fix parsing of base URL in SMIL manifest (#9225)sepro
Authored by: seproDev
2024-05-26[misc] Cleanup (#9765)Simon Sawicki
Closes #9763 Authored by: bashonly, seproDev, Grub4K Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com> Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
2024-05-26Update to ytdl-commit-a08f2b7 (#10012)Simon Sawicki
[ie] Rework JWPlayer extraction - https://github.com/ytdl-org/youtube-dl/commit/f66372403fd9e1661199fea100ba2600fa9697b2 [ie/gbnews] Add extractor - https://github.com/ytdl-org/youtube-dl/commit/70f230f9cf28e948662599b6257cb7d1262870e3 [ie/caffeinetv] Add extractor - https://github.com/ytdl-org/youtube-dl/commit/40bd5c18153afe765caa6726302ee1dd8a9a2ce6 [ie/youporn] Improve extraction - https://github.com/ytdl-org/youtube-dl/commit/0b2ce3685e02ea1a3ccee1026572e081b8f6ac83 [ie/youporn] Add playlist extractors - https://github.com/ytdl-org/youtube-dl/commit/668332b9733023ca2e927eeb2208725022248af8 Closes #9188, Closes #9523 Authored by: Grub4K, bashonly
2024-05-26[misc] Add `hatch`, `ruff`, `pre-commit` and improve dev docs (#7409)Simon Sawicki
Authored by: bashonly, seproDev, Grub4K Co-authored-by: bashonly <88596187+bashonly@users.noreply.github.com> Co-authored-by: sepro <4618135+seproDev@users.noreply.github.com>
2024-05-17Bugfix for 61b17437dc14a1c7e90ff48a6198df77828c6df4bashonly
Authored by: bashonly
2024-05-17[ie] Add POST data hash to `--write-pages` filenames (#9879)minamotorin
Closes #9773 Authored by: minamotorin
2024-04-21[ie] Make `_search_nextjs_data` non fatal (#8937)Simon Sawicki
Authored by: Grub4K
2024-04-01[core] Fix `filesize_approx` calculation (#9560)sepro
Reverts 22e4dfacb61f62dfbb3eb41b31c7b69ba1059b80 Despite being documented as `Kbit/s`, the extractors/manifests were returning bitrates in SI units of kilobits/sec. Authored by: seproDev, pukkandan
2024-03-30[ie] Add extractor impersonate API (#9474)bashonly
Authored by: bashonly, Grub4K, pukkandan
2024-03-29[fd/ffmpeg] Accept output args from info dict (#9278)bashonly
Authored by: bashonly
2024-03-11[cleanup] Fix misc bugs (#8968)pukkandan
Closes #8816 Authored by: bashonly, seproDev, pukkandan, Grub4k
2024-03-08[cleanup] Fix infodict returned fields (#8906)sepro
Authored by: seproDev
2024-02-20[ie] Migrate commonly plural fields to lists (#8917)Lev
Authored by: llistochek, pukkandan Related: #3944
2024-02-20[ie] Support multi-period MPD streams (#6654)Alard
2023-12-11[ie] Add `media_type` fieldBenjamin Krausse
Authored by: trainman261
2023-11-26[core] Parse `release_year` from `release_date` (#8524)sepro
Closes #7263 Authored by: seproDev
2023-11-18[ie] Extract from `media` elements in SMIL manifests (#8504)sepro
Authored by: seproDev
2023-11-14[ie] Do not test truth value of `xml.etree.ElementTree.Element` (#8582)bashonly
Testing the truthiness of an `xml.etree.ElementTree.Element` instance is deprecated in py3.12 Authored by: bashonly
2023-10-07[cleanup] Misc (#8300)Simon Sawicki
* Simplify nuxt regex * Fix tmz quotes and tests * Update test python versions Authored by: dirkf, gamer191, Grub4K
2023-09-21[ie] Make `_search_nuxt_data` more lenientbashonly
Authored by: std-move Co-authored-by: std-move <26625259+std-move@users.noreply.github.com>
2023-07-30[cleanup] Miscpukkandan
2023-07-24[ie] Extract subtitles from SMIL manifests (#7667)bashonly
Authored by: bashonly, pukkandan
2023-07-22[extractor] Fix `--load-pages`pukkandan
2023-07-15[compat, networking] Deprecate old functions (#2861)coletdjnz
Authored by: coletdjnz, pukkandan
2023-07-15[networking] Rewrite architecture (#2861)coletdjnz
New networking interface consists of a `RequestDirector` that directs each `Request` to appropriate `RequestHandler` and returns the `Response` or raises `RequestError`. The handlers define adapters to transform its internal Request/Response/Errors to our interfaces. User-facing changes: - Fix issues with per request proxies on redirects for urllib - Support for `ALL_PROXY` environment variable for proxy setting - Support for `socks5h` proxy - Closes https://github.com/yt-dlp/yt-dlp/issues/6325, https://github.com/ytdl-org/youtube-dl/issues/22618, https://github.com/ytdl-org/youtube-dl/pull/28093 - Raise error when using `https` proxy instead of silently converting it to `http` Authored by: coletdjnz
2023-07-06[core] Allow extractors to mark formats as potentially DRM (#7396)pukkandan
This is useful for HLS where detecting whether the format is actually DRM requires the child manifest to be downloaded. Makes the error message when using `--test` inconsistent, but doesn't really matter.