Convert Figma logo to code with AI

soimort logoyou-get

:arrow_double_down: Dumb downloader that scrapes the web

50,351
9,426
50,351
379

Top Related Projects

131,863

Command-line program to download videos from YouTube.com and other video sites

82,065

A feature-rich command-line audio/video downloader

26,735

👾 Fast and simple video download library and CLI tool written in Go

Download your Spotify playlists and songs along with album art and metadata (from YouTube if a match is found).

8,093

yewtube, forked from mps-youtube , is a Terminal based YouTube player and downloader. No Youtube API key required.

Quick Overview

You-Get is a command-line utility designed to download media contents (videos, audios, images) from the web. It supports a wide range of websites and platforms, making it a versatile tool for users who want to save online content for offline viewing or archival purposes.

Pros

  • Supports a vast array of websites and platforms
  • Easy to use command-line interface
  • Actively maintained and regularly updated
  • Can download high-quality versions of media content

Cons

  • Requires command-line knowledge, which may be challenging for non-technical users
  • Some websites may block or limit downloads, affecting functionality
  • Downloading copyrighted material without permission may be illegal in some jurisdictions
  • Performance can vary depending on the source website and network conditions

Code Examples

# Download a video from YouTube
you-get https://www.youtube.com/watch?v=dQw4w9WgXcQ
# Download a playlist from YouTube
you-get --playlist https://www.youtube.com/playlist?list=PLNYkxOF6rcIB1V2i_qfRtDMcY6YZK1lkt
# Download a video with custom output filename and format
you-get -o /path/to/save -O custom_filename.mp4 https://vimeo.com/123456789

Getting Started

  1. Install You-Get using pip:

    pip3 install you-get
    
  2. Basic usage:

    you-get [OPTIONS] URL
    
  3. For more options and information, use the help command:

    you-get --help
    
  4. To update You-Get to the latest version:

    pip3 install --upgrade you-get
    

Competitor Comparisons

131,863

Command-line program to download videos from YouTube.com and other video sites

Pros of youtube-dl

  • Supports a wider range of websites and platforms
  • More actively maintained with frequent updates
  • Offers more advanced features and customization options

Cons of youtube-dl

  • Slightly more complex command-line interface
  • Larger codebase, which may lead to longer execution times
  • Requires additional dependencies for some functionalities

Code Comparison

you-get:

def download_by_url(self, url, **kwargs):
    try:
        self.prepare(url, **kwargs)
        self.extract(**kwargs)
        self.download(**kwargs)
    except Exception:
        raise

youtube-dl:

def download(self, url_list):
    for url in url_list:
        try:
            self.extract_info(url)
            self.process_info(self._download_info)
        except Exception:
            self.report_error(url)

Both projects aim to download media from various websites, but they differ in their approach and feature set. you-get focuses on simplicity and ease of use, while youtube-dl offers more comprehensive functionality and wider platform support. youtube-dl's codebase is more extensive, allowing for greater flexibility but potentially increasing complexity. you-get's simpler structure may be more appealing for basic use cases or for users who prefer a straightforward tool.

82,065

A feature-rich command-line audio/video downloader

Pros of yt-dlp

  • More actively maintained with frequent updates
  • Supports a wider range of websites and platforms
  • Generally faster download speeds and better performance

Cons of yt-dlp

  • More complex command-line interface
  • Larger file size and more dependencies
  • Steeper learning curve for beginners

Code Comparison

yt-dlp:

ydl_opts = {'format': 'bestaudio/best'}
with yt_dlp.YoutubeDL(ydl_opts) as ydl:
    ydl.download(['https://www.youtube.com/watch?v=dQw4w9WgXcQ'])

you-get:

you_get.main(['https://www.youtube.com/watch?v=dQw4w9WgXcQ'])

yt-dlp offers more customization options and flexibility in its usage, while you-get provides a simpler, more straightforward approach. yt-dlp's code allows for more detailed configuration of download options, whereas you-get's implementation is more concise and easier to use for basic downloads.

Both tools serve the purpose of downloading media from various websites, but yt-dlp is generally considered more powerful and versatile, while you-get is simpler and more user-friendly for those who prefer a more streamlined experience.

26,735

👾 Fast and simple video download library and CLI tool written in Go

Pros of lux

  • Written in Go, potentially offering better performance and easier deployment
  • Supports concurrent downloads, which can speed up the process for multiple files
  • More actively maintained with recent updates

Cons of lux

  • Smaller community and less extensive documentation compared to you-get
  • Fewer supported sites and formats than you-get
  • May require more setup for users not familiar with Go

Code Comparison

you-get:

def download_urls(urls, **kwargs):
    for url in urls:
        download(url, **kwargs)

lux:

func Download(urls []string, option *Options) error {
    for _, url := range urls {
        if err := download(url, option); err != nil {
            return err
        }
    }
    return nil
}

Both projects provide similar functionality for downloading media from various websites. you-get is written in Python and has been around longer, with a larger user base and more extensive site support. lux, being newer and written in Go, offers potential performance benefits and concurrent downloads. However, it has a smaller community and less comprehensive documentation. The choice between the two may depend on the user's familiarity with Python or Go, the specific sites they need to download from, and their performance requirements.

Download your Spotify playlists and songs along with album art and metadata (from YouTube if a match is found).

Pros of spotify-downloader

  • Specialized for Spotify, offering features like playlist and album downloads
  • Provides high-quality audio downloads with metadata and album art
  • Supports various output formats (MP3, FLAC, OGG, M4A)

Cons of spotify-downloader

  • Limited to Spotify content, unlike you-get's multi-platform support
  • Requires a Spotify account and API credentials
  • May have legal concerns due to direct music downloads

Code Comparison

you-get:

def download_urls(urls, **kwargs):
    for url in urls:
        download(url, **kwargs)

spotify-downloader:

def download_track(track_id):
    track = spotify.track(track_id)
    audio = youtube.search(f"{track['name']} {track['artists'][0]['name']}")
    download_audio(audio, track)

Summary

spotify-downloader is a specialized tool for Spotify content, offering high-quality audio downloads with metadata. However, it's limited to Spotify and requires account credentials. you-get is more versatile, supporting multiple platforms, but may lack some of the specialized features for music downloads. The choice between the two depends on the user's specific needs and the platforms they primarily use for media consumption.

8,093

yewtube, forked from mps-youtube , is a Terminal based YouTube player and downloader. No Youtube API key required.

Pros of yewtube

  • Focuses specifically on YouTube, providing a streamlined experience for that platform
  • Offers a text-based interface, which can be more efficient for power users
  • Includes features like playlists and search history management

Cons of yewtube

  • Limited to YouTube content, while you-get supports multiple platforms
  • Requires mpv or mplayer as external dependencies for playback
  • Less actively maintained, with fewer recent updates compared to you-get

Code comparison

you-get:

def download_urls(urls, **kwargs):
    for url in urls:
        download(url, **kwargs)

if __name__ == '__main__':
    main()

yewtube:

def main():
    init_screen()
    try:
        start()
    finally:
        close_screen()

if __name__ == "__main__":
    main()

Both projects use Python, but you-get focuses on a more general-purpose downloader approach, while yewtube is structured around a text-based user interface for YouTube interaction. you-get's code snippet shows its ability to handle multiple URLs, while yewtube's main function sets up and manages the screen interface for user interaction.

Convert Figma logo designs to code with AI

Visual Copilot

Introducing Visual Copilot: A new AI model to turn Figma designs to high quality code using your components.

Try Visual Copilot

README

You-Get

Build Status PyPI version Gitter

NOTICE (30 May 2022): Support for Python 3.5, 3.6 and 3.7 will eventually be dropped. (see details here)

NOTICE (8 Mar 2019): Read this if you are looking for the conventional "Issues" tab.


You-Get is a tiny command-line utility to download media contents (videos, audios, images) from the Web, in case there is no other handy way to do it.

Here's how you use you-get to download a video from YouTube:

$ you-get 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
stream:
    - itag:          43
      container:     webm
      quality:       medium
      size:          0.5 MiB (564215 bytes)
    # download-with: you-get --itag=43 [URL]

Downloading Me at the zoo.webm ...
 100% (  0.5/  0.5MB) ├██████████████████████████████████┤[1/1]    6 MB/s

Saving Me at the zoo.en.srt ... Done.

And here's why you might want to use it:

  • You enjoyed something on the Internet, and just want to download them for your own pleasure.
  • You watch your favorite videos online from your computer, but you are prohibited from saving them. You feel that you have no control over your own computer. (And it's not how an open Web is supposed to work.)
  • You want to get rid of any closed-source technology or proprietary JavaScript code, and disallow things like Flash running on your computer.
  • You are an adherent of hacker culture and free software.

What you-get can do for you:

  • Download videos / audios from popular websites such as YouTube, Youku, Niconico, and a bunch more. (See the full list of supported sites)
  • Stream an online video in your media player. No web browser, no more ads.
  • Download images (of interest) by scraping a web page.
  • Download arbitrary non-HTML contents, i.e., binary files.

Interested? Install it now and get started by examples.

Are you a Python programmer? Then check out the source and fork it!

Installation

Prerequisites

The following dependencies are recommended:

Option 1: Install via pip

The official release of you-get is distributed on PyPI, and can be installed easily from a PyPI mirror via the pip package manager: (Note that you must use the Python 3 version of pip)

$ pip install you-get

Option 2: Install via Antigen (for Zsh users)

Add the following line to your .zshrc:

antigen bundle soimort/you-get

Option 3: Download from GitHub

You may either download the stable (identical with the latest release on PyPI) or the develop (more hotfixes, unstable features) branch of you-get. Unzip it, and put the directory containing the you-get script into your PATH.

Alternatively, run

$ cd path/to/you-get
$ [sudo] python -m pip install .

Or

$ cd path/to/you-get
$ python -m pip install . --user

to install you-get to a permanent path. (And don't omit the dot . representing the current directory)

You can also use the pipenv to install the you-get in the Python virtual environment.

$ pipenv install -e .
$ pipenv run you-get --version
you-get: version 0.4.1555, a tiny downloader that scrapes the web.

Option 4: Git clone

This is the recommended way for all developers, even if you don't often code in Python.

$ git clone git://github.com/soimort/you-get.git

Then put the cloned directory into your PATH, or run python -m pip install path/to/you-get to install you-get to a permanent path.

Option 5: Homebrew (Mac only)

You can install you-get easily via:

$ brew install you-get

Option 6: pkg (FreeBSD only)

You can install you-get easily via:

# pkg install you-get

Option 7: Flox (Mac, Linux, and Windows WSL)

You can install you-get easily via:

$ flox install you-get

Shell completion

Completion definitions for Bash, Fish and Zsh can be found in contrib/completion. Please consult your shell's manual for how to take advantage of them.

Upgrading

Based on which option you chose to install you-get, you may upgrade it via:

$ pip install --upgrade you-get

or download the latest release via:

$ you-get https://github.com/soimort/you-get/archive/master.zip

In order to get the latest develop branch without messing up the PIP, you can try:

$ pip install --upgrade git+https://github.com/soimort/you-get@develop

Getting Started

Download a video

When you get a video of interest, you might want to use the --info/-i option to see all available quality and formats:

$ you-get -i 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
streams:             # Available quality and codecs
    [ DASH ] ____________________________________
    - itag:          242
      container:     webm
      quality:       320x240
      size:          0.6 MiB (618358 bytes)
    # download-with: you-get --itag=242 [URL]

    - itag:          395
      container:     mp4
      quality:       320x240
      size:          0.5 MiB (550743 bytes)
    # download-with: you-get --itag=395 [URL]

    - itag:          133
      container:     mp4
      quality:       320x240
      size:          0.5 MiB (498558 bytes)
    # download-with: you-get --itag=133 [URL]

    - itag:          278
      container:     webm
      quality:       192x144
      size:          0.4 MiB (392857 bytes)
    # download-with: you-get --itag=278 [URL]

    - itag:          160
      container:     mp4
      quality:       192x144
      size:          0.4 MiB (370882 bytes)
    # download-with: you-get --itag=160 [URL]

    - itag:          394
      container:     mp4
      quality:       192x144
      size:          0.4 MiB (367261 bytes)
    # download-with: you-get --itag=394 [URL]

    [ DEFAULT ] _________________________________
    - itag:          43
      container:     webm
      quality:       medium
      size:          0.5 MiB (568748 bytes)
    # download-with: you-get --itag=43 [URL]

    - itag:          18
      container:     mp4
      quality:       small
    # download-with: you-get --itag=18 [URL]

    - itag:          36
      container:     3gp
      quality:       small
    # download-with: you-get --itag=36 [URL]

    - itag:          17
      container:     3gp
      quality:       small
    # download-with: you-get --itag=17 [URL]

By default, the one on the top is the one you will get. If that looks cool to you, download it:

$ you-get 'https://www.youtube.com/watch?v=jNQXAC9IVRw'
site:                YouTube
title:               Me at the zoo
stream:
    - itag:          242
      container:     webm
      quality:       320x240
      size:          0.6 MiB (618358 bytes)
    # download-with: you-get --itag=242 [URL]

Downloading Me at the zoo.webm ...
 100% (  0.6/  0.6MB) ├██████████████████████████████████████████████████████████████████████████████┤[2/2]    2 MB/s
Merging video parts... Merged into Me at the zoo.webm

Saving Me at the zoo.en.srt ... Done.

(If a YouTube video has any closed captions, they will be downloaded together with the video file, in SubRip subtitle format.)

Or, if you prefer another format (mp4), just use whatever the option you-get shows to you:

$ you-get --itag=18 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Note:

  • At this point, format selection has not been generally implemented for most of our supported sites; in that case, the default format to download is the one with the highest quality.
  • ffmpeg is a required dependency, for downloading and joining videos streamed in multiple parts (e.g. on some sites like Youku), and for YouTube videos of 1080p or high resolution.
  • If you don't want you-get to join video parts after downloading them, use the --no-merge/-n option.

Download anything else

If you already have the URL of the exact resource you want, you can download it directly with:

$ you-get https://stallman.org/rms.jpg
Site:       stallman.org
Title:      rms
Type:       JPEG Image (image/jpeg)
Size:       0.06 MiB (66482 Bytes)

Downloading rms.jpg ...
 100% (  0.1/  0.1MB) ├████████████████████████████████████████┤[1/1]  127 kB/s

Otherwise, you-get will scrape the web page and try to figure out if there's anything interesting to you:

$ you-get https://kopasas.tumblr.com/post/69361932517
Site:       Tumblr.com
Title:      [tumblr] tumblr_mxhg13jx4n1sftq6do1_640
Type:       Portable Network Graphics (image/png)
Size:       0.11 MiB (118484 Bytes)

Downloading [tumblr] tumblr_mxhg13jx4n1sftq6do1_640.png ...
 100% (  0.1/  0.1MB) ├████████████████████████████████████████┤[1/1]   22 MB/s

Note:

  • This feature is an experimental one and far from perfect. It works best on scraping large-sized images from popular websites like Tumblr and Blogger, but there is really no universal pattern that can apply to any site on the Internet.

Search on Google Videos and download

You can pass literally anything to you-get. If it isn't a valid URL, you-get will do a Google search and download the most relevant video for you. (It might not be exactly the thing you wish to see, but still very likely.)

$ you-get "Richard Stallman eats"

Pause and resume a download

You may use Ctrl+C to interrupt a download.

A temporary .download file is kept in the output directory. Next time you run you-get with the same arguments, the download progress will resume from the last session. In case the file is completely downloaded (the temporary .download extension is gone), you-get will just skip the download.

To enforce re-downloading, use the --force/-f option. (Warning: doing so will overwrite any existing file or temporary file with the same name!)

Set the path and name of downloaded file

Use the --output-dir/-o option to set the path, and --output-filename/-O to set the name of the downloaded file:

$ you-get -o ~/Videos -O zoo.webm 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Tips:

  • These options are helpful if you encounter problems with the default video titles, which may contain special characters that do not play well with your current shell / operating system / filesystem.
  • These options are also helpful if you write a script to batch download files and put them into designated folders with designated names.

Proxy settings

You may specify an HTTP proxy for you-get to use, via the --http-proxy/-x option:

$ you-get -x 127.0.0.1:8087 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

However, the system proxy setting (i.e. the environment variable http_proxy) is applied by default. To disable any proxy, use the --no-proxy option.

Tips:

  • If you need to use proxies a lot (in case your network is blocking certain sites), you might want to use you-get with proxychains and set alias you-get="proxychains -q you-get" (in Bash).
  • For some websites (e.g. Youku), if you need access to some videos that are only available in mainland China, there is an option of using a specific proxy to extract video information from the site: --extractor-proxy/-y.

Watch a video

Use the --player/-p option to feed the video into your media player of choice, e.g. mpv or vlc, instead of downloading it:

$ you-get -p vlc 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Or, if you prefer to watch the video in a browser, just without ads or comment section:

$ you-get -p chromium 'https://www.youtube.com/watch?v=jNQXAC9IVRw'

Tips:

  • It is possible to use the -p option to start another download manager, e.g., you-get -p uget-gtk 'https://www.youtube.com/watch?v=jNQXAC9IVRw', though they may not play together very well.

Load cookies

Not all videos are publicly available to anyone. If you need to log in your account to access something (e.g., a private video), it would be unavoidable to feed the browser cookies to you-get via the --cookies/-c option.

Note:

  • As of now, we are supporting two formats of browser cookies: Mozilla cookies.sqlite and Netscape cookies.txt.

Reuse extracted data

Use --url/-u to get a list of downloadable resource URLs extracted from the page. Use --json to get an abstract of extracted data in the JSON format.

Warning:

  • For the time being, this feature has NOT been stabilized and the JSON schema may have breaking changes in the future.

Supported Sites

SiteURLVideos?Images?Audios?
YouTubehttps://www.youtube.com/✓
X (Twitter)https://x.com/✓✓
VKhttps://vk.com/✓✓
Vimeohttps://vimeo.com/✓
Veohhttps://www.veoh.com/✓
Tumblrhttps://www.tumblr.com/✓✓✓
TEDhttps://www.ted.com/✓
SoundCloudhttps://soundcloud.com/✓
SHOWROOMhttps://www.showroom-live.com/✓
Pinteresthttps://www.pinterest.com/✓
MTV81https://www.mtv81.com/✓
Mixcloudhttps://www.mixcloud.com/✓
Metacafehttps://www.metacafe.com/✓
Magistohttps://www.magisto.com/✓
Khan Academyhttps://www.khanacademy.org/✓
Internet Archivehttps://archive.org/✓
Instagramhttps://instagram.com/✓✓
InfoQhttps://www.infoq.com/presentations/✓
Imgurhttps://imgur.com/✓
Heavy Music Archivehttps://www.heavy-music.ru/✓
Freesoundhttps://www.freesound.org/✓
Flickrhttps://www.flickr.com/✓✓
FC2 Videohttps://video.fc2.com/✓
Facebookhttps://www.facebook.com/✓
eHowhttps://www.ehow.com/✓
Dailymotionhttps://www.dailymotion.com/✓
Coubhttps://coub.com/✓
CBShttps://www.cbs.com/✓
Bandcamphttps://bandcamp.com/✓
AliveThaihttps://alive.in.th/✓
interest.mehttps://ch.interest.me/tvn✓
755
ナナゴーゴー
https://7gogo.jp/✓✓
niconico
ニコニコ動画
https://www.nicovideo.jp/✓
163
网易视频
网易云音乐
https://v.163.com/
https://music.163.com/
✓✓
56网https://www.56.com/✓
AcFunhttps://www.acfun.cn/✓
Baidu
百度贴吧
https://tieba.baidu.com/✓✓
爆米花网https://www.baomihua.com/✓
bilibili
哔哩哔哩
https://www.bilibili.com/✓✓✓
豆瓣https://www.douban.com/✓✓
斗鱼https://www.douyutv.com/✓
凤凰视频https://v.ifeng.com/✓
风行网https://www.fun.tv/✓
iQIYI
爱奇艺
https://www.iqiyi.com/✓
激动网https://www.joy.cn/✓
酷6网https://www.ku6.com/✓
酷狗音乐https://www.kugou.com/✓
酷我音乐https://www.kuwo.cn/✓
乐视网https://www.le.com/✓
荔枝FMhttps://www.lizhi.fm/✓
懒人听书https://www.lrts.me/✓
秒拍https://www.miaopai.com/✓
MioMio弹幕网https://www.miomio.tv/✓
MissEvan
猫耳FM
https://www.missevan.com/✓
痞客邦https://www.pixnet.net/✓
PPTV聚力https://www.pptv.com/✓
齐鲁网https://v.iqilu.com/✓
QQ
腾讯视频
https://v.qq.com/✓
企鹅直播https://live.qq.com/✓
Sina
新浪视频
微博秒拍视频
https://video.sina.com.cn/
https://video.weibo.com/
✓
Sohu
搜狐视频
https://tv.sohu.com/✓
Tudou
土豆
https://www.tudou.com/✓
阳光卫视https://www.isuntv.com/✓
Youku
优酷
https://www.youku.com/✓
战旗TVhttps://www.zhanqi.tv/lives✓
央视网https://www.cntv.cn/✓
Naver
네이버
https://tvcast.naver.com/✓
芒果TVhttps://www.mgtv.com/✓
火猫TVhttps://www.huomao.com/✓
阳光宽频网https://www.365yg.com/✓
西瓜视频https://www.ixigua.com/✓
新片场https://www.xinpianchang.com/✓
快手https://www.kuaishou.com/✓✓
抖音https://www.douyin.com/✓
TikTokhttps://www.tiktok.com/✓
中国体育(TV)https://v.zhibo.tv/
https://video.zhibo.tv/
✓
知乎https://www.zhihu.com/✓

For all other sites not on the list, the universal extractor will take care of finding and downloading interesting resources from the page.

Known bugs

If something is broken and you-get can't get you things you want, don't panic. (Yes, this happens all the time!)

Check if it's already a known problem on https://github.com/soimort/you-get/wiki/Known-Bugs. If not, follow the guidelines on how to report an issue.

Getting Involved

You can reach us on the Gitter channel #soimort/you-get (here's how you set up your IRC client for Gitter). If you have a quick question regarding you-get, ask it there.

If you are seeking to report an issue or contribute, please make sure to read the guidelines first.

Legal Issues

This software is distributed under the MIT license.

In particular, please be aware that

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.

Translated to human words:

In case your use of the software forms the basis of copyright infringement, or you use the software for any other illegal purposes, the authors cannot take any responsibility for you.

We only ship the code here, and how you are going to use it is left to your own discretion.

Authors

Made by @soimort, who is in turn powered by :coffee:, :beer: and :ramen:.

You can find the list of all contributors here.