Hacker News
points by Forgeties79 2 days ago | 0 comments
What are you using?
[–] EvanAnderson 2 days ago
Not the poster you're replying to, but my archiving rig uses my personal fork of "tt-rss" to pull in the RSS feeds for the channels I care about and a script to query the database. That script uses yt-dlp to download the videos and subs, then marks them downloaded in the database. It's a bunch of glue-and-tape scripting code but was easy to hack together in an afternoon. Tweaking yt-dlp to run at a velocity that didn't get my IP address put into "you must login" hell was the most difficult part. The only long-term care-and-feeding has been keeping yt-dlp updated in the face of the arms race.
[–] entropie 2 days ago
> Tweaking yt-dlp to run at a velocity that didn't get my IP address put into "you must login" hell was the most difficult part. YouTube is pretty hassle-free in that regard, at least for my IP region.

I have a script that downloads sequentially, and there’s an optional variable interval in between—though I don’t think I’ll actually need that. I once downloaded the entire contents of a YouTube channel that had over 400 GB of audiobooks. After a while, YouTube throttled the speed to 1/2 MB/s—which didn’t bother me, but everything still downloaded successfully. That was already two years ago, though.

A few days ago, I spent two consecutive days nonstop downloading playlists from YouTube Music, but that didn't trigger anything either.

[–] EvanAnderson 2 days ago
I stick a random delay between downloads, never download streams in parallel, and always download when nobody is using YouTube (ideally when nobody is home or everybody is asleep).

I never did get throttled-- I just stuck in "you must login" hell. We don't login to YouTube in our household, so that effectively cut YouTube off for my wife and daughter. My wife couldn't have cared less but I learned that being able to stream music videos while getting ready for the day or bed is mission-critical for my daughter. (I've asked her to identify channels I can sic the archiving rig on but, heretofore, she hasn't done it. I keep telling her those videos she likes could disappear at a moment's notice...)