Forum is open for all, Tracker is invite only. Please use same username as on both when you register...

Username: Log me on automatically each visit
Password:
It is currently Thu Nov 21, 2024 9:35 am


Post a new topicPost a reply Page 1 of 1   [ 7 posts ]
Author Message
 Post subject: How to batch download videos from paid sites like AOJ, Buchechaonline, etc?
PostPosted: Tue May 15, 2018 6:06 pm 
User avatar

Joined: Tue Feb 09, 2016 8:12 pm
Posts: 15
Wondering if there's a quicker way than downloading each video individually with something like a chrome extension and how people have created the giant site rip torrents. Any software or methods to batch download and rip these entire sites?


Top
 Profile  
Reply with quote  
 Post subject: Re:
PostPosted: Wed May 16, 2018 3:50 am 
Special

Joined: Sat Mar 11, 2017 1:22 am
Posts: 20
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Top
 Profile  
Reply with quote  
 Post subject: Re: Re:
PostPosted: Wed May 16, 2018 7:58 pm 
User avatar

Joined: Tue Feb 09, 2016 8:12 pm
Posts: 15
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.


Top
 Profile  
Reply with quote  
 Post subject: Re: Re:
PostPosted: Fri May 18, 2018 6:54 pm 
Site Admin
User avatar

Joined: Tue Apr 07, 2009 12:53 pm
Posts: 13407
Location: In front of you
nordik wrote:
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.



Do you think this would work?

http://savevideo.me

_________________
Image
So you wanna be a [bleeping] member? => Get access to the community <=

Image

Looking for a seedbox? RuTorrent, qbitTorrent, Deluge and Transmission included in all packages! Unlimited torrents, unlimited transfers!
Perfect for both beginners and professionals. Watch the files directly in your browser without downloading or download to your device, up to you!

Image
Really Fast 1 Gbit seedboxes - Professional support 24/7/365 - Click to learn more
To get a recurring 10% discount on all seedbox packages use the PROMO CODE: mmatorrents


Top
 Profile  
Reply with quote  
 Post subject: Re: Re:
PostPosted: Sat May 19, 2018 6:08 pm 
User avatar

Joined: Tue Feb 09, 2016 8:12 pm
Posts: 15
Dent wrote:
nordik wrote:
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.



Do you think this would work?

http://savevideo.me



Looks like the privacy settings of the source video on vimeo are blocking the link from being ripped from a site like that :sad:


Top
 Profile  
Reply with quote  
 Post subject: Re:
PostPosted: Sun May 20, 2018 8:14 pm 
Site Admin
User avatar

Joined: Tue Apr 07, 2009 12:53 pm
Posts: 13407
Location: In front of you
The reason you will find it hard to find exact info or a guide is that this kind of information is not "good" to share. Why? Well not all videos are "happy to be downloaded" and they might prevent you from doing it if you tell them how you do it ;) You know what I mean...

But a few hints.

kernelcrash wrote:
find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.


ffmpeg is a free program

https://ffmpeg.zeranoe.com/builds/

and it works like this

Code:
ffmpeg -i "THE SRC URL HERE" -c copy -bsf:a aac_adtstoasc "video.mp4"


kernelcrash wrote:
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


You need a program like Fiddler 4 or some other snooping program to find the src url.


You will find that it is not a straight forward method and that a lot of testing is required.

:ympeace:

_________________
Image
So you wanna be a [bleeping] member? => Get access to the community <=

Image

Looking for a seedbox? RuTorrent, qbitTorrent, Deluge and Transmission included in all packages! Unlimited torrents, unlimited transfers!
Perfect for both beginners and professionals. Watch the files directly in your browser without downloading or download to your device, up to you!

Image
Really Fast 1 Gbit seedboxes - Professional support 24/7/365 - Click to learn more
To get a recurring 10% discount on all seedbox packages use the PROMO CODE: mmatorrents


Top
 Profile  
Reply with quote  
 Post subject: Re: How to batch download videos from paid sites like AOJ, Buchechaonline, etc?
PostPosted: Fri Dec 15, 2023 10:54 am 
User avatar

Joined: Sat Nov 30, 2019 6:37 am
Posts: 19
5 or so years later, but for the record a program called yt-dlp can do batch downloads and it has very wide compatibility. See https://github.com/yt-dlp/yt-dlp

It's command line only. Easiest way is to run a linux vm (Ubuntu etc). Sample command to do a batch download would be: 'yt-dlp -a dl.txt'

dl.txt is a text file with one link per line. Name it whatever you want.

Lots of other instructions and options in the link above, but yt-dlp works on a very high percentage of sites.

If yt-dlp doesn't work, things get harder. Often as Dent has suggested the challenge can be finding the source URL. One app I've found useful for that is a chrome extension called 'Video DownloadHelper'.


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post a new topicPost a reply Page 1 of 1   [ 7 posts ]


Who is online

Users browsing this forum: No registered users and 6 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  

 
Powered by phpBB © 2000 - 2023 phpBB Group
Theme By: Nikkbu
Twitter RSS Feed Twitter