MMA-Torrents.com Forum
https://foru.mma-torrents.com/

How to batch download videos from paid sites like AOJ, Buchechaonline, etc?
https://foru.mma-torrents.com/viewtopic.php?f=89&t=7815		 Page 1 of 1
Author:  nordik [ Tue May 15, 2018 6:06 pm ]
Post subject:  How to batch download videos from paid sites like AOJ, Buchechaonline, etc?
Wondering if there's a quicker way than downloading each video individually with something like a chrome extension and how people have created the giant site rip torrents. Any software or methods to batch download and rip these entire sites?
Author:  kernelcrash [ Wed May 16, 2018 3:50 am ]
Post subject:  Re:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy
Author:  nordik [ Wed May 16, 2018 7:58 pm ]
Post subject:  Re: Re:
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.
Author:  Dent [ Fri May 18, 2018 6:54 pm ]
Post subject:  Re: Re:
nordik wrote:
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.



Do you think this would work?

http://savevideo.me
Author:  nordik [ Sat May 19, 2018 6:08 pm ]
Post subject:  Re: Re:
Dent wrote:
nordik wrote:
kernelcrash wrote:
If you know a bit of python write something with BeautifulSoup or selenium and find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


Interesting. Sadly I don't know much about Python but the site I am attempting to batch download from (Buchecha's) is indeed wordpress and the embedded videos work through vimeo i think.



Do you think this would work?

http://savevideo.me



Looks like the privacy settings of the source video on vimeo are blocking the link from being ripped from a site like that :sad:
Author:  Dent [ Sun May 20, 2018 8:14 pm ]
Post subject:  Re:
The reason you will find it hard to find exact info or a guide is that this kind of information is not "good" to share. Why? Well not all videos are "happy to be downloaded" and they might prevent you from doing it if you tell them how you do it ;) You know what I mean...

But a few hints.

kernelcrash wrote:
find the video tag src which is most likely an m3u8 playlist or .mp4.
if its m3u8 you can use ffmpeg to save it as mp4.


ffmpeg is a free program

https://ffmpeg.zeranoe.com/builds/

and it works like this

Code:
ffmpeg -i "THE SRC URL HERE" -c copy -bsf:a aac_adtstoasc "video.mp4"


kernelcrash wrote:
Each website is different so no single tool can be used to download all the videos.
Most of the sites are wordpress that use a plugin to protect the videos by checking if you are authenticated so its easy


You need a program like Fiddler 4 or some other snooping program to find the src url.


You will find that it is not a straight forward method and that a lot of testing is required.

:ympeace:
Author:  bjjvids [ Fri Dec 15, 2023 10:54 am ]
Post subject:  Re: How to batch download videos from paid sites like AOJ, Buchechaonline, etc?
5 or so years later, but for the record a program called yt-dlp can do batch downloads and it has very wide compatibility. See https://github.com/yt-dlp/yt-dlp

It's command line only. Easiest way is to run a linux vm (Ubuntu etc). Sample command to do a batch download would be: 'yt-dlp -a dl.txt'

dl.txt is a text file with one link per line. Name it whatever you want.

Lots of other instructions and options in the link above, but yt-dlp works on a very high percentage of sites.

If yt-dlp doesn't work, things get harder. Often as Dent has suggested the challenge can be finding the source URL. One app I've found useful for that is a chrome extension called 'Video DownloadHelper'.
Page 1 of 1 All times are UTC
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/