Karaoke-Version.com - Download script?

So.... after a bit of messing around. I did this on a Mac. Get the script above working first of all. then I found that if you download all your invoices (pdfs), which is quick way to get all your artist and song names. Open them all with word and copy and paste just the centre section of the pdf where your song name and artist is listed. I did about 700 songs in less than 10 minutes this way. Once they are all in excel you need to be creative with your renaming of certain letters and spaces etc within the names you have. use find and replace to do it. start by renanaming " : " with "/" all other punctuation marks such as ' ( ) ? can all be removed ' needs to be replaced with a - , and & needs to be replaced with the word and . finally rename all " " spaces with a "-". that's the hard bit done. now you need to add https://www.karaoke-version.com/custombackingtracks/ to the front of all the names you've created and .html to the end (CONCAT) is what you want to use in excel. Now use the LOWER command on your results to make all capitals lower case. This will give you all the correct formatted website addresses for your files. now add this to the front of the cells "nom run start "

Now all your lines will look like this

npm run start https://www.karaoke-version.com/custombackingtrack/solomon-burke/everybody-needs-somebody-to-love.html
npm run start https://www.karaoke-version.com/custombackingtrack/the-jackson-5/can-you-feel-it.html
npm run start https://www.karaoke-version.com/custombackingtrack/michael-jackson/one-day-in-your-life.html

etc etc etc

now comes the fun part -- you can now merge cells together with this in between each cell " ; " merge about 20 or 30 cells at a time and you will have a command like this

npm run start https://www.karaoke-version.com/custombackingtrack/solomon-burke/everybody-needs-somebody-to-love.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-jackson-5/can-you-feel-it.html ; npm run start https://www.karaoke-version.com/custombackingtrack/michael-jackson/one-day-in-your-life.html ; npm run start https://www.karaoke-version.com/custombackingtrack/madness/our-house.html ; npm run start https://www.karaoke-version.com/custombackingtrack/prince/betcha-by-golly-wow.html ; npm run start https://www.karaoke-version.com/custombackingtrack/joe-longthorne/wind-beneath-my-wings-live.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-temptations/i-wish-it-would-rain.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-stylistics/rockin--roll-baby.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-stylistics/you-make-me-feel-brand-new.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-stylistics/i-m-stone-in-love-with-you.html ; npm run start https://www.karaoke-version.com/custombackingtrack/george-mccrae/rock-your-baby.html ; npm run start https://www.karaoke-version.com/custombackingtrack/kool-and-the-gang/get-down-on-it.html ; npm run start https://www.karaoke-version.com/custombackingtrack/ub40/kingston-town.html ; npm run start https://www.karaoke-version.com/custombackingtrack/david-guetta/when-love-takes-over.html ; npm run start https://www.karaoke-version.com/custombackingtrack/michael-bolton/sittin--on-the-dock-of-the-bay.html ; npm run start https://www.karaoke-version.com/custombackingtrack/vigon-bamy-jay/sittin--on-the-dock-of-the-bay.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-commodores/easy.html ; npm run start https://www.karaoke-version.com/custombackingtrack/lionel-richie/hello.html ; npm run start https://www.karaoke-version.com/custombackingtrack/lionel-richie/endless-love-with-shania-twain.html ; npm run start https://www.karaoke-version.com/custombackingtrack/lionel-richie/stuck-on-you.html ; npm run start https://www.karaoke-version.com/custombackingtrack/lionel-richie/running-with-the-night.html ; npm run start https://www.karaoke-version.com/custombackingtrack/spiller/groovejet-if-this-ain-t-love.html ; npm run start https://www.karaoke-version.com/custombackingtrack/gala/freed-from-desire.html ; npm run start https://www.karaoke-version.com/custombackingtrack/ace-of-base/beautiful-life.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-cure/friday-i-m-in-love.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-cure/lovesong.html ; npm run start https://www.karaoke-version.com/custombackingtrack/daniel-boaventura/a-little-respect.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-temptations/girl-why-you-wanna-make-me-blue.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-commitments/the-dark-end-of-the-street.html ; npm run start https://www.karaoke-version.com/custombackingtrack/the-manhattans/hurt.html ; npm run start https://www.karaoke-version.com/custombackingtrack/dionne-warwick/there-s-always-something-there-to-remind-me.html ; npm run start https://www.karaoke-version.com/custombackingtrack/jeff-wayne/forever-autumn-highlights-version.html ; npm run start https://www.karaoke-version.com/custombackingtrack/seal/a-change-is-gonna-come.html ; npm run start https://www.karaoke-version.com/custombackingtrack/sam-cooke/a-change-is-gonna-come.html ; npm run start https://www.karaoke-version.com/custombackingtrack/celine-dion/beauty-and-the-beast.html ; npm run start https://www.karaoke-version.com/custombackingtrack/motown-the-musical/where-did-our-love-go-stop!-in-the-name-of-love.html

copy and paste this into terminal, hit return and leave your Mac to run in the background or at night etc and it will now download all of those multi track files automatically for you one after the other!!!!!

If you do some reading up on excel and how to expand cells so that once you do one cell you can drag it to all others etc, it will work quickly for you. Between working out how to do it and the formatting, I now have about 25 terminal commands to copy and paste into terminal to get ALL of my multitracks.

You could probably do more than 20 or 30 at a time, but why tempt fate lol

Lets see how it goes

Dave

The interest here is really nice to see, but I would suggestion caution when using this script to download huge batches of songs, especially in parallel. As stated in the README, this may well be against their terms of use, and I'd hate to see anyone's account get banned for using such automation. Doing so in huge batches will make it trivial for your account to be flagged as a bot, for instance. Especially multiple operations in parallel.

To answer some of the questions in this thread:

• the mouse grabbing / focus steeling behavior is not something you can get around. A single misclick can interrupt the scripts defined behavior, so it is recommended to just leave it alone for a few minutes to finish
• It would be fantastic if KV provided a true API for building such downloaders in a much nicer way, but since they don't, we rely on manual parsing and poking at a Chromium web driver. This is clunky, error prone, and difficult to extend with more options.
• Changing the download path, however, might be as easy as setting the PUPPETEER_DOWNLOAD_PATH environment variable to a folder of your choosing. I haven't tried this. I may add this to the script as a documented option.

Also great catch on the co.uk issue! I can fix that one.

Just an update on the above. KV have added a new "help FAQ" section in. Looks like they are listening to what's being said or done. They have now stated on their page that to download individual tracks, you can modify and do this as often as you like. I think they know people are using the script to download the tracks automatically.

https://www.karaoke-version.com/help/custombackingtrack_262.html

FredAnderson Great video Fred. Thanks so much for this. And Ben of course for the wonderful script

FredAnderson

Hi I cleaned the script a bit (much) now it returns all the links correctly.
to run it you need to install with pip

pip install -U beautifulsoup4

and need to create a file called config.toml in the current directory like

frm_login="mylogin"
frm_password="mypassword"

#!/usr/bin/env python3

from urllib.parse import urljoin
import logging
import os
import requests
import sys
import tomllib
from pprint import pprint, pformat

from bs4 import BeautifulSoup


# configure logging
logger = logging.getLogger(os.path.basename(__file__))
logging.basicConfig(level=logging.INFO)

# global variables
CONFIG_FILE = os.path.join(os.getcwd(), "config.toml")
DOMAIN_URL = "https://www.karaoke-version.com"
LOGIN_URL = f"{DOMAIN_URL}/my/login.html"
TARGET_PREFIX = "/custombackingtrack/"


def get_download_page_url(base_url, page):
    download_url = f"{base_url}/my/download.html?page={page:d}"
    return download_url

def get_number_of_pages(session, domain_url):
    # Use a trick if we put a huge number of pages we get the latest page
    logger.debug("Opening download page %d", 999)
    url = get_download_page_url(domain_url, 999)

    response = session.get(url)
    soup = BeautifulSoup(response.content, "html.parser")

    # Get all elements with the class 'mr-1'
    pagination_elements = soup.select("a.mr-1")

    last_page_number = 1

    # Check if there are pagination elements
    if pagination_elements:
        # Get the last element's href attribute
        last_page_link = pagination_elements[-1]["href"]
        # Extract the page number from the href
        last_page_number = int(last_page_link.split("page=")[-1])

    return last_page_number

def get_song_urls(session, domain_url, total_pages):
    all_song_urls = set() # Using a set to automatically handle duplicates

    for page_number in range(1, total_pages + 1):
        url = get_download_page_url(domain_url, page_number)
        response = session.get(url)
        soup = BeautifulSoup(response.content, "html.parser")

        # Find all <a> elements within <td class="my-downloaded-files__song">
        song_elements = soup.select("td.my-downloaded-files__song a")

        # Extract the href attributes from the <a> elements and construct full URLs
        song_urls = [urljoin(domain_url, element["href"]) for element in song_elements]
        all_song_urls.update(song_urls) # Update the set with new URLs

    # Sort the collected URLs
    sorted_song_urls = sorted(all_song_urls)

    return sorted_song_urls


def run_main():
    logger.info("Load config from %s", CONFIG_FILE)
    with open(CONFIG_FILE, "rb") as f:
        my_config = tomllib.load(f)

    with requests.Session() as session:
        # Login
        logger.info("Open loging page %s", LOGIN_URL)
        post = session.post(LOGIN_URL, data=my_config)

        # Check if login was successful
        assert post.status_code == 200

        logger.info("Login successful. Getting number of pages")

        total_pages = get_number_of_pages(session, DOMAIN_URL)
        logger.info("Total number of page is %d", total_pages)

        sorted_urls = get_song_urls(session, DOMAIN_URL, total_pages)

        logger.info("Sorted Song URLs:")
        for url in sorted_urls:
            print(url)


if __name__ == "__main__":
    logger.debug("run main")
    sys.exit(run_main())

now it return an ordered list of all the correct links