The internet is large, but not unlimited. To train the next generation of AI, we need to move beyond basic text scraping. To this, we propose PodTextify, the first and only dataset of podcasts.

Installation:

1. clone the repo

2. install whisper.cpp with OpenVino

3. install the requirements

   pip3 -r requirements.txt

Usage:

main.py --name='(name of podcast, or 'random' for random)' --number=(number of episodes to download) "

Description

PodTextify is the worlds first podcast-to-database program. The world is running out of high accuracy, human-written text to train LLM models on. With PodTextify, you can pass in a podcast name and download an arbitrary amount of episodes from a scraped iTunes listing directory. From these downloads, the program converts them to text files, cleans and grammar checks them, and outputs them into a model dataset parquet file.