This program uses python3 and multiple libraries to create a slideshow of a given audio file (.mp3) and its transcript, in which the images are displayed in time with the words being said. Works best with audio without much background audio or music, but music videos can be created in this fashion with some success. The images displayed are taken from Google Images. There is no guarantee these pictures are liscense free, so please make sure of that if you are utilizing this for anything other than personal use.
Here is what the program would generate for the first ~3.5 minutes of the bee movie.
https://www.youtube.com/watch?v=GQyiiDuV-Ao
Because of all the moving parts, this program requires quite a few libraries and software.
Python libraries:
Misc:
- gentle (using docker installation for Windows)
- Genius API (You must create an API and get a Genius client access token if using that feature)
Once everything is installed it's time to create the slideshow! Create a folder in the same directory as the script, named whatever you want. Inside the folder, include your mp3 file named ("audio.mp3"). If you are using audio that doesn't have lyrics on genius.com, also include a transcript of the audio called "transcript.txt". Also make sure your docker teminal displays "listening on port 8765" before running the script if the audio hasn't been analyzed before.
If you already have the transcript, just run python create.py [folder_name], otherwise if you want to gather the lyrics from genius add the -s tag before the folder name. Then, you simply have to wait while your audio is analyzed and the program downloads the images, and then a video will be played for you via a pygame window. If you want to run the same video again, just rerun the program and it will recognize that all the work has already been done and instantly play.
NOTE FOR MAC USERS: It is possible to use this program on a Mac/Linux. Follow the directions on the lowerquality/gentle page for Mac/Linux and generate the json alignment ahead of time, then place that into your folder with your existing mp3 and transcript. This also works for Windows if you use the provided demo of the software on their website