Learn to generate an AI music video by creating a base image with GPT-4o, animating it with Hedra, extracting and syncing audio with Adobe Audition and Demucs, and assembling the final video in Kapwing.
with Claire Vo
OpenAI's multimodal model
Use an image generation model like GPT-4o to create the central visual for your video. Tweak the prompt until you achieve the desired aesthetic. For example, the author started with a prompt for a musician with a guitar but later removed it for an acapella feel.
generate an image of Kurt Cobain playing a Tiny Desk concertTake the static image generated in the previous step and upload it to Hedra. This tool will animate the photo and allow you to add a custom audio track with synchronized lip movements.
Obtain the audio track for your video. You can use a tool like 4K Video Downloader to extract audio from an existing video (e.g., a YouTube concert). Then, use a program like Adobe Audition to edit and isolate the specific audio segment you need.
If you want to create an acapella version of your song, use a tool like Demucs to separate the vocal track from the instrumental track. This can create a more intimate and focused feel for the video.
demucs two-stems vocals /path/to/audio.mp3Import your animated clip from Hedra into a video editor like Kapwing. You can also generate additional B-roll clips using a video generation model like Veo 3 to add variety and match the overall aesthetic (e.g., '90s grunge'). Combine all clips and the final audio track to produce your music video.
Follow Sahil Lavingia's method for delegating small but impactful maintenance tasks, like fixing an internal Slack report, to the AI agent Devin. This workflow shows how to use simple, clear prompts to fix code and update system prompts without distracting your engineering team.
Learn Gumroad CEO Sahil Lavingia's process for rapidly prototyping a UI with v0, then using the AI agent Devin to autonomously code, implement, and submit the feature for review, turning a multi-day task into a one-hour workflow.
Improve your writing in real-time by using ChatGPT as a first reader. Get instant feedback on structure, clarity, and flow as you write, allowing you to polish your work section by section.
We've made ChatPRD affordable so everyone from engineers to founders to Chief Product Officers can benefit from an AI PM.