@chuanenlin
This is so cool! 🔊 Turning visuals into sound effects sounds like magic. 🪄 How does the system handle different types of visuals? Can it capture both simple scenes and more complex, dynamic ones? Excited to explore the auditory side of images! 🎨🎶
Report
Congratulations Team Soundify on your innovative launch on ProductHunt!
Report
This has a lot of potential. I would like it to generate background music for my drone films. I tried with uploading a drone image, and it generated audio clips like 'wind whistling through the trees' which would be good but the audio has a lot of static and noise. The audio clips it generated are not unsuable. But the direction is great, would like to use an improved version.
Hi guys,
Here is a simple web application for generating immersive sound effects based on visuals!
In a nutshell, the system first tries to capture a detailed understanding of the visual scene. Then, the system asks a language model (like ChatGPT) to brainstorm plausible sound descriptions. Finally, the system generates the audio files from sound descriptions.
If interested, feel free to read our short research paper: https://arxiv.org/pdf/2311.05609.... In addition, this work was built on top of a previous full research paper: https://arxiv.org/pdf/2112.09726....
Thanks and enjoy!
WeirdSpot.fyi by humit