Hi guys,
Here is a simple web application for generating immersive sound effects based on visuals!
In a nutshell, the system first tries to capture a detailed understanding of the visual scene. Then, the system asks a language model (like ChatGPT) to brainstorm plausible sound descriptions. Finally, the system generates the audio files from sound descriptions.
If interested, feel free to read our short research paper: https://arxiv.org/pdf/2311.05609.... In addition, this work was built on top of a previous full research paper: https://arxiv.org/pdf/2112.09726....
Thanks and enjoy!
Report
will it work for creation short sounds for a video games development process? I mean, for example, sound of jumps, steps, punches, and other... By the way, it would be interesting, for example, to voice comics. Anyway, good luck guys!
Congratulations Team Soundify on your innovative launch on ProductHunt! Love the idea of generating immersive sounds from visuals - It breathes life into still images. As a suggestion, you might consider integrating a feature for users to mix and match sounds for creating their unique audio immersion. Looking forward to seeing how Soundify develops. All the best!
Report
Congratulations on the launch of Soundify! The ability to generate immersive sounds from an image is a creative and exciting concept that opens up a new realm of possibilities for artists, designers, gamers, and content creators.
Hi guys,
Here is a simple web application for generating immersive sound effects based on visuals!
In a nutshell, the system first tries to capture a detailed understanding of the visual scene. Then, the system asks a language model (like ChatGPT) to brainstorm plausible sound descriptions. Finally, the system generates the audio files from sound descriptions.
If interested, feel free to read our short research paper: https://arxiv.org/pdf/2311.05609.... In addition, this work was built on top of a previous full research paper: https://arxiv.org/pdf/2112.09726....
Thanks and enjoy!
Which Frame?
GhostCut
Crustdata