AI startup Stability AI has teamed up with chipmaker Arm to carry Stability’s Secure Audio Open, an AI mannequin that may generate audio together with sound results, to cell gadgets working Arm chips.
Whereas numerous AI-powered apps can generate audio, like Suno and Udio, most depend on cloud processing, that means that they’ll’t be used offline. Furthermore, some audio era fashions have been skilled on copyrighted content material — posing an IP danger. Stability claims Secure Audio Open’s coaching set is made up totally of royalty-free audio and songs.
Secure Audio Open working on Arm chips, which might be demoed on the Cell World Congress convention in Barcelona this week, can generate a sound from a textual content description like, “Light ocean waves at sundown.” Stability says that it labored with Arm to optimize and “distill” Secure Audio Open, rushing up era instances by 30x. Producing a single 11-second audio pattern takes round 8 seconds on an Armv9 CPU.
To be clear, the optimized Secure Audio Open mannequin isn’t obtainable to obtain — not less than not but. However in an announcement, Stability CEO Prem Akkaraju hinted that Stability will work to carry its fashions, together with Secure Audio Open, to shopper apps and gadgets sooner or later.
“As increasingly more skilled creatives and companies undertake generative AI to energy their manufacturing pipeline, it’s necessary that our fashions and workflows can be found in all places for builders to construct and creators to create,” Akkaraju stated. “We’re excited to accomplice with Arm for this precise purpose.”
Stability says it’s collaborating with Arm to additional optimize and fine-tune Secure Audio Open for cell.
Stability, the beleaguered agency behind the favored picture era mannequin Secure Diffusion, raised new money final 12 months as traders together with Eric Schmidt and Napster founder Sean Parker sought to show the enterprise round. Emad Mostaque, Stability’s co-founder and ex-CEO, reportedly mismanaged Stability into monetary spoil, main workers to resign, a partnership with Canva to fall via, and traders to develop involved concerning the firm’s prospects.
In the previous couple of months, Stability has employed a brand new CEO, appointed Titanic director James Cameron to its board of administrators, and launched a number of new picture era fashions.
