Using FMOD audio with Twine

Authoring Twine
, , ,
1

Is it possible to integrate FMOD with chapbook or Twine2? If not, is there an IF or game engine that can incorporate interactive text with the full audio capabilities of Wwise or FMOD?

1 Like
2

Twine is a web page. There’s a document on using FMOD for a web application (https://www.fmod.com/docs/2.03/api/platforms-html5.html) but it looks cantankerous at best. Many limitations compared to “real” FMOD.

I think your best bet is to pick a game engine that you’re familiar with that supports the audio capacities you need (Unity, Unreal, Godot). Then look around for ways to do interactive text in that engine.

1 Like
3

As I understand it, both of theses products consist of two main parts:

  1. The application used to create & edit audio tracks / files, which can then be played by frameworks & applications that support playing audio files.
  2. APIs / addons that can be used by a software project to play the audio tracks / files, instead of using the existing audio playing functionality included in the environment / framework being used to develop the project.

Which of these two different sets of functionality are you wanting to integrate into your Twine / Chapbook based project?

1 Like
4

Definitely the second description. FMOD is rich with nearly endless ways to manipulate audio (music) tracks such as cross fading, dynamic builds, looping, sequenced delayed jumps, effects processors, etc.

I could use existing gaming engines to control FMOD, but the text interface in most of them is clunky at best, and then there’s the fact that it would be locked into specific distribution platforms.

Someone mentioned Harlowe Audio Library or Kindle Create. I have yet to research their capabilities.

I believe what I’m after might be uncharted, or lightly traveled territory, which is exciting. I hesitate to mentioned the full reach of the concept until after I have a better grasp of the technical side of ebooks, game engines, and audio software.

Thank you sooooooo much for your replies and any help that can be offered.

5

There are a few nice demos on the FMOD site but no further implementation or specific tutorials, sadly. You can download the demos and look at the code though, they’re helpful if limited.
If you run into any good learning resources, let me know! Otherwise, there’s always WebAudio API libraries for things like loops and effects (which I’m going to start studying).

6

Thanks, Mercurio!

I’ll dig into the codes of the above mentioned sources and see what can be learned. It seems like interest in integrating higher quality audio capabilities into this rapidly developing arena is increasing. Totally cool!

I’ll do my best to post anything I find or learn. I was just directed to explore Kotobee Author. If I uncover anything, l’ll follow up here.

1 Like