Re: [glob2-devel] Speech Recognition & Glob2

[Stéphane Magnenat]

On Sunday 22 February 2009 03:57:03 Miller Peterson wrote:
> Hello,
>
> As a class project, I've decided to try to build a speech recognition
> interface for Globulation 2 - i.e. to make it possible to issue orders
> via voice commands. For the speech recognition engine, I'd like to use
> Sphinx-4, which is a Java-based recognizer. Accordingly, I need some
> form of interprocess communication so that Sphinx-4 can talk to Glob2.
> I was hoping to get some advice on how to solve this problem. I've
> read through the online documentation and started poking around in the
> source, but am sitll pretty new to Glob2.
>
> The simplest plan I've come up with is for the Java recognizer and
> Glob2 to talk via TCP/IP sockets (using SDL_net). I guess I would add
> functionality to GameGUI which would receive commands from the
> recognizer over a socket and translate those into Orders, which would
> get pushed to the NetGame in the same way as other orders. Does that
> sound like it could work?

This seems a reasonable way to do. Personnally I would prototype the interface 
outside glob2, in a trivial program that just use the interface via TCP/IP 
sockets, and then integrate it into glob2. One thing to take care that I see 
is that you would have to feed the raw data to the voice recogniser through 
TCP as well, because otherwise voice recognition would broke VOIP. So you'll 
have to decide whether you want to queue wave data in glob2 and then send it 
to Sphinx-4, or you want to stream data in real time.

Good luck, please keep us informed, it is a nice project.

Kind regards,

Steph

-- 
http://stephane.magnenat.net