Spirtual Voice Chat with a ChatGPT-driven Monk

Chat with a ChatGPT-driven monk with your voice. Brother Geppetto is here with you, at a lovely pond at sunset, to listen to you and give you wise advice.

You can play this game either with a normal PC on the monitor or in Virtual Reality with SteamVR.

To enable chat functionality, create a free account with OpenAI and input your API key into the provided config file. A complimentary OpenAI account offers over a million free words of speech recognition and response production.

For speech-to-text, you can choose from several options: witai, OpenAIWhisper, Azure or Deepgram.

For the NPC's "brain" you can choose OpenAI's ChatGPT (either the GPT-3.5-turbo or GPT-4-turbo version), or use another provider like TogetherAI, OpenRouter, Mistral, or Groq to connect to a model like Google Gemini, Anthropic's Claude, Meta's Llama 3, Mistral's Mixtral and many more.

For text-to-speech, you can choose witai, OpenAI, Azure, Deepgram or ElevenLabs. The app communicates only with the service providers like OpenAI or ElevenLabs for speech understanding/generation via your accounts. It doesn't send any info to me or anyone else.

Supported languages: English, Spanish, Portuguese, German, Polish, French, Italian, Hindi or Swedish (depending on the speech-to-text and text-to-speech provider chosen).

I would like to improve this experience. Please send me your feedback to tamulur@yahoo.com! Enjoy your chat!

Changelog 0.1.13:

Added Mistral, OpenRouter and Groq as possible Chat AI providers. This allows you access to all kinds of models, for example Anthropic's newest Claude models or Google Gemini models or Meta's Llama 3. Added support for Deepgram speech-to-text and text-to-speech.