ChatGPT Therapy Voice Chat
A downloadable game
Chat with a ChatGPT-driven therapist with your voice. Engage in therapeutic conversations with Elizabeth, a cutting-edge virtual therapist. Set in a calming therapy room, share your concerns and anxieties with Elizabeth while a large wall screen displays a soothing YouTube video of your choosing.
Harnessing the power of ChatGPT, the world's most sophisticated artificial intelligence, Elizabeth draws from an extensive database of therapy sessions, including those conducted by renowned therapists. Her voice, brought to life by ElevenLabs, boasts the highest-quality generated speech currently available.
You can play this game either with a normal PC on the monitor or in Virtual Reality with SteamVR.
To enable chat functionality, create an account at one of the AI providers listed below, get an API key and enter it in the config file.
As AI provider you can choose between OpenAI, TogetherAI, OpenRouter, Mistral, or Groq. Depending on the provider you can then choose to connect to a model like OpenAI's GPT-4o, Google's Gemini Pro, Anthropic's Claude Sonnet, Meta's Llama 3, Mistral's Mixtral and many more. Alternatively you can connect to a locally running LLM, e.g. one run in LMStudio.
For speech-to-text, you can choose from several options: Local, Witai, OpenAIWhisper, Azure or Deepgram.
For text-to-speech, you can choose Witai, OpenAI, Azure, Deepgram, Cartesia or ElevenLabs.
Supported languages: English, Spanish, Portuguese, German, Polish, French, Italian, Hindi, Russian and Swedish (depending on the speech-to-text and text-to-speech provider chosen).
The app communicates only with the service providers like OpenAI or ElevenLabs for speech understanding/generation via your accounts. It doesn't send any info to me or anyone else.
I would like to improve this experience. Please send me your feedback to tamulur@yahoo.com!
Enjoy your therapy!
New in Release 0.1.27:
- added local speech-to-text
- added Cartesia as text-to-speech
- added option to use a local LLM
Download
Comments
Log in with itch.io to leave a comment.
Yo why do i keep getting "waiting for manager" and y I only see those words is because im stuck and cant turn right to see the full sentence?
Please send me the application's log file so I can find out what the problem is. To find it, press Win+R to open the Run dialogue box, then paste in:
%localappdata%\..\LocalLow\Tamulur\ChatGPT_NPC_Experiment_3_Therapist
and press Enter. This will open an Explorer window. The log file is "Player.log". Please send me this file in an email tamulur at yahoo dot com.
U dont use gmail?
Love your work! I encountered no difficulties in trying this out. I was curious if there is a way to modify the "role" prompt to change the manner in which the therapists responses are worded. It would be interesting to trial slang and different types of responses with the text-to-speech functionality.
Thanks!
I did have the possibility to modify the prompts in the earlier versions, but for various reasons I decided to take it out.
hey tamulur, love your work man! Is it working with GPT-4o mini ?
Sure, just set "gptModel" in config.json to "gpt-4o-mini" and select OpenAI as chat provider in the ingame menu.
Hello there!
I can't get the Mistral API to work, I bought some credits and made an API key, pasted the API key in config.json but I keep getting either the error
"CHAT AI ERROR: 'HTTP/1.1 401 UNAUTHORIZED
or
CHAT AI ERROR: 'HTTP/1.1 42 Unprocessable Entity
screenshots: https://imgur.com/a/ekarCGx
Tried to delete and create a new API key (and pasting it of course in config.json), tried changing MistralModel (tried open-mistral-nemo-2407, mistral-medium-latest,
open-mistral-7b)Thanks for listening!
Ah, thanks for the report. It seems the French are a bit fussy about which fields they accept in their API. I'll change that in the next version.
does the text to speech have to be ai? or can i use the windows tts
Local Windows TTS is not supported. It's bad quality, why would you even want it?
is it possible to change the openai.base_url (to a local server for example)?
Not in the current version, but I'm planning to support it in a future update.
I set up open AI bought some credits, and I put the key in the readme location. When I go to launch it it says I have entered an Azure key and need to enter an azure region. I did not enter an azure key. I can't do anything now.
You probably entered the OpenAI key in the wrong field, as the Azure key, or the Azure key field got modified by error and contains some non-empty value. Check the line that starts with "azureSpeechAPIKey". Set it to :
"azureSpeechAPIKey": "",
and then enter your open AI key in the line that starts with "openAiAPIKey".
If you did that and it still doesn't work, let me know.it keeps saying i dont have enough credits even though i just created my openai account a few days ago and its supposed to give me free credits for a month it said.
Can you visit OpenAI's playground at https://platform.openai.com/settings/organization/billing/overview and see what is says?
it said I have none… how do I get credits?
I no longer have a free account so I don't know how the page looks for you, for me there is a button to add credits. I don't know why they didn't add the $5 to your account when you opened it, maybe they changed something or it's a bug.
Should I ask support about it?
Yes, if they answer please let us know, maybe others have the same problem.
hi.
someone can tell me how to have the AI, step by step please .
hello ?
The steps are in the Readme file. What is unclear?
This is the best coded and looking AI chat GPT API "game".... weird question but how can i change her from a therapist to a girlfriend lol?
Thanks!
Wazup i just killed my dog in minecraft... im crying :(
Hey is there any way to specify use of the GPT4 API? That'd really be great
Yes, in config.json in the line where it says
"gptModel": "gpt-3.5-turbo",
just replace "gpt-3.5-turbo" with "gpt-4".
Your OpenAI account needs to have access to GPT-4 of course.
Thank alot man
Hi, right now it's not possible, but I plan to add that option in one of the future updates.
thanks, i'll be waiting to finally be able to play the game.
Hey, great work! I am very excited to try this, but I'm getting this error that is not letting me talk to the AI:
Log: 11978 state: Inactive. Player is pressing record button but cannot start recording because ScenarioManager.IsRecordingLocked is False
Hey, can you press on the button "Show Console" in the menu, then scroll all the way up to the first error, click on it to show the details at the bottom, then click on the details at the bottom and copy them and tell me what they are?
Error: Error: HTTP/1.1 429 Too Many Requests
UnityEngine.Debug:LogError(Object)
TamulurAI.DialogueManager:OnChatGPTFinished(Int32, String, String)
TamulurAI.<>c__DisplayClass107_0:<SendFullPrompt>b__2(String, String)
OpenAI.<DispatchRequest>d__8`1:MoveNext()
UnityEngine.UnitySynchronizationContext:Exec()
Thanks!
If this error comes up in multiple starts of the app, this might mean that your free credits at OpenAI have expired. They expire after three months. Is your OpenAI account maybe older than that?
Hi, Unfortunately, the application does not work, I downloaded it, it starts but exits unfortunately. Can you help me, thank you very much. Another question will be the addition of additional languages, it would be great, thank you very much
Can you send me the full log file to tamulur at yahoo dot com? It's at c:\Users\<Username>\AppData\LocalLow\Tamulur\ChatGPT_NPC_Experiment_3_Therapist\Player.log, where <Username> is your user name on the computer (without the angle brackets). This will help me find the issue, maybe others have the same problem.
Listen to a Brazilian youtuber who managed to translate, you know how, I would like to try in my own language too
The new update has support for 8 languages.
Hello
is there a shortcut i can click for the AI to listen to what i say into the microphone?
and also when i try typing it doesn't say anything
The OpenAI model might be temporarily overloaded. Try again later. If it still doesn't work, maybe you've run out of free credits. Check on OpenAI Playground if your account can still interact with ChatGPT.
Ok it worked thank you very much
How do I let the psychologist speak in Portuguese?
Multi language is not yet implemented.
I cant make it to work. I added the Open Labs API key but the game keeps saying "State: Waiting for user input"
Are you keeping the middle mouse button pressed to record? If you click on the "Open Console" button at the bottom of the right menu panel and scroll through the messages, are there any error messages (with a red icon)?
I'm having the same problem
Hi and good day.
I was wondering what are you using for the lipsync animation?
Thank you and have a good one.
I use Salsa Lipsync.
Hi Tore, thanks for creating this game! I am sure it will be so helpful for many. Can I check if it works on Macs?
Sorry, it doesn't work on Mac for now.
Hi Tore,
Amazing work on this VR/AI simulation! My team from an Australian University would love to enquire about your work on this, however, our emails are bouncing back from your Yahoo account. Is there another way we can get in touch?
Thanks! Sam
Hi Sam, please email me at tore.knabe at gmail dot com.
Hi, thanks for sharing your incredible glimpse into the future of VR&Ai.
I have an HTTP/1.1 500 Internal server error saying: "The server had an error processing your request. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if you keep seeing this error." type: server_error.
It appeared after my input had successfully been transcribed with whisper and now the error message stays there even after restarting the application. Any suggestions?
Can you try using your account on the OpenAI playground: https://platform.openai.com/playground? Switch Mode to "Chat".
Do you get the same error?
This helped! Thank you very much! It's working very well and fast! Have you considered implementing the option of selecting the (output) language in the config.json? All the tools you are using are theoretically capable of so many languages. This would add a huge plus I'd think.
Yes, I'm planning to support multiple languages in the future.
This is amazing, I've been using it in VR for the last couple of hours and am absolutely blown away!
I have another error again but not the same thing just like before
but do I need to create a new account from OpenAI? or I just buy the paid thing?
btw I don't have Credit Card or PayPal.
The free tokens one gets with an OpenAI account expire after three months. If you register another free account, you get new free ones, but only if it's with a different phone number.
oh okay thanks again!
and then I clicked the game, and suddenly I got an error from organization ID from OpenAI.
I don't know why is this happened?!
It's saying there is no such organization, but the organization ID looks ok to me. If that's the same key as you get in https://platform.openai.com/account/org-settings, I don't know why OpenAI is complaining. Actually the organization ID is not really required by the API, it's just if someone has several organizations registered with OpenAI. In the next version, I will drop the organization ID requirement from the config. Until then, double check whether the ID shown on OpenAI's web page is really the same as in your config file.
Update: the new version is out; you don't need to enter the OpenAI organization ID anymore.
oh okay thanks a lot Tamulur!
I cannot get the mic to work, neither by middle mouse button nor by right trigger
All I get is: "chat gpt did not generate any text from this prompt"
I have the api keys set up correctly so I don't know what might be wrong
Can you download the new version 0.1.3 and try again?
it did work! thanks. had to create a new open ai account to get the free tokens tho. I like how there's an animation of her writing on the notepad to hide the time it takes for all the ais to process the request. I also changed elizabeth's voice to a custom one I had on 11.ai by messing with the config file.
Thanks for the info, good to hear!
hey every time i try to play it says invalid elevenlabs api key
but i check and it is correct?
Does your line format look like this (the key is different of course):
"elevenLabsAPIKey": "679gbf3fb18cd4fd22d6a28595b80277",
If yes, can you send me a screenshot of the error message to tamulur@yahoo.com?
Do you need a paid GPT subscription for this? It gives me an error about exceeding my quota on launch.
The free tokens you get when opening a free account expire after three months. Your account is probably older than that?
I'm not totally sure. I'll try with another account.
edit: Created a new account but it's the same. I tried using the API in a python script but it also says 'You exceeded your current quota'. Probably they linked those 2 accounts together.
I checked and I have $0 credit.
You probably used the same phone number. When you register another free account on that number, they show a popup saying that since that number was already used, you don't get more free tokens.
Yeah, that's what happened. It works fine with another phone number. Thanks.