Runtime AI Chatbot Integrator (ElevenLabs, OpenAI, DeepSeek, Claude) +TTS

ℹ️ Note: The images with text-to-speech examples were created using the Runtime Audio Importer plugin. So, to follow these examples, you will need to install that plugin as well. However, you can also implement your own audio handling solution without using it. For text-to-text functionality, the Runtime Audio Importer is not required.

🤖 Seamlessly integrate cutting-edge AI chatbots into your Unreal Engine projects!

Transform your games and applications with powerful AI conversation capabilities and natural-sounding speech using the most advanced language models available today. This plugin provides direct access to OpenAI’s GPT models, Anthropic’s Claude, DeepSeek’s advanced reasoning models, plus high-quality TTS from OpenAI and ElevenLabs – all through simple Blueprint nodes!

Quick links:

• 🎮 Packaged Demo Project (Windows)
• 📦 Demo source files (UE 5.5) (requires this plugin, along with Runtime Audio Importer plugin, to be installed)
• 📄 Documentation
• 🎥 YouTube video demonstration

✨ Key features:

• Multiple AI Providers: Connect to OpenAI, Claude, and DeepSeek through their official APIs
• Latest Models Supported: Access cutting-edge models including GPT-4o, Claude 3.7 Sonnet, and DeepSeek Reasoner
• Flexible Response Handling: Choose between complete responses or real-time streaming (chunk by chunk)
• Advanced Streaming TTS: Get audio chunks as they’re generated for OpenAI and ElevenLabs, enabling immediate playback while synthesis continues
• Blueprint Ready: Simple nodes for immediate integration without C++ coding
• Cross-Platform: Works on all platforms supported by Unreal Engine (Windows, Android, Meta Quest, Mac, iOS, Linux, and more)
• Easy Authentication: Simple API key management for all services

🔧 Supported models:

Text chat models:

OpenAI:

• GPT-3.5 Turbo
• GPT-4o
• GPT-4o Mini
• GPT-4-32k
• GPT-4 Turbo
• O1
• O1 Mini
• O3 Mini

Claude (Anthropic):

• Claude 3.7 Sonnet
• Claude 3.5 Sonnet
• Claude 3.5 Haiku
• Claude 3 Opus

DeepSeek:

• DeepSeek Chat
• DeepSeek Reasoner (with dedicated reasoning output)

Text-to-Speech voices:

OpenAI TTS:

• Alloy, Ash, Ballad, Coral, Echo
• Fable, Onyx, Nova, Sage, Shimmer, Verse

ElevenLabs TTS:

• Eleven Multilingual V2
• Eleven Monolingual V1
• Eleven Turbo V2
• Eleven Turbo V2.5
• Eleven Flash V2.5

💡 Perfect for:

• Interactive NPCs with intelligent conversations and voices
• In-game assistants and guides that speak naturally
• Creative content generation and narration on-the-fly
• Educational applications with AI tutoring and spoken instructions
• AI-driven gameplay mechanics with voice feedback
• Virtual companions with personality expressed through text and speech
• Voice-overs and dialogue generated dynamically

Note: API usage requires accounts with respective services (OpenAI, Anthropic, DeepSeek, ElevenLabs) and may involve usage costs from these providers.