AI Integration Toolkit (AIITK)

|| A.I.I.T.K. V2.5 + UE5.5 is LIVE ||

|| Assistants / Real-time / Lip-sync / Json+Http tools / and more! ||

More info on v2.5 here.

The AI Integration Toolkit offers an affordable, fully customizable solution to integrate various generative AI technologies, including all the latest OpenAI APIs, along with Elevenlabs TTS and Meshy 3D generation APIs into Unreal Engine. With accessible nodes exposed to Blueprints and clear examples, developers can efficiently incorporate AI to build interactive and captivating experiences in their projects.

Features:

• ChatGPT: Enhance storytelling and interactions with NPCs using advanced natural language processing.
• Dall-E: Generate images based on text prompts for customized visual content.
• Whisper: Implement speech recognition capabilities for more engaging and accessible gameplay.
• GPT Vision: Integrate visual recognition and processing.
• OpenAI TTS: Convert text to speech for realistic and immersive conversation.
• Elevenlabs TTS: Utilize high-quality text-to-speech functionalities for diverse vocal outputs.
• NEW! Assistants API: Create a personal assistant with a memory.
• NEW! Realtime API: Conversate with AI in realtime.
• NEW! Json+Http tools: Construct a json to send via Http to integrate any API you want.
• NEW! Websocket in Blueprints: Connect to any Websocket you want with ease.
• NEW! ElevenLabs Lip-sync: Automatically generate visemes from phoneme data.
• Meshy: Create 3D meshes dynamically for more detailed and interactive environments.
• Blueprint Integration: User-friendly Blueprint nodes simplify the integration process.
• Practical Examples: Clear examples to help get a jump start on your next project.
• Developer-Friendly: Suitable for developers of all skill levels to leverage generative AI technologies in game design.

V2 Demonstration:

https://youtu.be/4wl4-j9jsBo

Documentation:

https://knooblegooble.github.io/AIITKDocumentation/

“I believe that integrating these new tools directly into the front-end of the experiences we create expands the possibility spaces of game design tenfold. Generative AI utilization should not be focused on replacing what a human could do, but about engaging with video games in brand new ways.”

Visit Discord for more info

-Thanks!