Overview
GladeCore is a comprehensive system for integrating advanced, AI-driven NPC interactions into an Unreal Engine project. It allows players to engage in dynamic, unscripted conversations with non-player characters using either text or voice. NPCs use local inference to respond in real-time, with their personalities, knowledge, and even their voices defined by easy-to-use data assets that are set up to be designed and configured in the engine. The plugin’s core features include:- LLM-Powered Dialogue: Utilizes local LLM inference to generate dynamic NPC responses.
- Speech-to-Text (STT): Allows the player to use their microphone to speak to NPCs.
- Text-to-Speech (TTS): Enables NPCs to audibly speak their generated responses using either ElevenLabs’ cloud API or a local Piper TTS model
- Data-Driven Personalities: NPC personas, backstories, and voice settings are configured through Data Assets, allowing for easy customization without changing code.
- Retrieval Augmented Generation (Pro Subscribers Only): Store and retrieve knowledge to keep responses accurate, consistent, and grounded.
- Custom Model Fine-Tuning (Pro Subscribers Only): Finetune and integrate your own custom models of different sizes, emotions, and training data for even more personalization.
- Multiplayer Support (Enterprise Only): The architecture is built with networking in mind, using client-server RPCs to handle communication but is not implemented out of the box. We offer custom support Enterprise clients to figure out multiplayer for their specific use case.