Overview
GladeCore is a comprehensive system for integrating advanced, AI-driven NPC interactions into an Unreal Engine or Unity project. It allows players to engage in dynamic, unscripted conversations with non-player characters using either text or voice. NPCs use local inference to respond in real-time, with their personalities, knowledge, and even their voices defined by easy-to-use data assets that are set up to be designed and configured in the engine. The plugin’s core features include:- LLM-Powered Dialogue: Utilizes local LLM inference to generate dynamic NPC responses
- Speech-to-Text (STT): Allows the player to use their microphone to speak to NPCs
- Text-to-Speech (TTS): Enables NPCs to audibly speak their generated responses using either Piper local TTS or ElevenLabs cloud API
- Data-Driven Personalities: NPC personas, backstories, and voice settings are configured through Data Assets, allowing for easy customization without changing code
- Retrieval Augmented Generation (Pro Subscribers Only): Store and retrieve knowledge to keep responses accurate, consistent, and grounded.
- Custom Model Fine-Tuning (Pro Subscribers Only): Finetune and integrate your own custom models of different sizes, emotions, and training data for even more personalization.
- Multiplayer Support: The architecture is built with networking in mind, using client-server RPCs to handle communication but is not implemented out of the box