Skip to main content

AI in an Agent

In the AI tab of an agent, you define which knowledge the AI Agent uses to answer questions. You can:

  • Connect Sources: websites, PDFs, Word and PowerPoint documents. See Sources.
  • Select Catalogs: curated article collections with maintained Q&A content. See Catalogs & Articles.
  • Connect Azure AI Search / SharePoint: if your knowledge already lives in a RAG index outside LoyJoy. See the Azure AI Search guide.
  • Connect MCP servers: up to three external knowledge sources via the Model Context Protocol.

The default implementation uses Retrieval Augmented Generation (RAG): for each user question, LoyJoy semantically searches for relevant chunks and passes them to the LLM as context.

How to enable AI in an agent​

  1. Open the agent and switch to the AI tab.
  2. Activate AI if not yet enabled: LoyJoy automatically inserts an AI Agent module into the process.
  3. Select sources or catalogs, optionally add a folder filter.
  4. Configure the AI Agent module (number of chunks, reranking, question splitter): see AI Agent module.

If your agent uses catalogs, you can enable Smart Search so that end users can search for catalog articles directly via the text input. Click the Search button in the AI tab to open the configuration dialog. There you can:

  • Enable or disable Smart Search.
  • Set the maximum number of search results and the allowed deviation between the search term and the text.
  • Choose whether a fallback button appears when no results are found.
  • Select the relevant catalogs and sources.

AI settings and tools​

The AI tab also gives you central settings and tools for the AI of your agent.

  • AI test automation: test your AI with a list of questions. You upload a CSV file with questions and receive the answers from your AI. See AI Test Automation.
  • AI quality check: analyze the quality of your AI messages and improve them with the help of AI. The AI analyzes frequent questions and answers and suggests improvements.

Below these settings you find the most recent AI messages of the agent. Further filter options and a CSV export are available in the Conversations area.