List view
Quick Start
Quick Start
User Guide
User Guide
Policies & GuardRails
Policies & GuardRails
Witness Anywhere: Remote Device Security
Witness Anywhere: Remote Device Security
Witness Attack
Witness Attack
Administrator Guide
Administrator Guide
Conversations Console
Conversations display the AI interactions across your organization, providing visibility into the User prompts and AI responses generated when working with AI Apps.
Conversations enable auditing, reviewing conversations, identifying risky or harmful activity, and help ensure compliance with organizational policies as well as government regulations.
WitnessAI supports multi-language interactions internally so your Policies and GuardRails can evaluate your AI data and protect your AI services as intended. Non-English text is not currently displayed as English in the Console.
Step-by-Step Instructions
Filtering Conversations
Access the Conversations page from the left-sidebar menu.
You will see a list of recent conversations between Users and AI Applications.
As explained in the Console & Settings section, use the Date Range picker to choose your preferred date range, and the Group drop-down to choose a Group of Users to review. The other top-level filters can be used to narrow your search.
Conversations can be filtered and sorted by the named columns, when the current view is displaying only a single page, 250 rows by default. If you have multiple pages displayed, use the top-level filters to reduce your results to a single page
Clicking on the text of any named column will display a pointer indicating an Ascending or Descending sort, as shown for the “Latest Intention” column in the image above. Repeated clicking will cycle through Ascending and Descending sorted data. Clicking the down-arrow alongside the column name will display a filter for that field.
Viewing File Attachments in Conversations
Enter “upload” in the “Search Conversations” field, and click the “Apply” button. Conversations that include files will display. Clicking on a row will display the slide-out with full details.
The Conversation Details slide-out sidebar displays information on files processed. Text files less than 100MB are supported. Larger files and files containing malware are blocked.
Files contained in AI App responses are not scanned or blocked, allowing users to save them as needed.
Reviewing Conversations
Consider a scenario: You are a team manager, and you want to review how your team uses AI. Pick a Date Range and a Group, then have a look at a few Conversations.
Click on a row to view the details. The slide-out panel will display the full conversation.
The slide-out panel display
- Initial Prompt, Latest Intention, User Group, User Email, AI Application, Number of Prompts, Number of Alerts, and Date & Time.
- Step through every user prompt and AI response in the Conversation. Use the left and right arrows to navigate between prompts, or click to jump to the beginning or end of the conversation at any time. The scroll bar on the right side moves automatically as you page through prompts.
- View the complete Prompt submitted by User, with the timestamp and intention.
- View the complete Response from the AI App.
Viewing Alerts in Conversations
Click on a Conversation Row displaying text in the “Risk Type” column.
- Alert Indicators: Alerts are now more prominently displayed and viewable within the slide-out panel when you click on a conversation row. Including the topic, subtopic, policy, and prompt. Click "Show Details" to expand the alert information, or "Hide Details" to collapse it.
- Sensitive Data Redaction Display: Redacted content is clearly marked in the prompt. If you have the appropriate role, you can click on the redactions to see the original text. Use the “Sensitive Content” slider to show or hide sensitive content.
- Guardrail Actions: View the actions that occurred on the right side, including whether content was redacted, if a warning was shown to the user, and if the prompt was blocked or allowed to be sent to the LLM.
- Navigate to Alerts Console: Clicking "View Alert" navigates to the Alerts console, where you can see full details of the specific alert including all Guardrail actions triggered, the policy and its version, and which guardrails were triggered.
Viewing Alerts Details
- Click on the eye icon to mask or unmask sensitive data
- View classification, source and destination, prompt ID, and conversation ID
- Click on "Matches" to expand details showing specifically what was matched to the guardrail
- Add labels to alerts as desired. Up to three existing and custom labels can be included in any alert.
- Scroll down to see more details