The Application Analytics feature in the Tencent Cloud Agent Development Platform allows you to track application data, review conversation history, and optimize Q&A performance.
Data Analysis
In data analysis, you can view the number of messages exchanged after the application is published, the number of users who interacted with the application (note: duplicate users across different channels cannot currently be de-duplicated), and the number of likes on application responses, and the percentage of likes relative to all rated responses. It supports time-based filtering, filtering by invocation type, and exporting detailed statistics.
Note:
Data is not in real-time and has about a 10-minute delay.
Conversation History
The conversation history section lets you view conversations after the application is published. Supports exporting histories by time.
Click View to see the full conversation context, including knowledge bases, workflows, tools, and other related information. You can also apply corrections or submit feedback.
Note:
Currently, user-uploaded document content is not displayed in conversation history.
Intelligent Classification of Conversation History
Conversation histories can be automatically classified. You can select unclassified histories and run intelligent classification. These histories come from production environment interactions, including web experience links, WeChat Official Accounts (service/subscription), and WeCom (Enterprise WeChat).
By filtering unclassified histories (e.g., by time, invocation type), and clicking Intelligent Classification, the system will run a clustering algorithm to classify them.
After saving, the classified records will be organized into folders on the left, sorted in descending order by entry count. Newly added unclassified logs can be incrementally clustered, with duplicates merged against existing categories.
Dissatisfied Q&As
In the client interface, users can rate application responses. If a user marks a response as unsatisfactory by clicking Not Satisfied, the Q&A record is automatically uploaded to the Unsatisfactory Issues list for optimization. The Unsatisfactory Issues list supports: search, filtering, ignore in batch, and bulk export.
Viewing History
By clicking View history to open the full conversation context. This can be used as a reference for answer correction.
Answer Correction
Clicking Answer Correction in an unsatisfactory record to open the Q&A input window, where you can edit the relevant Q&A. See Q&A for details. Once added, the corrected Q&A will be stored in the knowledge base. After being released, the application will prioritize responses from this updated knowledge.
Refuse To Answer
Click Refuse to answer in an unsatisfactory record to mark the issue as a refusal case and add it to the Refusal Questions List. If a user asks a semantically similar question again, the application will reply with the default unknown response.
Ignore
Clicking Ignore in an unsatisfactory record to remove the item from the list.
Error types in unsatisfactory responses are set by user feedback. When a user clicks Send Feedback in the client interface, a feedback button appears. After choosing an error type, it will be displayed in the Unsatisfactory Issues list. (Alternatively, you can send an evaluation event via the conversation API.)
Refused Questions
Once refusal questions are added, the model will identify similar questions and reject them with the default unknown response. Such as: “I’m sorry, I don’t have an answer for this question right now. Please try asking something else.”
