Unlock Survey Insights with AI Comment Summaries

Unlock Survey Insights with AI Comment Summaries

Survey comments in the Results tab offer powerful insights about employee experience and employee sentiment. These qualitative insights can shape your HR programs and empower leaders and managers to understand, empathize, and act. Reviewing comments one by one can be time consuming, especially for large organizations. Keep reading to learn about how you can leverage WorkTango’s AI-driven comment analysis tool to accelerate your post-survey outcomes.

Review Survey Results

Once a survey is complete the status will transition to “Completed” and you can access results by clicking the “View Reports” button.

After clicking “View Reports”, scroll down to the Text Questions card in your results. Click the “See # Comments” button to see all comments in WorkTango.

Create an AI Comment Summary

Click the “Analyze” button to ask AI to interpret the results.

After a short loading period, the AI Comment Summary will appear. The summary has four components:

1. Overall summary of all employee comments
2. Summary of three most common themes from positive comments
3. Summary of three most common themes from negative comments
4. WorkTango’s recommended actions to improve employee experience and achieve more positive comments the next time this question is asked in a survey

Each user will see their own AI Comment Summary. To maintain privacy, these summaries are not shared with other users. Each user must create their own AI Comment Summary, which will capture the employees they have access to based on their visibility permissions. This is also true for filtered AI Comment Summaries. Even if another person has already created this you’ll need to create one for your own view.

Filter Comments by Employee Attributes for AI Comment Summary

The AI Comment Summary includes all comments by default. You may apply filters to the AI Comment Summary to refine the summary.

This will reset the page, allowing you to create a new comment summary.

The new AI Comment Summary is visible when your filters are applied, and it will stop displaying when you change filters. Any AI Comment Summary you created can be retrieved by applying your filters again (including the default version without filters).

Export AI Comment Summary

AI Comment Summaries are added to Summary Report (PowerPoint) export by default.

To export, first click the Export button and choose “Summary Report”.

The AI Comment Summary will appear as a slide in the Summary Report PowerPoint.

Delete an AI Comment Summary

Periodically, you may find that the AI Comment Summary and recommendations don’t align to your business goals. When this happens, you may want to delete the AI Comment Summary.

To achieve this, click the “Delete” button (trashcan icon) to remove the AI Comment Summary from your view.

The component will revert to its default state.

Once an AI comment Summary is deleted it cannot be restored. However, you may choose to create a new AI Comment Summary as needed. Note that At I tools produce slightly different verbiage when repeating tasks. For example a repeated AI Comment Summary may use different words for the same theme.

Disable AI in WorkTango Surveys & Insights

AI Comment Summaries can be disabled via Settings by users with Configuration access. This is a single setting to turn on/off all AI features. Simply navigate to your Company Settings and toggle Generative AI settings to “Off.”

This will hide all AI front end components and disable sending data to the AI. If you toggle it off, Sentiment Analysis, Sentiment Cloud, and AI Comment Summaries will all be hidden.

Toggling AI Comment Summaries to “Off” can be used to ensure the WorkTango platform meets compliance requirements for organizations with a “no AI” policy.

Frequently Asked Questions

Can I generate AI Comment Summaries for all WorkTango Surveys?

No. Surveys must meet three criteria to be eligible for AI Comment Summaries.

1. The survey is complete. You can only run AI Comment Summaries on completed surveys. Surveys still open / in progress will not work until the survey is closed.
2. The survey includes at least one text-based open response question. While all Survey types and templates support AI Comment Summaries, this feature requires at least one text-based open response question.
3. There are enough responses. The anonymity threshold applies. AI Comment Summaries can only be generated if it complies with your anonymity policies.

How are AI Comment Summaries different from Sentiment Analysis?

The Sentiment Analysis feature has also been updated to use generative AI models. Previously, it utilized Machine Learning. Read more about Sentiment Analysis.

What type of AI model is being used?

WorkTango uses Google’s Gemini, a Natural Language Processing (NLP) model.

Can AI features be turned off?

Yes. A user with the “Configuration” permission can disable AI Comment Summaries for your organization. Simply navigate to your Company Settings and toggle Generative AI settings to “Off.”

If you toggle it off, Sentiment Analysis, Sentiment Cloud, and AI Comment Summaries will all be hidden.

What languages do AI Comment Summaries support?

AI Comment Summaries are available in English, French, and Spanish.

What dataset are you using to generate AI Comment Summaries?

In order to generate AI Comment Summaries, WorkTango processes the open text question(s) and the associated responses and comments from employees.

Is WorkTango using my employee data or responses to train the AI model?

No, we are not training any model. We are using Google’s Gemini model to produce text summaries only.

What measures are in place to protect from cyberattacks and other security risks?

At the LLM model level, we use Google’s default security settings to block dangerous or malicious contents

At the prompt level, we use the following industry best practice to protect against injection:

• Parameterize input; the LLM will treat all comments just as comments
• Guard prompt; place at the end of the prompt to protect against prompt injection

We also have automated integration tests in app to measure and verify the effectiveness of AI Technology.

How does WorkTango ensure that AI services cater to transparency standards?

We mark artificially generated content as being produced by AI.

Do you use copyrighted training data in the development of your system?

No.

Which development choices and mitigation measures do you take to eliminate or reduce as far as possible the risk of AI-generated content being misused?

Our feature is an optional tool for platform users to generate summaries from large amounts of text comments, supplementing reading through the comments. Usage of the summaries is at the discretion of the user, should they find them useful. AI Comment Summaries are unique to each user and are not shared between users.

More Questions?

Do you have a question that wasn't covered in this article? Let us know! Email your question(s) to engagement@worktango.com.