AI & Advanced
Leverage AI to generate test cases, get insights, connect AI agents, and power advanced reports.
Overview
TestKase's AI features use large language models and machine learning to accelerate your testing workflow. From generating comprehensive test cases from simple descriptions to providing intelligent testing insights and powering advanced analytics, AI capabilities help your team work smarter and ship higher-quality software.
AI in TestKase is designed to augment, not replace, your testing expertise. Every AI-generated output should be reviewed and validated by your team before being used in production testing.
Test case generation
Generate full test cases with steps from descriptions
AI Agent
Built-in conversational AI for test management
11 AI reports
ML-powered analytics for flaky tests, risk, quality & more
Credit-based
Pay-per-use model — only use credits when you need AI
Org-level control
Enable or disable AI for your entire organization
Private & secure
Data encrypted in transit, not used for AI training
AI Credits
AI features in TestKase are powered by a credit system. Each AI action consumes a certain number of credits based on the complexity and type of the request. Credits are shared across all users in your organization.
How Credits Work
- Shared balance — Credits belong to the organization, not individual users. All members share the same pool.
- Consumed on use — Credits are deducted each time an AI feature is invoked (generation, chat message, report run).
- No monthly reset — Credits do not expire or reset monthly. Unused credits carry over until used.
- Visible balance — The current credit balance is shown in Organization Settings → AI Features and in the AI credit indicator in the navigation bar.
Credit Costs by Feature
| AI Feature | Credit Cost | Notes |
|---|---|---|
| Test Case Generation | Variable | Depends on description length and number of test cases generated |
| AI Chat Message | 1 credit per message | Each user message in the chat consumes 1 credit |
| AI Report (Tier 3) | Variable | Depends on the specific report and dataset size |
New organizations may receive a starter credit balance depending on the subscription plan. Additional credits can be purchased at any time from the AI settings page.
Enable AI for Your Org
AI features must be explicitly enabled at the organization level before they become available to any user. This gives organization administrators full control over AI usage and credit consumption.
- Log in as an Organization Owner or Admin.
- Navigate to Organization Settings → AI Features.
- Toggle the Enable AI switch to On.
- AI features are immediately available to all users in the organization across all projects.
What Happens When AI Is Enabled
- The AI Generate button appears on the Test Cases page.
- The AI Agent icon appears in the project navigation.
- The AI Insights category appears in the Reports tab.
- AI Score badges (Flakiness Score and Duplicate Score) appear on every test case detail view.
- A credit balance indicator appears in the navigation bar.
What Happens When AI Is Disabled
- All AI-related UI elements are hidden across all projects.
- No credits are consumed (features cannot be triggered).
- Previously generated AI content (test cases, chat history) is preserved.
- AI reports that were already generated remain viewable.
You can enable and disable AI at any time without losing any data. Use this toggle to control costs during periods when AI is not needed.
AI Score Badges
Every test case detail view shows two AI-computed score badges — Flakiness Score and Duplicate Score — directly in the tab bar. These give you at-a-glance quality signals without running a full report.
- Flakiness Score measures how often a test case flips between pass and fail across executions. High scores indicate unreliable tests that need attention.
- Duplicate Score measures how similar a test case is to others in your project. High scores suggest redundancy in your suite.
Hover over either badge to see a detailed breakdown. Badges are color-coded (green/blue = healthy, yellow = review, red = action needed) and do not consume AI credits.
See Test Cases → AI Score Badges for full details on score ranges and color thresholds.
Next Steps
- AI Test Case Generation -- Generate comprehensive test cases from natural language descriptions.
- AI Agent -- Built-in conversational AI sidebar for creating test cases, querying data, and managing tests through natural language.
- AI Reports -- ML-powered analytics including flaky tests, risk heatmaps, and predictive failure.
- MCP Server -- Connect AI agents like Claude, Copilot, and Cursor to TestKase.
- Credits & Billing -- Purchase credits, monitor usage, and understand data privacy.
- Best Practices & FAQ -- Guidelines for effective AI usage and common questions.
