AI & Advanced
Leverage AI to generate test cases, get insights, connect AI agents, and power advanced reports.
Overview
TestKase's AI features use large language models to accelerate your testing workflow. Test Case Generation and the AI Agent make real LLM calls to generate test cases from simple descriptions and answer questions about your project. The AI Insights reports, by contrast, use advanced analytics and heuristic scoring computed directly from your data. Together these capabilities help your team work smarter and ship higher-quality software.
AI in TestKase is designed to augment, not replace, your testing expertise. Every AI-generated output should be reviewed and validated by your team before being used in production testing.
Test case generation
Generate full test cases with steps from descriptions
AI Agent
Built-in conversational AI for test management
11 AI reports
Advanced analytics for flaky tests, risk, quality & more — no credits used
Monthly credits
Plan-granted credits reset monthly; generation & chat are token-based
Org-level control
Enable or disable AI for your entire organization
Private & secure
Data encrypted in transit, not used for AI training
AI Credits
AI features that call a language model (Test Case Generation and the AI Agent) are powered by a credit system. Credits are consumed based on the number of tokens each request uses. Credits belong to the organization and are shared across all its users.
How Credits Work
- Shared balance — Credits belong to the organization, not individual users. All members share the same pool.
- Monthly plan grant — Your credit balance is granted by your plan (subscription tier × number of seats). It is overwritten on the 1st of every month with a fresh allocation.
- Not carried over — Unused credits do not roll over into the next month, and the balance is not top-up purchasable — it is reset to the plan allocation each month.
- Token-based consumption — Generation and AI Agent messages are charged by the actual number of tokens used, not a flat per-request fee.
- Visible balance — The current credit balance is shown in Organization Settings → AI Features and in the AI credit indicator in the navigation bar.
What Consumes Credits
| AI Feature | Credit Cost | Notes |
|---|---|---|
| Test Case Generation | Token-based | Scales with description length and the size of the generated output |
| AI Agent message | Token-based | Scales with the size of your prompt, project context, and the model's response |
| AI Insights reports (Tier 3) | None | Computed from your data with SQL analytics — they do not consume credits |
| AI Score badges | None | Flakiness and Duplicate scores do not consume credits |
Your monthly credit allocation is determined by your subscription plan and seat count. Because the balance is refreshed on the 1st of each month, plan seats up front for the AI usage your team expects rather than relying on carry-over.
Enable AI for Your Org
AI features must be explicitly enabled at the organization level before they become available to any user. This gives organization administrators full control over AI usage and credit consumption.
- Log in as an Organization Owner or Admin.
- Navigate to Organization Settings → AI Features.
- Toggle the Enable AI switch to On.
- AI features are immediately available to all users in the organization across all projects.
What Happens When AI Is Enabled
- The AI Generate button appears on the Test Cases page.
- The AI Agent icon appears in the project navigation.
- The AI Insights category appears in the Reports tab.
- AI Score badges (Flakiness Score and Duplicate Score) appear on every test case detail view.
- A credit balance indicator appears in the navigation bar.
What Happens When AI Is Disabled
- All AI-related UI elements are hidden across all projects.
- No credits are consumed (features cannot be triggered).
- Previously generated AI content (test cases, chat history) is preserved.
- AI reports that were already generated remain viewable.
You can enable and disable AI at any time without losing any data. Use this toggle to control costs during periods when AI is not needed.
AI Score Badges
Every test case detail view shows two AI-computed score badges — Flakiness Score and Duplicate Score — directly in the tab bar. These give you at-a-glance quality signals without running a full report.
- Flakiness Score measures how often a test case flips between pass and fail across executions. High scores indicate unreliable tests that need attention.
- Duplicate Score measures how similar a test case is to others in your project. High scores suggest redundancy in your suite.
Hover over either badge to see a detailed breakdown. Badges are color-coded (green/blue = healthy, yellow = review, red = action needed) and do not consume AI credits.
See Test Cases → AI Score Badges for full details on score ranges and color thresholds.
Next Steps
- AI Test Case Generation -- Generate comprehensive test cases from natural language descriptions.
- AI Agent -- Built-in conversational AI sidebar for creating test cases, querying data, and managing tests through natural language.
- AI Reports -- Advanced analytics including flaky tests, risk heatmaps, and predictive failure.
- MCP Server -- Connect AI agents like Claude, Copilot, and Cursor to TestKase.
- Credits & Billing -- Understand the monthly credit grant, monitor usage, and data privacy.
- Best Practices & FAQ -- Guidelines for effective AI usage and common questions.