Best Practices & FAQ
Guidelines for effective AI usage and answers to common questions.
Best Practices
- Always review AI-generated content. AI output is a starting point, not a finished product. Review every generated test case for accuracy, completeness, and relevance to your specific application before saving.
- Write detailed descriptions for generation. The more specific your input, the better the output. Include feature details, user roles, edge cases, and expected behaviors in your description.
- Generate in iterations. Start with a broad description for general coverage, then run focused generations for specific areas (security testing, negative testing, accessibility). This produces more comprehensive test suites than a single generation.
- Use AI reports with sufficient data. AI reports require historical execution data to produce meaningful insights. Wait until you have completed at least 3-5 test cycles before relying on AI-powered analytics.
- Combine AI with human expertise. Use AI generation for routine and repetitive scenarios (form validation, CRUD operations), and write manual test cases for complex business logic, workflows, and domain-specific scenarios that require deep product knowledge.
- Monitor credit usage. Track how much of your monthly credit allocation the credit-consuming features (Test Case Generation and the AI Agent) use, and adjust usage patterns. Remember the balance resets on the 1st of each month and does not carry over. AI Insights reports do not consume credits, so you can run them freely.
- Use the AI Agent for exploration. The AI Agent is most valuable for brainstorming test scenarios, identifying coverage gaps, and getting testing strategy advice. Use it as a thinking partner rather than a test case factory.
- Keep AI features disabled when not needed. If your team is in a documentation or planning phase with no testing activity, disable AI to prevent accidental credit usage.
FAQ
▶Do AI features work offline?
No. AI features require an active internet connection as they use cloud-based AI models for processing. An active subscription with available credits is also required.
▶Are my test cases and project data sent to external AI services?
When you invoke an AI feature, relevant data (e.g., your description for generation, project metrics for reports) is sent to the AI model via encrypted connections. The data is processed in real-time and is not stored or used for training by the AI provider.
▶Can I control which users can use AI features?
AI features are controlled at the organization level via the Enable AI toggle. When enabled, all users can use AI features. Role-based restrictions on specific AI actions (e.g., restricting report generation to admins) can be configured through the permissions matrix.
▶What happens when I run out of credits?
When your credit balance reaches zero, the credit-consuming AI features — the AI Generate button and the AI Agent — show a "No credits available" message and stop until credits are available again. AI Insights reports and AI Score badges keep working because they do not consume credits. All other TestKase features continue to work normally. Your balance is replenished automatically on the 1st of the next month; to increase the monthly allocation before then, upgrade your subscription tier or add seats.
▶Can I generate test cases in different languages?
The AI generates test cases in the language of your input description. If you write the description in English, output is in English. You can write descriptions in other languages and the AI will attempt to generate test cases in that language, though English produces the best results.
▶How accurate are AI-generated test cases?
AI-generated test cases are generally high quality for common scenarios (form validation, CRUD, authentication flows). However, they should always be reviewed for domain-specific accuracy. The AI may not know your specific business rules, infrastructure constraints, or regulatory requirements.
▶Do AI credits carry over month to month?
No. Credits are a monthly grant based on your subscription (plan tier × seats). The balance is overwritten on the 1st of every month with a fresh allocation, so any unused credits from the previous month do not carry over. There is no separate credit-purchase flow — to change your monthly allocation, change your subscription tier or seat count.
▶Can I get a refund on unused credits?
Please refer to the TestKase billing and refund policy or contact support for information about credit refunds.
▶How are AI report results different from regular reports?
Regular reports (Tier 1 and 2) show what happened — counts, percentages, trends. AI Insights reports (Tier 3) apply advanced analytics and heuristic scoring on top of that data to rank risk, flag flaky tests, and highlight quality gaps. These are deterministic calculations computed from your execution history — not machine-learning predictions — and they consume no AI credits.
▶How often should I run AI reports?
As often as you like — AI Insights reports consume no credits and recalculate from live data every time you open them. In practice, reviewing them at the end of each sprint or test cycle works well. Reports like Flaky Tests and Suite Optimization are most meaningful when revisited periodically (monthly or quarterly) once enough history has accumulated.