SmartTC produced testcases based on the Pairwise Algorithm, which is an effective mathematical model that will generate a pair of result at least once. Many academic studies have be conducted and proven that Pairwise Algorithm is an effective method for testing.
Q2: How long does it take to train our testers to adopt SmartTC for testing?
SmartTC is a very simple-to-use application, with a very intuitive grahpical user interface. Once the testers and designers have undestood the Pair-wise algorithm testing modeling, the learning curve for using the SmartTC should be minimal.
Q3: Will designers and testers still need to involve in the testing process if using SmartTC?
SmartTC is a powerful tool to aid testers for generating effective test cases. Designers and Testers will still need to involve in designing test cases based on the output from SmartTC. Designers and testers can take advantage of the Include and Exclude features in SmartTC if there are special test cases that must or must not be tested.
Q4: Is SmartTC Architecture dependent?
No, SmartTC is Architecture neutral.
Q5: Can SmartTC be applied in any phase (unit, integration, system) of testing?
Yes, definitely. As long as the functionality of the software to be tested can be modeled in terms of a number of input parameters and their possible values, the tool can be used to auto-generate optimum test set.
Q6: Roughly, how much we can benefit from adopting SmartTC?
Let's say you were to test a system which has 6 input parameters with 10 possible values. The possible combinations of input values would be 10^6 i.e. a million. Let's assume each combination i.e. a test case would require 2 minutes to execute which implies it would take approximately 33,333 hours (i.e. ~ 1,389 days) to test all these test cases. If pairwise technique is used, the number of testcases required would be 120 which would take only 4 hours to execute. The savings in time and effort is 99.99%.
Moreover, using the technique and tool, there are savings in test planning and test automation. There is savings in time and effort for adopting new test cases when change in requirement and/or design happens.
Q7: The gain in using SmartTC sounds too good to be true, what is the catch?
Yes, it is quite good, isn't it? However, mind you, nobody with right mind set will test all combinations anyway, but one won't be able to automatically generate an optimum and effective test set. SmartTC uses pair-wise technique to automatically generate a manageable yet effective test set. One may argue by not guaranteeing higher order interactions the test set will not be able to test all functionalities. The point is, first of all one is NOT able to achieve 100% code coverage in any case and second, studies indicate that most field faults occur by interaction of two parameters and therefore pair-wise technique allows higher code coverage than any adhoc way of choosing testcases.
Q8: Is SmartTC a standalone or web-based product?
Currently, it is a standalone application, however, web version is under beta testing and would be available soon.
Q9: Do you provide consulting and support services?
Yes, Cistel works very closely with their customers to see their needs and provide consulting, tool support as well as resources as/when required.
