Thursday 15 July 2010

How to get maximum value out of automated testing during a limited period of time? -



How to get maximum value out of automated testing during a limited period of time? -

i have relatively big project, had no automatic tests.

now management has given several weeks of time stabilize product, including test automation.

in order value of these x weeks can spend on automatic testing, need know classes/methods test first.

how can prioritize testing efforts (decide, class/method test now, later) apart approaches listed below ?

calculate dependents each class (how many other classes utilize class, including transitive dependencies). classes greatest number of dependent classes should tested first. find out, classes alter (according version command system). frequent changes may symptom of either lots of bugs or active development in these classes. in both cases, makes sense write unit tests them. find out, classes involved in bug reports testers and/or customers.

all of ideas seems good. this article can help prioritizing , automating.

this formula of how estimating testing effort:

method testing process (based on utilize case driven approach).

step 1 : count number of utilize cases (nuc) of scheme step 2 : set avg time test cases(attc) per test plan step 3 : estimate total number of test cases (ntc)

total number of test cases = number of usecases x avg testcases per utilize case

step 4 : set avg execution time (aet) per test case (idelly 15 min depends on system) step 5 : calculate total execution time (tet) tet = total number of test cases * aet step 6 : calculate test case creation time (tcct)

usually take 1.5 times of tet tcct

tcct = 1.5 * tet

step 7 : time retest case execution (rtce) retesting

usually take 0.5 times of tet

rtce = 0.5 * tet step 8 : set study generation time (rgt

usually take 0.2 times of tet

rgt = 0.2 * tet step 9 : set test environment setup time (test)

it depends on test plan

step 10 : total estimation time = tet + tcct+ rtce + rgt + test + buffer...;)

here example how works:

total no of utilize cases (nuc) : 227

average test cases per utilize cases(aet) : 10

estimated test cases(ntc) : 227 * 10 = 2270

time estimation execution (tet) : 2270/4 = 567.5 hr

time creating testcases (tcct) : 567.5*4/3 = 756.6 hr

time retesting (rtce) : 567.5/2 = 283.75 hr

report generation(rgt) = 100 hr

test environment setup time(test) = 20 hr.

total hrs 1727.85 + buffer

4 means number of test cases executed per hour

i.e 15 min take execution of each test case

and since going automate scratch

up had no automatic tests

i think may consider not benefits, myths automated testing too:

automation cannot replace human

once automated, cost savings given

every test case can automated

testing can automated

one test tool suitable tasks

automated testing doesn’t mean automatic

after testing ... means computer aided testing.

unit-testing testing automated-tests qa

No comments:

Post a Comment