Support

Expand all | Collapse all

Same tests for multiple environments

Jump to Best Answer
  • 1.  Same tests for multiple environments

    Posted 01-07-2018 06:26
    Hi,
    What is the best way to organize test runs on multiple environments (for example Windows, Unix, Linux etc)
    What will be correct:
    - To create separate TestPlan for each environment by duplicate origin TestPlan
    - Or use in different run cycles (for different environments) and add related different tags to those cycles. Like : Cycle 1 run on Windows and have tag Win, Cycle 2 run on Unix and have tag Unix etc.
    - Or some other way?

    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------


  • 2.  RE: Same tests for multiple environments
    Best Answer

    Posted 01-08-2018 06:54
    I would create a testplan for each different environment. A test is only passed when all instances in the different environments are passed.

    ------------------------------
    Harald Hotz-Behofsits
    Frequentis AG
    ------------------------------



  • 3.  RE: Same tests for multiple environments

    Posted 01-08-2018 08:54
    Probably can also do next:
    Reuse test cases. Reused TC will get other GlobalId. After that I will can add them to same TestPlan, different groups. It will be exactly same TestCases but with different IDs (reused). And I will can add groups: Windows, Unix etc in one TestPlan. Under those groups I will add those reused TestCases.
    Correct?

    But this way (and separate Test Plan for each environment) will multiple data. Or in TestPlans, or in TestCases. I like the way without multiple data. So it is cycling. What wrong in it?

    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------



  • 4.  RE: Same tests for multiple environments

    Posted 01-10-2018 09:17
    Edited by Dana 01-10-2018 09:17

    Hello Yana,

    I agree with @Harald his suggestion makes a lot of sense and it might be the less cumbersome method of achieving this.



    ------------------------------
    Dana Medhaug
    Technical Support Engineer
    Jama Software
    ------------------------------



  • 5.  RE: Same tests for multiple environments

    Posted 01-11-2018 02:01
    Ok, thank you both a lot.
    I have no experience with jama, it is new framework for me.
    But explain me please :
    If I will use in Cycling - is it not more UNcumbersome method?
    I mean: 1 Test plan and different cycles (signed by different tags) for different OS environment
    ?


    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------



  • 6.  RE: Same tests for multiple environments

    Posted 01-11-2018 06:46
    No, the result of the latest cycle will be valid, in your case you have test runs valid concurrently for the same testcase. This can be achieved only with having them in different testplans.

    ------------------------------
    Harald Hotz-Behofsits
    Frequentis AG
    ------------------------------



  • 7.  RE: Same tests for multiple environments

    Posted 01-11-2018 08:56
    Ok, understood. Thank you!

    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------



  • 8.  RE: Same tests for multiple environments

    Posted 01-14-2018 03:39
    And one more question related to topic issue:
    What is the bad\problematic point in next structure?:
    I have test cases. I reuse them a few times so clones will get other IDs.
    After that I put those test cases to different groups of one TestPlan. The groups will: Windows, Linux, Unix etc. Every group will contain exactly same set of testcases.
    After that I will can run related to environment group.
    For example, for windows I will run group "windows". Etc.
    If I will change some test case, all reused from it testcases will updated.
    So I will have 1 Test Plan and a few groups of test cases according tested environment.

    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------



  • 9.  RE: Same tests for multiple environments

    Posted 01-16-2018 16:33
    Hi Yana,
    I don't see any problems with this approach. Good luck.

    ------------------------------
    Dana Medhaug
    Technical Support Engineer
    Jama Software
    ------------------------------



  • 10.  RE: Same tests for multiple environments

    Posted 01-17-2018 01:15
    Good)
    Thanks!

    ------------------------------
    Yana Fridman
    ZAC
    ------------------------------