Test Cycles with multiple samples

Jomar Ochoco
Jomar Ochoco Member Posts: 2
Hello.  I'm using Jama to track my hardware testing.  

For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

------------------------------
Jomar Ochoco
MN
------------------------------

Comments

  • [Deleted User]
    [Deleted User] Posts: 103
    edited January 2023
    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
  • Jomar Ochoco
    Jomar Ochoco Member Posts: 2
    edited January 2023
    I think that's my best option here. For my specific situation though, every cycle will always require multiple samples. So if I have one failure, I'm going to test a new set of samples. Ideally, they're organized within a cycle.

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-22-2023 18:52
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software
    ------------------------------

    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
  • Jacob Brodal
    Jacob Brodal Member Posts: 11
    edited January 2023
    When we test HW We use one test case in one test cycle with multiple samples.
    In the description we might indicate sample size as 10. In our steps, we would then have a step saying "Repeat previous steps according to sample size". The result column will then contain results from all samples. You could also have one step per sample, if it is known beforehand.

    If we have a test fail, we will then create a new cycle containing that test case. It might not be the best in your case if multiple people will enter information, but it is still possible, they just can't do it at the same time.

    ------------------------------
    Jacob Brodal
    Systems Engineer
    3Shape
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-22-2023 21:55
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    I think that's my best option here. For my specific situation though, every cycle will always require multiple samples. So if I have one failure, I'm going to test a new set of samples. Ideally, they're organized within a cycle.

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------

    Original Message:
    Sent: 01-22-2023 18:52
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software

    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
  • Per Ekvall
    Per Ekvall Member, Jama Validation Kit (JVK) + Functional Safety Kit (FSK) Posts: 10
    edited January 2023

    Question Jacob, if you have several different configurations of hardware but same test case with several samples.  

    Each test case can contain several samples (of the HW configuration). I would like to use cycles for configurations of HW+SW but the same test procedure. The problem i see is that the latest run is counted and the test coverage is based on the latest only. 

    ------------------------------
    Per Ekvall
    AMBU
    Ballerup
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-23-2023 01:37
    From: Jacob Brodal
    Subject: Test Cycles with multiple samples

    When we test HW We use one test case in one test cycle with multiple samples.
    In the description we might indicate sample size as 10. In our steps, we would then have a step saying "Repeat previous steps according to sample size". The result column will then contain results from all samples. You could also have one step per sample, if it is known beforehand.

    If we have a test fail, we will then create a new cycle containing that test case. It might not be the best in your case if multiple people will enter information, but it is still possible, they just can't do it at the same time.

    ------------------------------
    Jacob Brodal
    Systems Engineer
    3Shape
    ------------------------------

    Original Message:
    Sent: 01-22-2023 21:55
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    I think that's my best option here. For my specific situation though, every cycle will always require multiple samples. So if I have one failure, I'm going to test a new set of samples. Ideally, they're organized within a cycle.

    ------------------------------
    Jomar Ochoco
    MN

    Original Message:
    Sent: 01-22-2023 18:52
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software

    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
  • [Deleted User]
    [Deleted User] Posts: 103
    edited January 2023
    For this scenario, you will want to consider separate Test Plans for each configuration of the Hardware, since results from separate Test Plans are rolled up as "worst result" (as opposed to Test Cycles, which are "latest result").   For this to scale, Jama is working on mechanisms that would allow you to better deal with large numbers of Test Plans.

    ------------------------------
    Geoffrey Clemm
    Jama Software
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-26-2023 01:46
    From: Per Ekvall
    Subject: Test Cycles with multiple samples

    Question Jacob, if you have several different configurations of hardware but same test case with several samples.  

    Each test case can contain several samples (of the HW configuration). I would like to use cycles for configurations of HW+SW but the same test procedure. The problem i see is that the latest run is counted and the test coverage is based on the latest only. 

    ------------------------------
    Per Ekvall
    AMBU
    Ballerup
    ------------------------------

    Original Message:
    Sent: 01-23-2023 01:37
    From: Jacob Brodal
    Subject: Test Cycles with multiple samples

    When we test HW We use one test case in one test cycle with multiple samples.
    In the description we might indicate sample size as 10. In our steps, we would then have a step saying "Repeat previous steps according to sample size". The result column will then contain results from all samples. You could also have one step per sample, if it is known beforehand.

    If we have a test fail, we will then create a new cycle containing that test case. It might not be the best in your case if multiple people will enter information, but it is still possible, they just can't do it at the same time.

    ------------------------------
    Jacob Brodal
    Systems Engineer
    3Shape

    Original Message:
    Sent: 01-22-2023 21:55
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    I think that's my best option here. For my specific situation though, every cycle will always require multiple samples. So if I have one failure, I'm going to test a new set of samples. Ideally, they're organized within a cycle.

    ------------------------------
    Jomar Ochoco
    MN

    Original Message:
    Sent: 01-22-2023 18:52
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software

    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------
  • Jacob Brodal
    Jacob Brodal Member Posts: 11
    edited January 2023
    Agree with Geoffrey. A good example is when we test the PCs we are selling with some of our devices.
    They all have to live up to the same (mostly) requirements and can come from different suppliers.

    In this case we have a test plan per PC model. This also makes it easier for re-testing, i.e., subsequent test cycles is covering the same configuration you are testing-

    ------------------------------
    Jacob Brodal
    Systems Engineer
    3Shape
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 01-26-2023 07:54
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    For this scenario, you will want to consider separate Test Plans for each configuration of the Hardware, since results from separate Test Plans are rolled up as "worst result" (as opposed to Test Cycles, which are "latest result").   For this to scale, Jama is working on mechanisms that would allow you to better deal with large numbers of Test Plans.

    ------------------------------
    Geoffrey Clemm
    Jama Software
    ------------------------------

    Original Message:
    Sent: 01-26-2023 01:46
    From: Per Ekvall
    Subject: Test Cycles with multiple samples

    Question Jacob, if you have several different configurations of hardware but same test case with several samples.  

    Each test case can contain several samples (of the HW configuration). I would like to use cycles for configurations of HW+SW but the same test procedure. The problem i see is that the latest run is counted and the test coverage is based on the latest only. 

    ------------------------------
    Per Ekvall
    AMBU
    Ballerup

    Original Message:
    Sent: 01-23-2023 01:37
    From: Jacob Brodal
    Subject: Test Cycles with multiple samples

    When we test HW We use one test case in one test cycle with multiple samples.
    In the description we might indicate sample size as 10. In our steps, we would then have a step saying "Repeat previous steps according to sample size". The result column will then contain results from all samples. You could also have one step per sample, if it is known beforehand.

    If we have a test fail, we will then create a new cycle containing that test case. It might not be the best in your case if multiple people will enter information, but it is still possible, they just can't do it at the same time.

    ------------------------------
    Jacob Brodal
    Systems Engineer
    3Shape

    Original Message:
    Sent: 01-22-2023 21:55
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    I think that's my best option here. For my specific situation though, every cycle will always require multiple samples. So if I have one failure, I'm going to test a new set of samples. Ideally, they're organized within a cycle.

    ------------------------------
    Jomar Ochoco
    MN

    Original Message:
    Sent: 01-22-2023 18:52
    From: Geoffrey Clemm
    Subject: Test Cycles with multiple samples

    You can create additional cycles (one for each sample).   In the Description field of the cycle, indicate what sample is being tested.

    ------------------------------
    Geoffrey Clemm
    Jama Software

    Original Message:
    Sent: 01-18-2023 13:44
    From: Jomar Ochoco
    Subject: Test Cycles with multiple samples

    Hello.  I'm using Jama to track my hardware testing.  

    For each test cycle, I need to test multiple samples of my hardware.  Is there a way I can further separate a cycle into each sample so that different people can test their hardware sample and enter in their data independently?

    ------------------------------
    Jomar Ochoco
    MN
    ------------------------------