Test Runs cannot be sorted by Test Group

Patrick Szabo
Patrick Szabo Member, Medical Devices & Life Sciences Solution Posts: 55
edited March 13 in Peer-to-Peer Support Forum

Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group

But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!

------------------------------
Patrick
------------------------------
Patrick

Comments

  • [Deleted User]
    [Deleted User] Posts: 152
    edited May 2023

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!

    ------------------------------
    Patrick
    ------------------------------
  • Patrick Szabo
    Patrick Szabo Member, Medical Devices & Life Sciences Solution Posts: 55
    edited May 2023

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

    Patrick
  • [Deleted User]
    [Deleted User] Posts: 152
    edited May 2023

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick
    ------------------------------

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

  • Patrick Szabo
    Patrick Szabo Member, Medical Devices & Life Sciences Solution Posts: 55
    edited May 2023

    Which pick list are you referring to? Test group name is not a pick list.

    ------------------------------
    Patrick
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 05-24-2023 18:37
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------

    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

    Patrick
  • [Deleted User]
    [Deleted User] Posts: 152
    edited June 2023

    I understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance? 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 05-24-2023 23:48
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Which pick list are you referring to? Test group name is not a pick list.

    ------------------------------
    Patrick
    ------------------------------

    Original Message:
    Sent: 05-24-2023 18:37
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

  • Patrick Szabo
    Patrick Szabo Member, Medical Devices & Life Sciences Solution Posts: 55
    edited June 2023

    Where can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?

    ------------------------------
    Patrick
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 06-02-2023 17:01
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    I understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance? 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------

    Original Message:
    Sent: 05-24-2023 23:48
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Which pick list are you referring to? Test group name is not a pick list.

    ------------------------------
    Patrick

    Original Message:
    Sent: 05-24-2023 18:37
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

    Patrick
  • [Deleted User]
    [Deleted User] Posts: 152
    edited June 2023

    Hi Patrick, 

    In the most current version of Jama Connect, it should be under Admin > Organization > Organization admin > Pick lists -- when you select a pick list, a menu opens on the right-hand side that allows you to view the set order (and drag and drop the pick lists there to rearrange them). 

    image


    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 06-05-2023 01:19
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Where can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?

    ------------------------------
    Patrick
    ------------------------------

    Original Message:
    Sent: 06-02-2023 17:01
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    I understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance? 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-24-2023 23:48
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Which pick list are you referring to? Test group name is not a pick list.

    ------------------------------
    Patrick

    Original Message:
    Sent: 05-24-2023 18:37
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

  • S Grond
    S Grond Member Posts: 3
    edited February 7

    We are seeing the same behaviour, but only for Duplicated test plans (Jama version 8.79.5). Workaround for us is to add new test cycle in duplicated test plan and then re-adding the tests.

    ------------------------------
    S Grond
    ------------------------------
    -------------------------------------------
    Original Message:
    Sent: 06-08-2023 10:56
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    In the most current version of Jama Connect, it should be under Admin > Organization > Organization admin > Pick lists -- when you select a pick list, a menu opens on the right-hand side that allows you to view the set order (and drag and drop the pick lists there to rearrange them). 

    image


    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR
    ------------------------------

    Original Message:
    Sent: 06-05-2023 01:19
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Where can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?

    ------------------------------
    Patrick

    Original Message:
    Sent: 06-02-2023 17:01
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    I understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance? 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-24-2023 23:48
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Which pick list are you referring to? Test group name is not a pick list.

    ------------------------------
    Patrick

    Original Message:
    Sent: 05-24-2023 18:37
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-17-2023 02:37
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi Carly,

    thanks for looking into this.

    We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
    Not even the test run ID's are generated by a meaningful sequence.

    Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
    imageAs you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
    imageWhen I click again, the order changes and a down arrow appears:
    imageBut the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
    Test Run ID:
    imageimage
    Name:
    imageimage
    Test Case:
    imageimage
    Here the Test Groups and their order:
    image
    I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

    3.8.3.4.1 TST-VER-3
    3.8.3.4.2 TST-VER-1
    3.8.3.5.1 TST-VER-5
    3.8.3.5.2 TST-VER-6
    3.8.3.7 TST-VER-8
    3.8.3.13 TST-VER-7

    None of the screenshots above show this order.
    From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

    In summary, we see two issues here:

    1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
    2. Test Runs cannot be ordered by Test Group. This behaves completely random

    What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

    Thanks for your help!



    ------------------------------
    Patrick

    Original Message:
    Sent: 05-16-2023 17:36
    From: Carly Rossi
    Subject: Test Runs cannot be sorted by Test Group

    Hi Patrick, 

    I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?



    ------------------------------
    Carly Rossi // she/her/hers
    Community Program Manager // Jama Software
    Portland, OR

    Original Message:
    Sent: 05-04-2023 01:22
    From: Patrick Szabo
    Subject: Test Runs cannot be sorted by Test Group

    Hi,
    a while ago, I posted the following idea:
    Sort Test Runs by Test Group

    But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
    Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
    Thanks!



    ------------------------------
    Patrick
    ------------------------------

    S Grond

Categories