Test Runs cannot be sorted by Test Group
Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
Patrick
------------------------------
Comments
-
Hi Patrick,
------------------------------
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
-------------------------------------------
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
------------------------------
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
Patrick
------------------------------
0 -
Hi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
------------------------------
-------------------------------------------
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------Patrick0 -
Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
-------------------------------------------
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
------------------------------
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------0 -
Which pick list are you referring to? Test group name is not a pick list.
------------------------------
Patrick
------------------------------
-------------------------------------------
Original Message:
Sent: 05-24-2023 18:37
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupGot it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------Patrick0 -
I understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
-------------------------------------------
Original Message:
Sent: 05-24-2023 23:48
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhich pick list are you referring to? Test group name is not a pick list.
------------------------------
Patrick
------------------------------
Original Message:
Sent: 05-24-2023 18:37
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupGot it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------0 -
Where can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?
------------------------------
Patrick
------------------------------
-------------------------------------------
Original Message:
Sent: 06-02-2023 17:01
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupI understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
Original Message:
Sent: 05-24-2023 23:48
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhich pick list are you referring to? Test group name is not a pick list.
------------------------------
Patrick
Original Message:
Sent: 05-24-2023 18:37
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupGot it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------Patrick0 -
Hi Patrick,
In the most current version of Jama Connect, it should be under Admin > Organization > Organization admin > Pick lists -- when you select a pick list, a menu opens on the right-hand side that allows you to view the set order (and drag and drop the pick lists there to rearrange them).
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
-------------------------------------------
Original Message:
Sent: 06-05-2023 01:19
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhere can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?
------------------------------
Patrick
------------------------------
Original Message:
Sent: 06-02-2023 17:01
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupI understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-24-2023 23:48
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhich pick list are you referring to? Test group name is not a pick list.
------------------------------
Patrick
Original Message:
Sent: 05-24-2023 18:37
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupGot it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------0 -
We are seeing the same behaviour, but only for Duplicated test plans (Jama version 8.79.5). Workaround for us is to add new test cycle in duplicated test plan and then re-adding the tests.
------------------------------
S Grond
------------------------------
-------------------------------------------
Original Message:
Sent: 06-08-2023 10:56
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
In the most current version of Jama Connect, it should be under Admin > Organization > Organization admin > Pick lists -- when you select a pick list, a menu opens on the right-hand side that allows you to view the set order (and drag and drop the pick lists there to rearrange them).
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
------------------------------
Original Message:
Sent: 06-05-2023 01:19
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhere can I find this setting? I am organization admin for us and cannot find a respective setting. Or is this a setting in the system admin section?
------------------------------
Patrick
Original Message:
Sent: 06-02-2023 17:01
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupI understand that test group names and pick lists are unrelated entities, no worries! What I meant was that the settings for the sorting order for pick lists is also what determines the sort order for test group names. Have you checked with your administrator to see what that is set to/as, by chance?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-24-2023 23:48
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupWhich pick list are you referring to? Test group name is not a pick list.
------------------------------
Patrick
Original Message:
Sent: 05-24-2023 18:37
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupGot it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper.
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-17-2023 02:37
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi Carly,
thanks for looking into this.
We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.
Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:
Name:
Test Case:
Here the Test Groups and their order:
I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:
3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7
None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.
In summary, we see two issues here:- Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
- Test Runs cannot be ordered by Test Group. This behaves completely random
What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.
Thanks for your help!
------------------------------
Patrick
Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test GroupHi Patrick,
I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?
------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR
Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test GroupHi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group
But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!
------------------------------
Patrick
------------------------------S Grond0