Support

Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group

But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!

Hi Patrick, 

I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?

------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR

Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test Group

Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group

But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!

------------------------------
Patrick
------------------------------

Hi Carly,

thanks for looking into this.

We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.

Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:

Name:

Test Case:

Here the Test Groups and their order:

I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7

None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

In summary, we see two issues here:

1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
2. Test Runs cannot be ordered by Test Group. This behaves completely random

What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

Thanks for your help!

------------------------------
Patrick

Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test Group

Hi Patrick, 

I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?

------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR

Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test Group

Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group

But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!

------------------------------
Patrick
------------------------------

Got it, and thanks for breaking it down in such detail, Patrick! My understanding is that the sort order should mirror the pick list sort order and is based on how the Jama Connect administrator set them up. That said, if you can confirm that the sort order here does not match the pick list sort order and/or is how the Jama Connect administrator set them up, I'd recommend filing a Support ticket (with a link to this thread included in the body) to dig in deeper. 

Hi Carly,

thanks for looking into this.

We are simply trying to sort the test runs by the test groups, in order to get at least the test runs from the same test group next to each other. This would already help. Ideally, the test runs should be in the same order as sorted within the test groups in the Test Cases section. As the test cases can be moved up and down within the test groups, the expectation is that the testers can plan the test sequence with that. What would this feature be good for, if not for that?
Not even the test run ID's are generated by a meaningful sequence.

Here some examples from a small test cycle with 6 test cases and 3 test groups. After creating a new cycle, the order looks like this:
As you can see, the test runs are neither sorted by ID, Name, Test Group nor Test Case ID. When I now click on the Titel of the Test Group column, nothing changes, but it shows a small up-arrow next to the title:
When I click again, the order changes and a down arrow appears:
But the order within the test group column is completely random. It is not even just the opposite order as before. The sorting works for all the other columns:
Test Run ID:

Name:

Test Case:

Here the Test Groups and their order:

I also checked if the Test Run ID's maybe follow the heading number of the test cases, but this is also not the case. Here is the order based on the heading:

3.8.3.4.1 TST-VER-3
3.8.3.4.2 TST-VER-1
3.8.3.5.1 TST-VER-5
3.8.3.5.2 TST-VER-6
3.8.3.7 TST-VER-8
3.8.3.13 TST-VER-7

None of the screenshots above show this order.
From our perspective, this is clearly a bug and there is no logic behind the creation of the test run ID's. There might be a certain logic in the implementation, but it looks completely random.

In summary, we see two issues here:

1. Test Runs are generated in a random order. It does not follow any obvious logic. If it would follow the sequence in the Test Cases section, a sorting by ID would be possible to follow the correct sequence
2. Test Runs cannot be ordered by Test Group. This behaves completely random

What I forgot to mention: we are on Self-hosted version 8.79.1, but in previous versions (e.g. 8.36.1) it didn't work either.

Thanks for your help!

------------------------------
Patrick

Original Message:
Sent: 05-16-2023 17:36
From: Carly Rossi
Subject: Test Runs cannot be sorted by Test Group

Hi Patrick, 

I've been digging into this, and wanted to get some additional clarification to make sure I was on the right path -- are you trying to have the test groups sorted alphabetically, to have them sorted in the order they were added in, or are you trying to have them sorted in a different order?

------------------------------
Carly Rossi // she/her/hers
Community Program Manager // Jama Software
Portland, OR

Original Message:
Sent: 05-04-2023 01:22
From: Patrick Szabo
Subject: Test Runs cannot be sorted by Test Group

Hi,
a while ago, I posted the following idea:
Sort Test Runs by Test Group

But for us, this looks more like a bug then a feature request. Our testing group came back to me recently, that with this behavior, the whole test execution is almost unusable, especially when there are a lot of test runs in one cycle. With that, it is not possible to plan a test sequence by creating and sorting test groups in the Test Cases section, and execute them in the correct order in the test runs afterwards.
Can someone from Jama look into this and confirm that this is a bug? Is there maybe a workaround for this?
Thanks!

------------------------------
Patrick
------------------------------