Here is an interesting choice regarding priorities.
You have two objectives that you are using suites of automated end-to-end checks to meet. One is "Detect problems that ought to stop deployment of the release to production" and the other is "Help developers find problems in their code before they submit to the repository."
You have not built either of these yet. You have a set of end-to-end automated checks that so far have been run by the authors of those checks from their own machine, but the mechanism for other people to run them or to trigger them automatically (report results, etc.) has not been put together yet.
Which do you prioritize to implement first? Do you prioritize deployment because it has the most critical impact, would have the most conservative set of checks, the more stringent need to run with reliable results? Do you prioritize developers finding problems because it has the most coverage potential, has the lower reliability threshold requirements and thus easier to work on first?
I don't believe the answer is the same in all conditions. I believe the product maturity, engineer experience, state of the automation framework and scripts, and maybe even the mood of the team might indicate the better choice. I believe either path is going to introduce a lot of "oops" moments that need to get addressed.
Add to this "is there a right way?" question, consider that a lot of people dismiss end-to-end automation as a no-starter project from the get-go. I understand that argument, but stand puzzled how people are content with evaluation that never looks at the product running as a whole, so count me in the "Yeah, but..." crowd on that one. That said, I do consider it a valid point, and don't leap into end-to-end automation lightly if somebody has a strong alternative (and if you don't have a strong alternative, there is probably something very wrong in the project).
So, there you go, a question posed where the answer is more questions. Welcome to reality. If anybody sells you something different, well... yeah, they were selling you something, and that merits thinking about.
hashtag
#softwaretesting hashtag
#softwaredevelopment hashtag
#ifyoureadbetweenthelinesonmypostsyouwillhaveaprettygoodideawhatproblemsIamworkingon
5
Here is an interesting choice regarding priorities.
You have two objectives that you are using suites of automated end-to-end checks to meet. One is "Detect problems that ought to stop deployment of the release to production" and the other is "Help developers find problems in their code before they submit to the repository."
You have not built either of these yet. You have a set of end-to-end automated checks that so far have been run by the authors of those checks from their own machine, but the mechanism for other people to run them or to trigger them automatically (report results, etc.) has not been put together yet.
Which do you prioritize to implement first? Do you prioritize deployment because it has the most critical impact, would have the most conservative set of checks, the more stringent need to run with reliable results? Do you prioritize developers finding problems because it has the most coverage potential, has the lower reliability threshold requirements and thus easier to work on first?
I don't believe the answer is the same in all conditions. I believe the product maturity, engineer experience, state of the automation framework and scripts, and maybe even the mood of the team might indicate the better choice. I believe either path is going to introduce a lot of "oops" moments that need to get addressed.
Add to this "is there a right way?" question, consider that a lot of people dismiss end-to-end automation as a no-starter project from the get-go. I understand that argument, but stand puzzled how people are content with evaluation that never looks at the product running as a whole, so count me in the "Yeah, but..." crowd on that one. That said, I do consider it a valid point, and don't leap into end-to-end automation lightly if somebody has a strong alternative (and if you don't have a strong alternative, there is probably something very wrong in the project).
So, there you go, a question posed where the answer is more questions. Welcome to reality. If anybody sells you something different, well... yeah, they were selling you something, and that merits thinking about.
#softwaretesting #softwaredevelopment #ifyoureadbetweenthelinesonmypostsyouwillhaveaprettygoodideawhatproblemsIamworkingon
Developer Evangelist @ DevRev | Building Developer Community | AI Agent For Good
10moPlease do join our Community on Discord, we share a lot of our community insights there and also give support for our tool. https://discord.gg/UAVV5mvjB7