Define test scenarios and test cases continuously!
Article#: 00040
Date: 2020-11-19
Author: Radim
Why do we test?
We test because we want to check whether a function, a program or the entire system does exactly what we request.
The results of a successful test must meet the requirements.
We also gain our first practical experiences through tests.
These practical experiences can lead us to rethink and adapt or expand our requirements.
We should test every requirement and prove every expectation.
We should follow the rule: What has not been tested must be regarded as not working.
It is better to think about the test scenarios together with the definition of the requirements than to try to find out the test scenarios later.
Developers should also define test cases because they can see during development what needs to be checked.
Identify what has to be tested, define how it should be tested and what the desired result should look like, and write it down.
Make sure there are positive and negative test cases for each scenario.
The positive ones cover the intended or normal situations and the negative ones cover the unintended or exceptional situations.
A solution often has to be tested several times under different conditions.
It is beneficial to document the relationship between the requirements and their tests cases.
If a requirement is to be changed, you know which relevant test cases and their desired results also need to be revised.
If you maintain a list of test cases associated with each requirement, you have a good overview of pending tests and the status of each requirement.
© Radim-Automation, 2020–2025. All rights reserved.
Sharing of this article is permitted with proper attribution (link to the original page).
Related previous articles:
- Don't make it worse!
- Write a project diary!
- Keep the answers to the question "Why"
- Everything is difficult until it becomes easy
- Realize every good idea ASAP!
- Get and stay in the flow!
- Industrial evolution - Listen to your customers and follow new trends!
- Stay alert!
- What does the customer need?
- Don't disappoint your customer!
- Ask questions!
- Communication skills are extremely important
- Develop a sense of responsibility!
- Focus on target!
- Think on paper!
- Multitasking is harmful
- Avoid overly optimistic estimates!
- 9 women can't make a baby in a month
- Sharpen your axe before you start felling!
- Don't hide any problem!
- Check the result!
- Keep it simple!
- Don't leave a work package half-finished!
- Success is not a matter of coincidence
- Good communication is important
- Development is evolution
- Follow the vision!
- Transparency and reliability
- From an idea to a consistent system
Related next articles:
- Do the right things and do them right!
- Safety first!
- More than just start and stop
- I can see what you can not see
- Do you really want to start with this?
- Is the way really the goal?
- Prepare a good project plan and keep it up to date!
- HMI and PLC applications should grow together
- Write down your best practices and processes!
- Set your goals for today, tommorow, this week ...
- Functional and intuitive HMI
- Who will operate?
- Collect all the requirements and sort them!
- Why do automation projects fail?
- Project leader
- Learn from your journey!
- Design machines with a focus on user's abilities and needs
- Think critically!
- Are there also any disadvantages?
- A good concept = Complete set of suitable solutions
- Hardware concept
- Modular software architecture
- Machine modularization
- Knowledge gained from a completed project is priceless
- Visual modeling
- Safety relays versus safety PLC
- Software update
- Design considerations for effective HMIS
- Talk to operators
- Event logger as the very first function implemented in the program
- Diagnostic tools
- My boss was a hero
- Keep the documentation up to date throughout the project
- Maintain order in the program code
- Make backups, make small changes and test a lot
- Keep everything you need together
- Hidden dangers during commissioning
- HMI is not a web page
- The false illusion of rapid progress
- HMI - annoying pop-up windows
Comment#: 00001
Date: 2021-08-10
User: Radim
Define measurable and achievable test criteria.
Avoid using unachievable absolute criteria such as 100% reliability or 100% availability.
Comment#: 00002
Date: 2022-02-26
User: Radim
Identifying and fixing problems early costs less than fixing them later when they are already distributed among customers.
Comment#: 00003
Date: 2022-09-13
User: Radim
"One good test is worth a thousand expert opinions."
- Wernher von Braun
Comment#: 00004
Date: 2022-10-31
User: Radim
"Disciplined testing and commissioning procedures executed by qualified resources are critical for safe and efficient startup. Shortcuts here inevitably lead to ongoing operational problems, costing many times the minimal savings from reduced commissioning time."
- https://blog.isa.org/industrial-automation-projects-challenging-management
Comment#: 00005
Date: 2022-11-16
User: Radim
"The later in the development cycle we discover a bug in the software, the more expensive it is to fix."
- https://www.linkedin.com/pulse/unit-testing-world-industrial-automation-jakob-sagatowski/?trackingId=8Il2af6t8cNMxCT2pRn76Q%3D%3D
Comment#: 00006
Date: 2022-11-30
User: Radim
New problems occur in real operation that were not expected or experienced during development or test operation.
Then you are happy if you know the system / devices well, if you know how they work, how they are connected and controlled, etc. This know-how comes simply from working on the system, from solving smaller and larger problems...
Comment#: 00007
Date: 2022-11-30
User: Radim
During development, do not use other (preliminary) hardware than the one selected for production. You gain important experience with the hardware. You will find out whether the performance is sufficient and learn how to eliminate problems that arise during development. If the software development phase is carried out on the hardware designed for sharp operation, you will experience fewer unpleasant surprises after the machine is commissioned.
Comment#: 00008
Date: 2023-10-02
User: Radim
How to get the right intuition?
"Developing and honing your intuition can be a valuable skill, but it's important to remember that intuition is inherently subjective and can't always be "right" in an objective sense. However, you can work on improving the accuracy and reliability of your intuition by following these tips:
1. Increase Your Knowledge and Experience: The more you know about a particular subject or domain, the better your intuition is likely to be within that area. Gain expertise and experience through study, practice, and exposure.
2. Trust Your Gut: Pay attention to your gut feelings or initial impressions. Sometimes, your subconscious mind processes information faster than your conscious mind, leading to intuitive insights. Don't dismiss these feelings outright; give them consideration.
3. Practice Mindfulness: Mindfulness meditation can help you become more aware of your thoughts and feelings. This self-awareness can improve your ability to recognize and trust your intuition.
4. Keep a Journal: Maintain a journal where you record your intuitive hunches and the outcomes. Over time, this can help you assess the accuracy of your intuition and learn from your experiences.
5. Seek Feedback: Discuss your intuitive insights with trusted friends, mentors, or colleagues. They can provide valuable perspectives and help you refine your intuition by offering feedback on your decisions.
6. Validate with Data: When possible, seek out data or information that can confirm or refute your intuitive impressions. This can help you develop a more evidence-based form of intuition.
7. Relax and Clear Your Mind: High-stress levels or a cluttered mind can cloud your intuition. Engage in relaxation techniques like deep breathing, meditation, or progressive muscle relaxation to clear your mind and enhance your intuitive abilities.
8. Ask Open-Ended Questions: When facing a problem or decision, ask yourself open-ended questions and let your mind wander. This can stimulate creative and intuitive thinking.
9. Learn from Mistakes: Embrace your intuition's imperfections. When your intuition leads you astray, use those experiences as learning opportunities. Analyze what went wrong and adjust your intuition accordingly.
10. Practice Patience: Sometimes, intuition needs time to develop. Don't rush your decision-making process if you're unsure. Give yourself the space to allow your intuition to emerge.
11. Combine with Analysis: Balance your intuition with analytical thinking. For important decisions, use your intuition as an initial guide but then follow up with critical analysis and data-driven assessment.
12. Cultivate Emotional Intelligence: Understand and manage your emotions effectively. Emotional intelligence can enhance your ability to perceive and interpret your own and others' emotional signals, which can inform your intuition.
Remember that intuition can vary from person to person, and it's not always infallible. It's a skill that you can refine over time, but it's also important to recognize its limitations and use it as a complementary tool alongside rational thinking and evidence-based decision-making when appropriate."
- https://chat.openai.com (How to get the right intuition?)
Comment#: 00010
Date: 2023-11-28
User: Radim
If you choose the path to the left at the crossroads, you will not be able to pick the fruit that grows on the path to the right.
So collect all the requirements and decide which ones you want to choose and which ones you want to eliminate by weighing up the pros and cons.