The Value of Running Experiments
Running experiments is a fundamental practice in Agile and empirical approaches to validate proposed solutions with potential customers. Understanding how to effectively communicate the importance of this practice can ensure organizational buy-in and successful product development.
Exam Question
You have heard that the best way to understand whether a proposed solution is valuable is to run small experiments to test the concept with potential customers. Your CFO feels that the organization cannot afford to run experiments because they are too expensive. How do you respond to your CFO?
(choose the best answer)
A. Stakeholder reviews eliminate the need to run most experiments, so experiments are not needed very often.
B. Spending a small amount of money to validate a solution is much less expensive than developing a product that fills no customer needs.
C. Since experiments are usually based on market research, they will probably be successful anyway and the money will not be wasted.
D. Experiments are only needed for new product concepts, not existing products, so they are not needed very often.
Correct Answer
B. Spending a small amount of money to validate a solution is much less expensive than developing a product that fills no customer needs.
Explanation
Correct Answer
B. Spending a small amount of money to validate a solution is much less expensive than developing a product that fills no customer needs:
Running small experiments to validate a proposed solution with potential customers is a cost-effective strategy. By spending a small amount of money upfront, you can ensure that the product or feature you develop meets actual customer needs and avoids the risk of investing heavily in a product that fails in the market.
Why the Other Options Are Less Effective
A. Stakeholder reviews eliminate the need to run most experiments, so experiments are not needed very often:
While stakeholder reviews are important, they do not provide direct feedback from potential customers. Experiments offer empirical evidence that can validate or invalidate assumptions about customer needs.
C. Since experiments are usually based on market research, they will probably be successful anyway and the money will not be wasted:
This statement assumes that market research is infallible. Experiments provide practical, real-world insights that can sometimes contradict market research predictions.
D. Experiments are only needed for new product concepts, not existing products, so they are not needed very often:
Experiments are valuable for both new and existing products. They help in continuously validating and improving the product to meet evolving customer needs.
Benefits of Running Experiments
- Cost-Effective Validation: Small-scale experiments prevent larger financial losses by identifying ineffective solutions early.
- Customer-Centric Development: Direct feedback from potential customers ensures the product aligns with their needs and preferences.
- Reduced Risk: Experiments help in identifying potential issues and risks before significant resources are committed.
- Continuous Improvement: Regular experimentation allows for ongoing refinement and enhancement of products.
EBM Framework Insights
- Current Value (CV): Experiments help in understanding the current value delivered to customers and identifying areas for improvement.
- Unrealized Value (UV): Identifying gaps through experiments can reveal opportunities for future value.
- Ability to Innovate (A2I): Experiments foster a culture of innovation and continuous learning.
- Time to Market (T2M): Validating ideas quickly through experiments can reduce time to market for valuable features.
Relevance to the PAL-EBM Exam
Understanding the importance of running experiments and effectively communicating their value to stakeholders is crucial for the PAL-EBM exam. This knowledge demonstrates the ability to apply empirical principles to drive value and ensure successful product development.
Key Takeaways
- Running small experiments is a cost-effective way to validate proposed solutions with potential customers.
- Experiments provide direct feedback that can validate or invalidate assumptions about customer needs.
- Experiments are valuable for both new and existing products, fostering continuous improvement and innovation.
- Emphasizing the cost savings of early validation can help secure stakeholder buy-in.
Conclusion
Running small experiments to validate proposed solutions is an essential practice in Agile and empirical approaches. By demonstrating the cost-effectiveness and value of experiments, you can ensure that your organization invests in solutions that meet customer needs and drive success.

Get ready for the official PAL-EBM exam
100 PAL-EBM practice questions, each with an in-depth explanation like the one above.
- Practice Mode: study at your own pace and choose the test length.
- Mock Exam Mode: 40 random questions in 60 minutes, like the real exam.
$29 is ScrumPrep's one-time price. The official PAL-EBM exam fee ($200) is paid separately to Scrum.org.
More PAL-EBM exam questions
- Your company’s largest revenue producing product has recently been losing customers to new competitors whose products have some very attractive features. A major stakeholder insists that their customers can be won back by implementing a set of new features that customers have long been asking for. Implementing all of these features will take more than a year and will postpone other planned improvements. What should you do?
- What are the minimum essential characteristics of a good strategic goal?
- The profit margin for Product A has gone up by 15% this year, due to a combination of revenue increase and improvements in efficiency. What does this say about the value that the product delivers to customers?
- Product A is the main driver of both revenue and profit for your company; it has very happy customers (high Current Value) and low Unrealized Value. Product B is relatively new; it has low Current Value and high Unrealized Value. Both Product Owners of the two products are requesting significant additional funding to improve their products. What do you do?
- True or False: Goals need to be decomposed to the department, group, and team level in order to make them practical and actionable.
