Postgraduate Engineering

Business Experimentation: a tool for making decisions in contexts of uncertainty

24.05.2024

Author: Postgraduate Engineering

  • How to make more effective decisions in increasingly complex business environments?
  • How can we test our ideas to identify those that truly add value?
  • How to create an organizational culture that promotes curiosity, creativity, and respect for evidence when testing ideas?

Matías Hirschmann y Sebastian Senlle, directors of program in Business Experimentation from the Faculty of EngineeringThey gave a webinar on Experimentation in Companies, understanding it as The application of the scientific method to improve business decision-making.

During the meeting, they emphasized that information overload today makes decision-making more difficult, with companies forced to operate in complex environments. In this context, the experimental methodology This becomes very relevant because cause-and-effect relationships need to be validated in order to identify what actually works to move business metrics.

It is interesting to transfer the scientific method to the business field to carry out tests and test hypotheses on a sample of customers, in order to then make effective decisions on a larger scale. With the data obtained from iterations, This generates valuable information for the company that helps reduce risks and accelerate learning. And, on the other hand, it allows us to avoid contaminating our own decisions with cognitive biases (for example, avoiding falling into "confirmation bias", which leads us to pay more attention to information that reinforces our previous beliefs).

Experimentation is customer-centric Because when it's implemented, the company learns continuously from customer feedback: it can see how customers respond to changes in our value proposition, based on the various tests that are carried out. In turn, it stimulates creativity and innovation. “We celebrate finding problems to conduct experiments that allow us to progress and learn.”, he claimed Matías Hirschmann.

 

Sectors or organizational challenges where Business Experimentation can be applied:

To conduct experiments, a rigorous methodology is essential: only in this way can the results obtained from a sample be scaled to the rest of the customer base. Simultaneously, a cyclical approach is adopted, where the very execution of the experiment sparks new ideas or questions, which can lead to new hypotheses that we then aim to validate.

How to experiment step by step:

  1. Addressing a problemIdentify the business metric we seek to impact and formulate hypotheses for possible testable solutions
  2. List the hypotheses then prioritize them, ranking them in terms of impact, trust, and effort.
  3. Design the experiment: Choose the type of experiment, the success criteria, and define the size and composition of the sample so that it is representative of the population about which I seek to draw conclusions (it must not be biased).
  4. Execution of the experiment: The sample is typically divided in two, with only one variation in the version of our product each group receives. One treatment group receives the modified version, while the other group (the "control") continues to receive the unchanged version. The metrics obtained in each case are then compared; this allows us to assess whether there are significant differences between the two groups.
  5. Analysis of results: We aim to determine if the target variable differs significantly between the two groups, in order to either reject or accept the hypothesis. Based on this, we then define the appropriate business decision (for example: do we scale the modification tested in the experiment to all customers?).

Organizational culture necessary to be able to carry out experiments

In order to apply these methodologies, one needs to have a entrepreneurial spirit and valuing continuous learning within the company. The first step is always to begin: run the first experiment and start demonstrating value to the company based on that initial experience.

How to delve deeper into the Business Experimentation methodology?

All the topics covered in the webinar are explored in greater depth throughout the program in Business ExperimentationFor those interested in this decision-making tool, you can visit the following link.

  • Unique in Latin America
  • Start date: 14/08
  • Theoretical/practical approach
  • Online mode

 

 

It may interest you

12.05.2026

Biomedical Engineering students develop...
Three third-year students of the Engineering B program...

17.04.2026

From Argentina to Kazakhstan: a teacher...
Marcos Bamonte, Robotics professor at the Faculty...

Share