NICK WRIGHT
  • Home
  • About
  • Services
  • Testimonials
  • Articles
    • Organisations and leadership
    • Learning and development
    • Coaching and counselling
  • Blog
  • e-Resources
  • News
  • Contact
  • Home
  • About
  • Services
  • Testimonials
  • Articles
    • Organisations and leadership
    • Learning and development
    • Coaching and counselling
  • Blog
  • e-Resources
  • News
  • Contact

Test and learn

19/3/2022

8 Comments

 
Picture

‘The willingness to experiment, it turns out, is the chief indicator of how innovative a person or company will be.’ (Hal Gregorson)

Test and Learn is an experimental, adaptive technique, used to address complexity, uncertainty and innovation. It’s useful in situations where, say, past experience isn't a reliable guide for future action because e.g. critical conditions have changed. It’s also useful when moving into new, unchartered territory where the evidence needed for sound decision-making can only be generated by, ‘let's suck it and see’. It shares a lot in common with action research: create a tentative hypothesis, step forward, observe the results, try to make sense of them, refine the hypothesis, take the next step.

Test and Learn is used in fast-paced, fluid environments, such as by rapid-onset disaster response teams where conventional strategizing and planning isn't realistic or possible. By the time a detailed plan is formulated, things have moved on - and the paper it's written on is sent for recycling before the ink has dried. Test and Learn is also used by marketing teams when testing new products or services or seeking to penetrate new or not-yet-known markets. It provides tangible evidence based on customer responses which, in turn, enables change or refinement before investing further.

What psychological, relational and cultural conditions enable Test and Learn to work?

  1. Leaders who believe and overtly support the idea that learning is a key to success, both from experiments that go well and those that fail.
  2. Shared opportunities for ideation, hypothesis formulation, testing of assumptions and critical sense-making: e.g. via action learning.
  3. Experiments that are sufficiently specific and observable to draw out key evidence and learning.
  4. Meaningful recognition, celebration and reward for experimentation and learning, and for the progress that results from it.

When have you used Test and Learn? How did you do it? What difference did it make?

(See also: Unpredictable; Adaptive)
8 Comments
Kathrin
20/3/2022 03:53:37 pm

Students and teachers do test and learn on a small scale every day. Nobody can know which answers will be given and which direction the conversation in the class will take. Nobody can know which ideas students spontaneously have and which ideas are spontaneously tried out. I always want to encourage my students to keep thinking or to keep going, even if the result is different than expected.
Test and learn can completely transform a prepared lesson. But the students should have the opportunity to try out their spontaneous ideas, the teacher takes a back seat with his planning and goals and gives the students the space to test and learn.

Reply
Nick Wright
20/3/2022 04:43:52 pm

Hi Kathrin and well said. Your approach certainly sounds consistent with the Montessori teaching philosophy. I liked your comment that 'test and learn can completely transform a prepared lesson.' I guess that's the beauty of experimentation - we can hypothesise about outcomes but it's not until we actually try it and see what happens that true learning emerges. That reminds me of the difference between belief and faith. The adventure of faith is acting on what we believe as if it were true...and then discovering all kinds of things that we couldn't possibly have known in advance.

Reply
Richard Simpson
21/3/2022 08:30:55 am

Again, referring to my NHS experience and hopefully instructively - the NHS is very complex and very risk averse. The tendency is always to go for the 'tried and tested' option - usually tried and tested somewhere else and lauded as 'the solution' because it worked then and there. I'm sure a lot of informal 'test and learn' goes on, but at the organisational level the default is to come up with the grand plan, often based on a model, to gain Board approval. When things don't fit this Procustean frame, project managers double down to force reality to fit the plan. As someone once said to me regarding the NHS mindset: "It is easier to ask forgiveness than to seek approval." In other words, just do it, Adopting a 'test and learn' approach would be revolutionary (not a bad thing!) but it would also involve people at all levels, embodying learning, and removing some of the dead weight of hierarchy. In the public sector in general, the map assumes greater importance than the territory.

Reply
Nick Wright
21/3/2022 01:31:11 pm

Hi Richard and thank you for your reflections. I found your insights from experience interesting and useful - as always! Yes, 'tried and tested' is a great way of framing a contrast to 'test and learn'. I recognised your observation that, sometimes, when things don't go to plan, 'project managers double down to force reality to fit the plan'.

Your comment that, 'the map assumes greater importance than the territory' is a very sobering one - and signals, for me, an even greater importance for critical reflection and, in particular, critical reflexivity. I think this is where techniques such as action learning can be so useful - where hypotheses, assumptions, filters sense-making etc. can be challenged constructively from a base of support.

On that theme, this short related piece may resonate? https://www.nick-wright.com/blog/spots

Reply
Haven
22/3/2022 03:27:57 pm

I was fascinated reading this blog and interested of diverse discussions. What a creative approach to test and learn. In my country we been to variety of research and adapting learning techniques and styles globally. We pattern our learning strategies approaches and styles to our greatest influence which is America. We are into extreme bureaucratic ways in learning which at the moment the most basic ways of teaching were often put into trash. Our collection of Basic Research, Action Research and many more that students made where just filed in the library where the consumers are the dust mites and termites because education now focuses on online learning. Our most common way of test is paper and pencil test which means objective type of test and theoretical quizzes.

We have also essays where students are able to explain why. In short too many unnecessary ways in education where in fact the most essential part is moulding one’s character which is the essence of life, community progress and reforms. No one among the doctors in education encourages actual ground of learning which the very basic and practical application of a fruitful learning. Most high ranking officials in our government belongs to percentage party. Which means in everything they do, it involves percentage of commissions before a single goal being achieved. So if education will go on this way it means our country will continue to produce rubbish and self centered graduates. Which is a greatest irony and failure behind those mission and vision of every school institutions.

I pray the world will innovate on learning techniques into behavioral approach than innovating complexity that provokes danger and endless corruption.

Reply
Nick Wright
22/3/2022 03:31:13 pm

Hi Haven and thank you for posting such a thoughtful response. I think you pose some very serious and important questions vis a vis the fundamental goals and nature of education in society and the world. We often conceive of education in its narrowest terms as academic input and achievement.

Interestingly, Reg Regans (the founding 'father' of Action Learning) regarded the most valuable method of education as enabling people to grasp, struggle, wrestle-with and find or create solutions to the real-life issues they were facing and dealing with. I like his philosophy: 'Swap your difficulties, not your cleverness.'

It would be interesting to see Action Learning as a methodology applied to incorporate and address wider global, ethical issues in order to achieve spiritual, personal and social transformation. Lots to think about..!

Reply
Jonathan Bradshaw
22/3/2022 08:12:36 pm

Hi Nick and thank you for posting this article. I was interested to see the link that you made between Test and Learn and action learning.

In my experience, Test and Learn shares similarities with evidence-based practice (EBT) in nursing. It draws on the scientific deductive method which can be valuable in closed-system work where actions and consequences are linear and predictable. For example, imagine we want to create condition Z, and we believe that X + Y will achieve it. Now imagine that we know what Z is, and what X is...but we don't know what Y is. We can use Test and Learn to experiment with options. Once Z result appears, we know what Y is.

One of the criticisms or limitations of this approach is that when applied to dynamically-complex systems: e.g. human families, teams or organisations, there are too many confounding variables to make accurate predictions for the future. Any number of variables could account for what we perceive as Y and Z. It's not mechanistic. In these types of situations, qualities such as intuition and shared sense-making often prove more fruitful than empirical evidence drawn from other experiments.

I think this is where, as you say, critically-reflective methods such as action learning could help.

Reply
Nick Wright
22/3/2022 08:27:36 pm

Thank you, Jonathan. I think that's an interesting observation concerning some of the similarities between Test and Learn and EBP. You reminded me of some supervision work I did with a PhD student involved in family systems work who, similarly critiqued EBP for reasons along the same sort of lines that you outlined so well here.

I agree that this is where action learning can add real value as a critically-reflective and critically-reflexive process. At its best, it enables participants to test hypotheses, assumptions, sense-making, conclusions drawn etc. (I guess a bit like peer review in the context of a scientific community) - drawing on questions from a diverse peer group.

I also find critiques of EBT from a social constructionist perspective particularly stimulating and useful. I love Kenneth Gergen's challenge in this short video (starting at 3 mins 05 secs), where he starts with an object that we would ordinarily recognise as a bottle of water: https://www.youtube.com/watch?v=-AsKFFX9Ib0&t=226s

Reply



Leave a Reply.

    ​Nick Wright

    ​I'm a psychological coach, trainer and OD consultant. Curious to discover how can I help you? ​Get in touch!

    Picture
    Like what you read? Simply enter your email address below to receive regular blog updates!
    Subscribe to Blog
    Picture
    Picture


    ​Archives

    January 2023
    December 2022
    November 2022
    October 2022
    September 2022
    August 2022
    July 2022
    May 2022
    April 2022
    March 2022
    February 2022
    January 2022
    December 2021
    October 2021
    September 2021
    August 2021
    July 2021
    June 2021
    May 2021
    April 2021
    March 2021
    February 2021
    January 2021
    December 2020
    November 2020
    October 2020
    September 2020
    August 2020
    July 2020
    June 2020
    May 2020
    April 2020
    March 2020
    February 2020
    January 2020
    December 2019
    November 2019
    October 2019
    August 2019
    July 2019
    June 2019
    May 2019
    April 2019
    March 2019
    February 2019
    January 2019
    December 2018
    November 2018
    October 2018
    September 2018
    August 2018
    July 2018
    June 2018
    May 2018
    March 2018
    February 2018
    January 2018
    December 2017
    November 2017
    October 2017
    September 2017
    August 2017
    July 2017
    June 2017
    May 2017
    April 2017
    March 2017
    January 2017
    December 2016
    November 2016
    October 2016
    September 2016
    August 2016
    July 2016
    June 2016
    May 2016
    April 2016
    March 2016
    February 2016
    January 2016
    December 2015
    October 2015
    September 2015
    July 2015
    June 2015
    May 2015
    April 2015
    February 2015
    January 2015
    December 2014
    November 2014
    August 2014
    July 2014
    May 2014
    April 2014
    March 2014
    February 2014
    December 2013
    November 2013
    August 2013
    July 2013
    June 2013
    May 2013
    April 2013
    March 2013
    February 2013
    January 2013
    December 2012
    November 2012
    October 2012
    July 2012
    June 2012
    May 2012
    April 2012
    March 2012
    February 2012
    January 2012
    December 2011
    November 2011
    October 2011
    September 2011
    August 2011
    July 2011
    June 2011
    May 2011
    April 2011
    March 2011
    February 2011

    Categories

    All
    Abc
    Ability
    Accountability
    Achievement
    Act
    Action
    Action Learning
    Activism
    Adaptability
    Adaptive
    Advent
    Adventure
    Africa
    Agency
    Ambiguity
    Angle
    Anticipation
    Anxiety
    Appraisal
    Appreciation
    Appreciative
    Appreciative Inquiry
    Approach
    Argyris
    Asia
    Assumption
    Assumptions
    Asylum
    Attachment
    Attention
    Attitude
    Audience
    Authenticity
    Authority
    Autonomy
    Avoidance
    Awareness
    Behaviour
    Being
    Belief
    Beliefs
    Bias
    Bible
    Body Language
    Boundaries
    Brainstorming
    Brand
    Calling
    Care
    Career
    Censorship
    Challenge
    Change
    Character
    Charity
    Child
    Choice
    Choose
    Christ
    Christian
    Christmas
    Clarity
    Client
    Climate
    Coach
    Coaching
    Coactive
    Cognition
    Cognitive
    Cognitive Behavioural
    Commitment
    Communication
    Community
    Compassion
    Competence
    Competencies
    Complexity
    Concepts
    Conflict
    Confluence
    Congruence
    Consciousness
    Construct
    Constructs
    Construe
    Consultancy
    Contact
    Content
    Context
    Contracting
    Contribution
    Control
    Conversation
    Corruption
    Counselling
    Counterintiution
    Counterintuition
    Countertransference
    Courage
    Craziness
    Creativity
    Credibility
    Crisis
    Critical Consciousness
    Critical Reflection
    Critical Reflective Practice
    Critical Reflexivity
    Critical Thinking
    Critique
    Cross
    Cross Culture
    Cross-culture
    Culture
    Curiosity
    Customer Care
    Customers
    Customer Service
    Death
    Deception
    Decision
    Deconstruction
    Defence
    Defences
    Deferred Gratification
    Definition
    Delusion
    Democracy
    Depression
    Determination
    Development
    Deviance
    Deviant
    Diagnosis
    Disaster
    Discernment
    Disclosure
    Discovery
    Discrimination
    Disruptive
    Dissent
    Dissident
    Dissonance
    Distinctiveness
    Distortion
    Diversity
    Dream
    Dynamic
    Dynamics
    Easter
    Ecology
    Edge
    Edi
    Education
    Effectiveness
    Efficiency
    Ego State
    Eliciting
    Emergence
    Emotion
    Emotional
    Emotional Intelligence
    Empathy
    Empowerment
    Encouragement
    Energy
    Engagement
    Environment
    Equality
    Eternity
    Ethics
    Ethiopia
    Evaluation
    Evidence
    Evocative
    Existential
    Existentialism
    Expectation
    Expectations
    Experience
    Experiment
    Experimentation
    Exploration
    Explore
    Exposure
    Facilitation
    Faith
    Fear
    Feedback
    Feeling
    Feminism
    Figure
    Filter
    Fit
    Flashback
    Focus
    Forgiveness
    Framework
    Freedom
    Freud
    Fun
    Future
    Gender
    Geopolitical
    Geopolitics
    Gestalt
    Global
    Goal
    Goals
    God
    Gospel
    Grace
    Grief
    Grit
    Ground
    Group
    Guidance
    Healing
    Health
    Hear
    Heidegger
    Hero
    Hope
    Human
    Human Givens
    Humanity
    Human Resources
    Human Rights
    Humility
    Humour
    Hypotheses
    Hypothesis
    Icon
    Ideation
    Identity
    Image
    Imagination
    Impact
    Impostor
    Inclusion
    Independence
    Influence
    INGO
    Initiative
    Injustice
    Innovation
    Inquiry
    Insecurity
    Insight
    Inspiration
    Instinct
    Integrity
    Intention
    Interdependence
    Interference
    International
    Interpretation
    Intimacy
    Introversion
    Intuition
    Invisible
    Jargon
    Jesus
    Journey
    Jungle
    Justice
    Keys
    Knowing
    Knowledge
    Labels
    Language
    Lateral Thinking
    Leader
    Leadership
    Learning
    Lesson
    Liberal
    Life
    Light
    Listening
    Logic
    Loss
    Love
    Management
    Manager
    Marathon
    Matrix
    Mbti
    Meaning
    Media
    Mediation
    Meetings
    Memory
    Mentoring
    Merit
    Metaphor
    Metaphysic
    Mindfulness
    Miracle
    Mirroring
    Misfit
    Mission
    Mode
    Morality
    Motivation
    Mystery
    Narrative
    Nazis
    Need
    Negotiation
    Neo-Nazi
    Networking
    News
    New Year
    Norm
    Norms
    Noticing
    Online
    Operations
    Opportunity
    Oppression
    Organisation
    Organisation Develoment
    Organisation Development
    Origin
    Pace
    Panic
    Paradigm
    Paradox
    Partnership
    Passion
    Pastoral
    Pattern Matching
    Peace
    People
    Perception
    Perfectionism
    Performance
    Perseverance
    Personal Constructs
    Personal Leadership
    Person Centred
    Perspective
    Phenomenology
    Phenomenon
    Philippines
    Philosophy
    Physicality
    Plan
    Plans
    Plato
    Play
    Plot
    Polarity
    Policy
    Politics
    Poor
    Positive
    Positive Psychology
    Posture
    Potential
    Potential#
    Poverty
    Power
    Practice
    Pragmatism
    Praxis
    Prayer
    Preference
    Preferences
    Prepare
    Presence
    Principles
    Priorities
    Priority
    Privilege
    Proactivity
    Problem Solving
    Process
    Professional
    Progressive
    Projection
    Projects
    Prompt
    Protection
    Providence
    Provocative
    Psychoanalysis
    Psychodynamic
    Psychodynamics
    Psychology
    Psychometrics
    Psychotherapy
    Purpose
    Quality
    Questions
    Race
    Radical
    Rational
    Rationale
    Rationalisation
    Rationality
    Reality
    Reason
    Reasoning
    Reconciliation
    Recruitment
    Reflect
    Reflection
    Reflective Practice
    Reflexivity
    Reframing
    Refugee
    Refugees
    Relationship
    Relationships
    Release
    Religion
    Representation
    Rescue
    Research
    Resilience
    Resonance
    Resourcefulness
    Responsibility
    Responsive
    Responsiveness
    Revelation
    Reward
    Rights
    Risk
    Role
    Role Model
    Rosabeth Moss-kanter
    Rules
    Sabbath
    Satire
    Satnav
    Saviour
    Schemata
    School
    Science
    Secure Base
    Security
    See
    Selection
    Selective Attention
    Self
    Sense Making
    Senses
    Sensitivity
    Serendipity
    Servant
    Shadow
    Significance
    Silence
    Sin
    Skills
    Social Construct
    Social Construction
    Social Constructionism
    Social Media
    Social Psychology
    Socrates
    Solution Focused
    Solutions
    Solutions Focus
    Solutions-focus
    Space
    Speed
    Spirit
    Spirituality
    Stance
    Stealth
    Stereotype
    Stereotypes
    Story
    Strategic
    Strategy
    Strengths
    Stress
    Stretch
    Structure
    Struggle
    Stuck
    Style
    Subconscious
    Subjectivity
    Success
    Suffering
    Supervision
    Support
    Survival
    Sustainability
    Symbol
    Symbolism
    Systems
    Systems Thinking
    TA
    Tactical
    Tactics
    Talent
    Teaching
    Team
    Teamwork
    Teenage
    Theology
    Theory
    Therapy
    Thinking
    Thought
    Time
    Touch
    Toys
    Traction
    Trade
    Tradition
    Training
    Transactional Analysis
    Transference
    Transformation
    Transition
    Transitional Object
    Trauma
    Trust
    Truth
    Uncertainty
    Unexpected
    Vallues
    Value
    Values
    Violence
    Visibility
    Vision
    Voice
    VUCA
    Vulnerability
    Vulnerable
    Waiting
    War
    Wealth
    Weird
    Wellbeing
    Will
    Willingness
    Window
    Wisdom
    Wonder
    Words
    World
    Worth
    Youth
    Zoom

    RSS Feed

Proudly powered by Weebly
  • Home
  • About
  • Services
  • Testimonials
  • Articles
    • Organisations and leadership
    • Learning and development
    • Coaching and counselling
  • Blog
  • e-Resources
  • News
  • Contact