Our efficacy & research capabilities

Lifecycle
stage

Description

Efficacy questions

Research questions

Idea

Pitching a new product

What are the high-level intended learner outcomes?

What learning science research exists to support the idea of the product?

Explore

Developing the product

What are the specific intended learner outcomes?

What metrics, baselines, and targets are associated with the learner outcomes?

How will we design the product to make sure we achieve the learner outcomes?

What learning science research exists to support the design of the product?

How can we work with educators and students to improve the design of the product?

Validate

Testing the product

What evidence is there that different designs for the product might lead to the intended learner outcomes?

Is the product on track to achieve the learner outcomes?

What learning science experiments would inform improvements to the design of the product?

What leading indicators of the learner outcomes can we examine in efficacy trials?

Grow

Improving the product

What evidence is there that approaches to implementing the product have a positive effect on learner outcomes?

Are customers using the product as intended?

What implementation research is happening to improve customer experience and further improve the design?

What correlations exist between product design, product usage, and learner outcomes?

Sustain

Supporting the product

What evidence is there that the product’s effect on learner outcomes is increasing?

Are customers still using the product as intended?

What causal links exist between use of the product and learner outcomes?

Retire

Divesting or closing the product

Are there other products that deliver the same learner outcomes as this one?