When Does Design Thinking Work? A Convergence Theorem for the Iterate-Test Core
Organizations: Institute of Informatics, Kozminski University, ul. Jagiellońska 57/59, 03-301 Warsaw, Poland · Faculty of Mathematics and Applied Sciences, Rzeszów University of Technology, al. Powstańców Warszawy 12, 35-959 Rzeszów, Poland · Department of Complex Systems, Rzeszów University of Technology, al. Powstańców Warszawy 12, 35-959 Rzeszów, Poland
Abstract
Design thinking is widely taught as an iterative loop of ideation, prototyping, and testing, yet conditions under which such a loop must improve innovation outcomes remain unspecified. Taking problem framing as given, we formalize the iterate-test core as search over a finite prototype space whose utility is learned through noisy evaluations. We prove that the prototype a team believes to be best converges almost surely to a local optimum under five conditions: finite framing, local ideation, non-summable discovery rates, unbiased repeated testing, and retention of tested prototypes. Bounded test bias or criteria drift degrades the guarantee by a bounded amount, and multiple stakeholders yield convergence to a locally Pareto-optimal set. Finite-horizon simulations across three landscape classes (additive valuation, NK rugged landscapes, and clustered modular architectures) show that asymptotic limits are rarely reached in practice. Teams face an optimizer's curse, overestimating their chosen concept by 4-8% and frequently discarding superior prototypes. Testing every prototype once proves to be the worst allocation; optimal performance requires building one to three prototypes per five tests and repeatedly re-testing leaders. Pre-screening concepts yields greater performance gains than tuning testing policies.
Figures & tables
| , | features admitted by the frame; prototype space |
|---|---|
| , | utility of prototype , in ; its maximum |
| variants of that ideation can reach in one step | |
| , | prototypes built and tested by round ; their eventual set |
| history up to the end of round | |
| belief about after round ( under biased tests) | |
| , | the favourite, , and the belief about it |
| Assumption | Changed element | Main | DVF family | NK family |
|---|---|---|---|---|
| Baseline | — | |||
| Local ideation | variants within 1 feature | |||
| variants within 3 features | ||||
| unbounded variants | ||||
| Generativity | 1 idea per round | |||
| 2 ideas per round |
| Main | DVF family | NK family | |||
|---|---|---|---|---|---|
| Policy | shipped | shipped | diff. | shipped | diff. |
| Random search | |||||
| Hill-climbing | |||||
| -greedy | |||||
| UCB | |||||
| Thompson sampling | |||||
| Cost of a reframe (rounds) | |||||
|---|---|---|---|---|---|
| Policy | 4 | 10 | 20 | 35 | Reframes |
| Never | 0.694 | 0.694 | 0.694 | 0.694 | 0 |
| Every 15 rounds | 0.700 | 0.697 | 0.693 | 0.694 | 5.0 |
| Every 25 rounds | 0.703 | 0.698 | 0.698 | 0.698 | 4.0 |
| Every 40 rounds | 0.702 | 0.704 | 0.703 | 0.698 | 2.0 |
| Once, after 75 rounds | 0.701 | 0.702 | 0.699 | 0.699 | 1.0 |
| Assumption | In practice | When it fails | Simulated departure and its cost |
|---|---|---|---|
| Finite frame | The brief and the vocabulary of features stay fixed during an epoch | No fixed space in which an optimum is defined | Not simulated |
| Local ideation | New ideas are variants of what has been built | With unbounded jumps the limit is global but progress is slower | Unbounded variants: to |
| Persistent generativity | The team keeps proposing variants, even late | The process can stop short of a local optimum | One idea per round in place of five: to |
| Unbiased, repeated testing | Tests can contradict the team; favourites are tested again | A lucky prototype can stay on top; under bias the result is only -locally optimal | No prototype tested twice: to . Bias : to |
| Retention | Rivals to the favourite are kept | The best prototype found can be lost | Only the favourite kept: to |
Last-Iterate Convergence
Last-iterate convergence studies whether an algorithm’s final update approaches an optimizer or equilibrium, rather than only its average.
See all 47 papers