David Wolpert
David H. Wolpert is an American mathematician, physicist and computer scientist. He is a professor at Santa Fe Institute. He is the author of three books, three patents, over one hundred refereed papers, and has received numerous awards. His name is particularly associated with a group of theorems in computer science known as "no free lunch".
Career
David Wolpert took a B.A. in Physics at Princeton University (1984), then attended the University of California at Santa Barbara where he took the degrees of M.A. (1987) and Ph.D. (1989).
Between 1989 and 1997 he pursued a research career at Los Alamos National Laboratory, IBM, TXN Inc. and Santa Fe Institute.
From 1997 to 2011 he worked as senior computer scientist at NASA Ames Research Center, and became visiting scholar at the Max Planck Institute.
He spent the year 2010-11 as Ulam Scholar at the Center for Nonlinear Studies at Los Alamos.[1]
He joined the faculty of Santa Fe Institute in 2011 and became a professor there in September 2013. [2]
His research interests have included statistics, game theory, machine learning applications, information theory, optimization methods and complex systems theory.
"No free lunch"
One of Wolpert’s most discussed achievements is known as No free lunch in search and optimization. [3][4][5] [6] By this theorem, all algorithms for search and optimization perform equally well averaged over all problems in the class with which they are designed to deal. The theorem holds only under certain conditions that are not often encountered precisely in real life, [7][8][9] although it has been claimed that the conditions can be met approximately.[10] The theorem lies within the domain of computer science, but a weaker version known as the “folkloric no free lunch theorem” has been drawn upon by William A. Dembski in support of intelligent design. [11] This use of the theorem has been rejected by Wolpert himself[12] and others[13][14]
Limitation on knowledge
Wolpert has put forward a formal argument to show that it is in principle impossible for any intellect to know everything about the universe of which it forms a part, in other words disproving "Laplace's demon". [15] This has been seen as an extension of the limitative theorems of the twentieth century such as those of Heisenberg and Gödel.[16]
Academic positions
- Senior member of IEEE
- Research Associate of Infometrics Institute, American University
- Associate Editor, Advances in Complex Systems
- Member of Editorial Board – Journal of Artificial Intelligence Research
- Member on multiple NSF panels
Awards
- Princeton University Physics Department Kusaka Prize
- Best Paper Award for IEEE Transactions on Evolutionary Computation, Vols .1 & 2
- Superior Accomplishment Award for NASA Code IC for 1999
Publications
- Wolpert, D.H. (ed.), The Mathematics of Generalization, Addison-Wesley, 1994. ISBN 0201409852
- Wolpert, D.H. An Incompleteness Theorem for Calculating the Future, SFI Economics Program, Santa Fe Institute, 1996.
- Tumer, K. and Wolpert, D.H. (ed.), Collectives And The Design Of Complex Systems, Springer, 2004. ISBN 0387401652
- Guy, T.V., Karny M., Wolpert D.H. (eds.), Decision making with imperfect decision makers, Springer, 2012. ISBN 3642246478
- Wolpert, D.H. Theory of Collective Intelligence, NASA Technical Reports Server, 2013. ISBN 1289283427
References
- ↑ CNLS Ulam Scholar
- ↑ David Wolpert, Santa Fe Institute
- ↑ Wolpert, D.H., Macready, W.G. (1995), No Free Lunch Theorems for Search, Technical Report SFI-TR-95-02-010 (Santa Fe Institute).
- ↑ Wolpert, D.H., Macready, W.G. (1997), No Free Lunch Theorems for Optimization, IEEE Transactions on Evolutionary Computation, 1, 67.
- ↑ Wolpert, David (1996), The Lack of A Priori Distinctions between Learning Algorithms, Neural Computation, pp. 1341–1390.
- ↑ David H. Wolpert, What the No Free Lunch Theorems Really Mean; How to Improve Search Algorithms, SFI Working Paper 2012-10-017, Santa Fe Institute 2012
- ↑ Streeter, M. (2003) Two Broad Classes of Functions for Which a No Free Lunch Result Does Not Hold, Genetic and Evolutionary Computation – GECCO 2003, pp. 1418–1430.
- ↑ Igel, C., and Toussaint, M. (2004) A No-Free-Lunch Theorem for Non-Uniform Distributions of Target Functions, Journal of Mathematical Modelling and Algorithms, 3, pp. 313–322.
- ↑ English, T. (2004), No More Lunch: Analysis of Sequential Search, Proceedings of the 2004 IEEE Congress on Evolutionary Computation, pp. 227–234.
- ↑ S. Droste, T. Jansen, and I. Wegener. 2002. Optimization with randomized search heuristics: the (A)NFL theorem, realistic scenarios, and difficult functions, Theoretical Computer Science, vol. 287, no. 1, pp. 131–144.
- ↑ Dembski, W. A. (2002) No Free Lunch, Rowman & Littlefield, ISBN 0-7425-1297-5
- ↑ Wolpert, D. (2003), William Dembski's treatment of the No Free Lunch theorems is written in jello, Talk Reason
- ↑ Perakh, M. (2003), The No Free Lunch Theorems and Their Application to Evolutionary Algorithms, Talk Reason.
- ↑ Richard Wein (2002), Not a Free Lunch But a Box of Chocolates (Sect. 5.3), The TalkOrigins Archive
- ↑ David H. Wolpert (2008). "Physical limits of inference". Physica D. 237 (9): 1257–1281. arXiv:0708.1362
. doi:10.1016/j.physd.2008.03.040. full text - ↑ Graham P. Collins, Within Any Possible Universe, No Intellect Can Ever Know It All, Scientific American, 16 February 2009