Are the No Free Lunch theorems useful for anything?

I have been thinking about the No Free Lunch (NFL) theorems lately, and I have a question which probably every one who has ever thought of the NFL theorems has also had. I am asking this question here, because I have not found a good discussion of it anywhere else.

The NFL theorems are very interesting theoretical results which do not hold in most practical circumstances, because a key assumption of the NFL theorems is rather strong. This assumption is, roughly speaking, that the performance of an algorithm is averaged over all problem instances drawn from a uniform probability distribution. In realistic applications the problems an algorithm typically encounters are NOT drawn from a uniform distribution, and are instead drawn from what is likely a very interesting and complicated distribution specific to the general problem setting.

So, while the NFL theorems are quite interesting results, do they have any practical implications? Or are they merely theoretical results?

EDIT: By practical implications, I mean novel or improvements over existing algorithms, improved hyper-parameter selection, and things of that nature. I would even be interested to learn of NFL-inspired theorems that do apply to realistic search/optimization/learning problems.

• See this question: cs.stackexchange.com/questions/21758/… , the answers go into the usage of NFL. Also, note that the NFL theorems are 'negative' results, so all practical use of them is limited to saying we cannot achieve something. Some call this inherently theoretical. You should specify what you mean by 'theoretical result'. Commented Feb 16, 2018 at 18:51
• @Discretelizard none of the responses go into applications, they are concerned with interpretations. As for the distinction between a theoretical and a practical result, I am relying on colloquial understandings of the terms. Commented Feb 16, 2018 at 21:35
• @D.W. It is admittedly a broad question, but I would be happy to have ANY implication pointed out to me for ANY of the NFL theorems. After spending some time on searching myself, I am starting to doubt whether there are any practical implications whatsoever. Commented Feb 16, 2018 at 21:35
• I feel like you have essentially already answered your own question. Indeed, real-world inputs are arguably not arbitrary but drawn from some specific distribution since they model human interaction, a physical process, or so on.
– Juho
Commented Feb 17, 2018 at 9:36
• @SurgicalCommander Well, I most certainly don't know it's precise colloquial meaning in this context. Given that your background is in Physics, while most people here have background in CS or math, the meaning could very well differ between you and the potential answer-er. Commented Feb 17, 2018 at 10:19