[snip]
I thought they were rather rhetorical, but it will be fun to answer them.

Originally Posted by
Nereid
On your "babble-mouthed technician", would it be fair to say that a direct implication of this is the more nonsense we generate, the greater the chances of finding some incredible breakthrough somewhere in amongst it would be?
Would we have discovered penicillin if someone had not left the window open?
Vulcanized rubber if Goodyear would not have been a sloppy cook?
Recognizing patterns in what appears to be chaos is the very heart of the discovery process. Our theories do not jump out and tell us when they are wrong; and if the analystical process is always tailored around the assumption that they are right, we won't find the cracks in the theories.
Just the other day I was ask to help debug an infrared measurement system that was being kludgy. I got frustrated with the messy peripherial lab cords and stuff in my way, and took the device to my office to get it working. It worked almost immediately, but when I took it back to the lab, even after the lab was cleaned up, it still wouldn't work. With just a little more detective work we found the automatic lights in the room used an infrared beam to detect motion, and this was scrambling the reciever. In this case chaos indirectly contributed to the solution - who knows how long I would have been stuck if the lab hadn't been messy and I never moved the device.
I can give many more examples - The scientist who was trying to make antifreeze and produced a goo that plugged his drain so bad he realized he had invented the first synthetic rubber.
Also, when your "babble-mouthed technician" did "propose something ingenius" [sic], did the tech (the author) recognise that it was in any way any different from any other of "stupid, ill-informed ideas" he'd proposed before?
The fact that an engineer grabbed the idea and ran with it made it obvious. In this case, he did NOT give the technician credit, which I think was extremely callous; but it would be wrong to give more credit to the 'random idea generator' than the engineer who made the system work. If he ran with every idea suggested by the tech, he would have run himself out of a job before the good idea emerged.
Much of the time, we give more credit to those who carefully log and descibe a new discovery that the often unorganized genius (or fool - sometimes it is hard to tell the difference) who spawned the discovery, such as the greater credit given to Marconi than Tesla for the development of radio transmission.
One of the most important discoveries in the development of the atomic bomb was the observation that if neutrons are slowed down, they engage in more collisional reactions. This surprising development was the result of careful experimentation, but also a willingness of the investigators to expect and inspect unexpected results; and use these results to prepare a new list of expectations.
I don't think (many) astrophysical researchers were prepared to look at the failure of supernova to demonstrate the expected slowing in the rate of expansion of the universe; and conclude there may be fundamental flaws in both theory and methodology. They simply threw in a new variable and started writing proposals to study Dark Energy. This has to change.