"In recent years, researchers have made considerable progress on the of inductive learning tasks, but for theoretical results to have impact on practice, they must deal with the average case. In this paper we present an average-case analysis of a simple algorithm that induces one-level decision trees for concepts defined by a single relevant attribute. Given knowledge about the number of training instances, the number of irrelevant attributes, the amount of class and attribute noise, and the class and attribute distributions, we derive the expected classification accuracy over the entire instance space. We then examine the predictions of this analysis for different settings of these domain parameters, comparing them to experimental results to check our reasoning."

“Science is a seamless web: each idea spins out to a new research task, and each research finding suggests a repair or an elaboration of the network of theory. Most of the links connecting the nodes are short, each attaching to its predecessors. Weaving our way through the web, we stop from time to time to rest and survey the view — and to write a paper or a book.”

“BACON.4 does not have heuristics for considering trigonometric functions of variables directly . Thus, in the run described here we simply told the system to examine the sines. In the following chapter we will see how BACON can actually arrive at the sine term on its own in a rather subtle manner.”

“In all of these cases, the error arose from accepting “loose” fits of a law to data, and the later, correct formulation provided a law that fit the data much more closely. If we wished to simulate this phenomenon with BACON, we would only have to set the error allowance generously at the outset, then set stricter limits after an initial law had been found.”

“New heuristic is used to prefer revision to premises that support relatively weak generalized beliefs.”

“In the scientist’s house are many mansions... Outsiders often regard science as a sober enterprise, but we who are inside see it as the most romantic of all callings. Both views are right. The romance adheres to the processes of scientific discovery, the sobriety to the responsibility for verification...”