Psychological intuitions about natural category structure do not always correspond to the true structure of the world. The current study explores young children's responses to conflict between intuitive structure and authoritative feedback using a semi-supervised learning (Zhu et al., 2007) paradigm. In three experiments, 160 children between the ages of 4 and 8 learned a one-dimensional decision criterion for distinguishing yummy and yucky "alien fruits". They then categorized a large number of new fruits without corrective feedback. The distribution of the new fruits was manipulated such that the natural boundary in the stimuli did not always correspond to the learned boundary. Children changed their decision criteria to reflect the structure of the new stimuli, effectively unlearning the original boundary. Younger children were especially swayed by the distributional information, being relatively insensitive to feedback that the original non-natural boundary was, in fact, still correct. Results are discussed in terms of children's ability to selectively attend to specific information (i.e. feedback vs. distribution), and their interests in forming generally useful representations of experience.