Active participation in the information society requires the ability to find some order in the chaotic nature of the Web and not to get lost within the endemic presence of inaccurate, misleading, biased and false information. This article presents an approach to Information Problem Solving (IPS)--that is, finding, understanding and assessing information on the Web--and discusses a study carried out in an Italian secondary school, using an experimental and a control group. The study aimed at exploring how to best foster IPS skills, and observing whether and how IPS activities could promote the development of more general learning dispositions and competences. After a period of training with IPS activities, the experimental group showed different dispositions towards learning from a text and engaging with open-ended questions. Despite serious limitations in the depth of analysis, most students were able to reach acceptable solutions; at the same time, they felt empowered and developed an embryonic critical attitude on which it might be possible to build further.