In most of our social life we communicate and relate to others. Successful interpersonal relating is crucial to physical and mental well-being and growth. This study, using the still-face paradigm, demonstrates that even human neonates (n = 90, 3-96 hr after birth) adjust their behavior according to the social responsiveness of their interaction partner. If the interaction partner becomes unresponsive, newborns will also change their behavior, decrease eye contact, and display signs of distress. Even after the interaction partner resumes responsiveness, the effects of the communication disturbance persist as a spillover. These results indicate that even newborn infants sensitively monitor the behavior of others and react as if they had innate expectations regarding rules of interpersonal interaction.