In this paper, an attempt was made to locate the role of internationalisation in African Higher Education Institutions (HEIs). It is argued that comprehensive international, intercultural, and global dimensions in the affairs of African tertiary institutions provide for a more nuanced and diversified higher education landscape. Through a desk study approach, dwelling mainly on existing literature, the paper examines the issues of internationalisation from the perspectives of diversity and inclusion, as well as the roles of the relevant key players within those institutions to practically deliver internationalisation strategies that will put the institution on a global pedestal while remaining locally and regionally relevant. More importantly, strategies for achieving comprehensive internationalisation are discussed drawing inferences from literature and documentary sources. The interrogation of these sources in relation to the expectations of the current and future HEIs to remain socially relevant and sustainable is carried out. HEIs in Africa must contribute to socio-economic change and engage with their quad-helix and eco-system partners to ensure that high end skills training, knowledge production, entrepreneurship and innovation are accelerated. In so doing, African HEIs must embrace diversity in its fullness including welcoming differences in gender, race, culture, nationality and providing platforms of engagement that allow for inclusion, and breaking silos to allow for a nuanced agenda of internationalisation.