In the past decade, digitisation and the adoption of digital technology requiring data systems has become widely spread in Africa. With this comes the complexities of how data is collected, processed, shared, and utilised, including issues of data privacy and protection. Countries have adopted several laws and policies designed to promote access, address privacy and personal data protection concerns as well as stimulate the uptake of data-based initiatives. Trust plays a significant role in building data systems that are accurate as people are more willing to share their personal data with data controllers. Like other African countries, Ghana has enacted several laws and policies, including the Data Protection Act, 2012 (Act 843), The National Identification Register (Amended) Act, 2017 (Act 750), and The Cybersecurity Act, 2020 (Act 1030). Ghana has also embarked on several massive data collection programmes, including the mandatory SIM Card registration and the issuance of national IDs. However, the data collection programmes have been hit by high levels of apathy from the public, and this has been attributed to the low levels of trust in public institutions that collect and control data. The objective of this research therefore is to investigate the sources and impact of this low level of trust among Ghanaian public. The research also explores the possible ways public trust can be bolstered by data governance systems. The study employed quantitative surveys and qualitative in-depth interviews for data collections. The study found a prevalence of mistrust in public data controllers in Ghana. The main reason for the mistrust stemmed from the lack of public education and awareness among data subjects as well as personal experiences relating to data breaches by data controllers.