The Power of Dark Data - Exploring the Role of Data Governance

Holistic Dark Data Governance is an emerging field reshaping how organisations manage and govern their data. Despite significant investments in digital transformation, many organisations and institutions still struggle to adopt effective dark data governance practices. In Texas, USA, universities have made substantial investments in digital initiatives to keep pace with the rapidly evolving technological landscape in higher education. A considerable portion of these investments have been directed toward managing dark data, improving data quality, governance, and integration, and adopting modern applications to enhance educational outcomes. However, the challenge of dark data governance is not confined to Texas; it is a global issue that remains under-researched and infrequently practiced. This research represents a pioneering effort to tackle the challenge of dark data governance at one of the leading universities in Texas. By advancing research in this emerging field, the study proposes comprehensive methods for deploying effective holistic dark data governance models within the university setting, enabling the institution to better manage and control dark data, and thereby achieve its operational and strategic goals. The study began with an analysis of existing data governance frameworks, revealing their limitations due to a lack of focus on dark data. In response, this research aims to develop a holistic model designed to establish, deploy, and sustain effective dark data governance systemic functions within the organisational Viable System Model (VSM) context. The proposed framework offers a comprehensive approach to addressing the challenges of dark data governance, surpassing the limitations of traditional data governance frameworks. Additionally, it equips universities with the knowledge and tools necessary to implement such models, empowering them to manage and control dark data effectively to achieve their objectives. A crucial step in developing the proposed model was understanding the systemic functions of holistic data governance. To support the model's conceptualization, the study employed Critical Success Factors, VSM, and Cybernetics theories. Given the complexity of the model, organisations and institutions need a method to assess their current state and define their requirements. To facilitate this, the research introduced a Maturity Model alongside an Assessment Matrix. These tools were validated and evaluated at a top university in Texas using mixed research methods, including both qualitative and quantitative approaches. The Delphi approach was used for validation, with expert representation from the university. The Assessment Matrix evaluation enables organisations and institutions to determine their maturity levels in holistic dark data governance and define the requirements for achieving their full viable level. To further assess the research findings and develop an improvement roadmap, the study incorporated a practical evaluation that examined the application of the assessment matrix across realistic case scenarios at three prominent universities in Texas, USA. These universities were actively implementing general data governance practices but had not yet adopted a comprehensive approach to dark data governance. This research significantly contributes to the academic debate on holistic dark data governance while offering practical frameworks that empower organisations and institutionsto enhance their holistic data governance practices and achieve their operational and strategic goals.