Big Data Modern Stack for District Government

Mutiara Auliya Khadija

Abstract:

Data is the new oil for all circles, including the district government. The more information systems that are used, more data will be collected both in the form of structured and unstructured data which is often called Big Data. The obstacle faced by the district government in handling Big Data is that the data is stored in different stores. Therefore the analysis process becomes difficult. For this reason, it is time for the district government to implement the Big Data Modern Stack that refers to a collection of technologies that comprise a cloud-native data platform. Big Data Modern Stack will combine cloud technology with on-premises technology in the district government system. So that the district government can store all the data collected in its own data warehouse. This research explores how Big Data Modern Stack could be implemented for district data system. We propose ELT (Extract, Load, Transform) using Fivetran for data ingestion from various forms of stored data, then unite all data into a data warehouse to be displayed in a Business Intelligence Tool. The paper concludes that this modern big data stack approach can unite some of the data owned by the district government. So that it can be used to support the decision making process for related stakeholders.