An Open Source Real-Time Data Portal
DOI:
https://doi.org/10.13052/jicts2245-800X.235Keywords:
Open data, Real-time systems, Sensor networks, Data repository, Internet of Things, IoT, 5GAbstract
In the coming years there will be a rapid growth in the generation and processing of data from multiple sources. These sources, sometimes referred to as the Internet of Things (IoT), will consist of devices such as sensors, monitors and smartphones. This trend has been made possible because of (a) the adoption of IPv6 (allowing for such devices to be addressable), (b) enhancements in cellular technologies (in particular 5G) to better support short infrequent bursts of data transmissions and (c) the introduction of smartphones with a wide range of sensors and (d) the availability of easily deployed, low cost, low energy sensors (helped by the introduction of Raspberry Pi and Arduino processors). The real-time data generated by these devices can serve be used in several ways including being mined for important information and correlations, as well as use in web and mobile applications. This data, however, is often either proprietary or in a format that is not easily usable by real time applications. Furthermore, if an application developer needs to integrate (mash-up) data from multiple sources it is quite burdensome to develop interfaces. The present platforms for open data repositories are designed for static non real-time data. We propose a design and provide specifications for a platform that will accept real-time open data from multiple sources in multiple formats and make the data accessible in a standard format at user specified frequencies. The data is held for a finite period of time and digests made so that developers can also make use of historical data.
Downloads
References
About citysdk linked open data distribution api. available: http://citysdk .waag.org/about.CitySDK.
The world bank. open data essentials, available: http://data.worldbank .org/about/open-government-data-toolkit/knowledge-repository. The World Bank.
Directive 2003/98/ec of the european parliament and of the council of 17 November 2003 on the re-use of public sector information. available: http://ec.europa.eu/informationsociety/policy/psi/rules/eu/indexen.htm. European Commission, 2003.
Definition of open data and content. available: http://opendefinition.org/. Open Knowledge Foundation Network, 2004.
Memorandum for the heads of executive departments and agencies: Open government directive. The U.S. White House House, 2009.
M. Janssen A. Zuiderwijk and K. Jeffery. Towards an e-infrastructure to support the provision and use of open data. In Proc. Conference for e-Democracy and Open Government, Krems an der Donau, Austria, 2013.
M. Janssen A. Zuiderwijk and A. Parnia. The complementarity of open data infrastructures: An analysis of functionalities. In Proc. 14th Annual International Conference on Digital Government Research, 2013.
F. Corno and F. Razzak. Publishing lo(d)d: Linked open (dynamic) data for smart sensing and measuring environments. In Proc. 3rd International Conference on Ambient Systems, Networks and Technologies (ANT) / 9th International Conference on Mobile Web Information Systems (MobiWIS), Canada, 2012.
D. Le-Phuoc and M. Hauswirth. Linked open data in sensor data mashups. Digital Enterprise Research Institute, National University of Ireland, Galway, Ireland, 2009.
K. OHara. Transparency, open data and trust in government: Shaping the infosphere. In Proc. 3rd Annual ACM Web Science Conf., 2012.
H. Patni. and C. Henson. Linked sensor data. In Proc. Collaborative Technologies and Systems (CTS) Symposium, 2010.
D. De Roure P. Missier J. Ainsworth J. Bhagat P. Couch D. Cruickshank M. Delderfield I. Dunlop M. Gamble D. Michaelides S. Owen D. Newman S. Sufi S. Bechhofer, I. Buchan and C. Goble. Why linked data is not enough for scientists. Future Generation Computer Systems, 29:599–611, 2013.
