PPS-ADS: A Framework for Privacy-Preserved and Secured Distributed System Architecture for Handling Big Data

Mohd Abdul Ahad, Ranjit Biswas

Abstract


The exponential expansion of Big Data in 7V’s (velocity, variety, veracity, value, variability and visualization) brings forth new challenges to security, reliability, availability and privacy of these data sets. Traditional security techniques and algorithms fail to complement this gigantic big data. This paper aims to improve the recently proposed Atrain Distributed System (ADS) by incorporating new features which will cater to the end-to-end availability and security aspects of the big data in the distributed system. The paper also integrates the concept of Software Defined Networking (SDN) in ADS to effectively control and manage the routing of the data item in the ADS. The storage of data items in the ADS is done on the basis of the type of data (structured or unstructured), the capacity of the distributed system (or coach) and the distance of coach from the pilot computer (PC). In order to maintain the consistency of data and to eradicate the possible loss of data, the concept of “forward positive†and “backward positive†acknowledgment is proposed. Furthermore, we have incorporated “Twofish†cryptographic technique to encrypt the big data in the ADS. Issues like “data ownershipâ€, “data security, “data privacy†and data reliability†are pivotal while handling the big data. The current paper presents a framework for a privacy-preserved architecture for handling the big data in an effective manner.

Keywords


ADS; r-train; SDN; Twofish; OAuth 2.0; PC, DC; Coach.

Full Text:

PDF

References


R. Biswas, Atrain distributed system (ads): An infinitely scalable architecture for processing big data of any 4V, Computational Intelligence for Big Data Analysis Frontier Advances and Applications: edited by D.P. Acharjya, Satchidananda Dehuri and Sugata Sanyal, Springer International Publishing. Switzerland. 2015, 3-53.

R. Biswas, r-train (train) : A new flexible dynamic data structure, INFORMATION : An International Journal (Japan) 14 (4) (2011) 1231-1246.

R. Biswas, Heterogeneous data structure r-atrain, INFORMATION : An International Journal (Japan) 15 (2) (2012) 879-902.

B. A. Forouzan, Data Communication and Networking, 4th Edition, McGraw-Hill, 2007.

Ovsiannikov M, Rus S, Reeves D, Sutter P, Rao S, Kelly J. The quantcast file system. Proceedings of the 39th International conference on Very Large Scale Databases (VLDB Endowment); Trento. 2013. p.1092-1101.doi:10.14778/2536222.2536234

Ho S, Wu C, Zhou J, Chen W, Hsu C, Hsiao H, Chung Y. Distributed metaserver mechanism and recovery mechanism support in quantcast file system. IEEE Proceeding of 39th Annual Computer Software and Applications Conference (COMPSAC); USA. 2015. p. 758-63. doi:10.1109/ compsac.2015.109

Lakshman A, Cassandra MP. A decentralized structured storage system. Proceeding of ACM SIGOPS Operating Systems; USA. 2010. p. 35-40.

Dede E, Sendir B, Kuzlu P, Hartog J, Govindaraju M. An Evaluation of Cassandra for Hadoop. IEEE Proceeding of 6th International Conference on Cloud Computing; USA.2013. p. 494-501. doi:10.1109/cloud.2013.31

Luciani J, Brisk. Better Hadoop with Cassandra. Available from: http://www.datastax.com/wp-content/uploads/ 2011/07/Brisk_fully_distributed_Hadoop.pdf

Comparing the Hadoop Distributed File System (HDFS) with the Cassandra File System (CFS), White Paper, By Datastax Corporation. 2016. Available from: https://www.datastax.com/wp-content/uploads/2012/09/WP-DataStaxHDFSvsCFS.pdf

Shvachko K, Kuang H, Radia S, Chansler R. The Hadoop distributed file system. IEEE Proceeding of the 26th Symposium on Mass Storage Systems and Technologies (MSST); USA. 2010. p. 1-10.

Borthakur D. HDFS Architecture Guide, Apache Foundation.2016. Available from: https://hadoop.apache.org/ docs/r1.2.1/hdfs_design.pdf

Gupta L. HDFS – Hadoop Distributed File System Architecture Tutorial. Available from: http://howtodoinjava.com/big-data/hadoop/hdfs-hadoop-distributed-file-systemarchitecture-tutorial/

D Singh and C K Reddy, A survey on platforms for big data analytics, Journal of Big Data, 2014, 1:8

http://www.journalofbigdata.com/content/1/1/8

M. Chen et al., Big Data: Related Technologies, Challenges and Future Prospects, SpringerBriefs in Computer Science, DOI 10.1007/978-3-319-06245-7__4

Martin Strohbach, Jorg Daubert, Herman Ravkin, and Mario Lischka, Big Data Storage, Chapter 7, J.M. Cavanillas et al. (eds.), New Horizons for a Data-Driven Economy 2016.

J.K. Park, J. Kim, Big data storage configuration and performance evaluation utilizing NDAS storage systems, AKCE International Journal of Graphs and Combinatorics (2017), https://doi.org/10.1016/j.akcej.2017.09.003.

Wei Zhou, Dan Feng, Zhipeng Tan, Yingfei Zheng, Improving Big Data Storage Performance in Hybrid Environment, Journal of Computational Science, (2017) http://dx.doi.org/10.1016/j.jocs.2017.01.003

R. Kemp, Legal aspects of managing big data, Computer Law and Security Review, 30 (5) (2014), pp. 6482-491. Elsevier. https://doi.org/10.1016/j.clsr.2014.07.006

Bruce Schneier, John Kelsey, Twofish: A 128-bit block cipher, AES Round 1 Technical Evaluation CD-1: Documentation, National Institute of Standards and Technology.

B. Schneier, J. Kelsey, N. Ferguson, The Twofish Encryption Algorithm, A 128-Bit Block Cipher, John Wiley & Sons, 1999.

https://oauth.net/2/

Ryan Boyd, Getting Started with OAuth 2.0 2012, Published by O’Reilly Media, Inc., 1005 Gravenstein Highway North, Sebastopol, CA 95472.

S. A. Diego Kreutz, Fernando M. V. Ramos, S. Uhlig, Software-defined networking: A comprehensive survey, Proceedings of the IEEE 103 (1) (2015) 14-76.

Introduction to software defined networking (SDN), Washington University in Saint Louis, Url : http://www.cse.wustl.edu/ jain/cse570-13/.

W. Braun, M. Menth, , Software-defined networking using openflow: Protocols, applications and architectural design choices, Future Internet 6 (2014) 302-336.

Software-defined networking: The new norm for networks, Open Networking Foundation (ONF),White Paper (2012) 1-12.




DOI: http://dx.doi.org/10.18517/ijaseit.8.4.5465

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development