### Enhanced Manhattan-based Clustering using Fuzzy C-Means Algorithm for High Dimensional Datasets

#### Abstract

The problem of mining a high dimensional data includes a high computational cost, a high dimensional dataset composed of thousands of attribute and or instances. The efficiency of an algorithm, specifically, its speed is oftentimes sacrificed when this kind of dataset is supplied to the algorithm. Fuzzy C-Means algorithm is one which suffers from this problem. This clustering algorithm requires high computational resources as it processes whether low or high dimensional data. Netflix data rating, small round blue cell tumors (SRBCTs) and Colon Cancer (52,308, and 2,000 of attributes and 1500, 83 and 62 of instances respectively) dataset were identified as a high dimensional dataset. As such, the Manhattan distance measure employing the trigonometric function was used to enhance the fuzzy c-means algorithm. Results show an increase on the efficiency of processing large amount of data using the Netflix ,Colon cancer and SRCBT an (39,296, 38,952 and 85,774 milliseconds to complete the different clusters, respectively) average of 54,674 milliseconds while Manhattan distance measure took an average of (36,858, 36,501 and 82,86 milliseconds, respectively)Â 52,703 milliseconds for the entire dataset to cluster. On the other hand, the enhanced Manhattan distance measure took (33,216, 32,368 and 81,125 milliseconds, respectively) 48,903 seconds on clustering the datasets. Given the said result, the enhanced Manhattan distance measure is 11% more efficient compared to Euclidean distance measure and 7% more efficient than the Manhattan distance measure respectively.

#### Keywords

#### Full Text:

PDF#### References

N. Raksha and R. Alankar, â€œDetection of fuzzy duplicates in high dimensional datasets,â€ 2016 Int. Conf. Adv. Comput. Commun. Informatics, ICACCI 2016, pp. 1423â€“1428, 2016.

Y. G. Jung, M. S. Kang, and J. Heo, â€œClustering performance comparison using K- means and expectation maximization algorithms,â€ Biotechnol. Biotechnol. Equip. ISSN1310-2818, vol. 2818, no. October, 2015.

Z. Cebeci and F. Yildiz, â€œComparison of K-Means and Fuzzy C-Means Algorithms on Different Cluster Structures,â€ J. Agric. Informatics, vol. 6, no. 3, pp. 13â€“23, 2015.

R. Winkler, F. Klawonn, and R. Kruse, â€œProblems of Fuzzy c-Means Clustering and Similar Algorithms with High Dimensional Data Sets,â€ Challenges Interface Data Anal. Comput. Sci. Optim., pp. 1â€“8, 2012.

S. Pandit and S. Gupta, â€œA COMPARATIVE STUDY ON DISTANCE MEASURING,â€ Int. J. Res. Comput. Sci., vol. 2, no. 1, pp. 29â€“31, 2011.

T. K. Mohana, V. Lalitha, L. Kusuma, N. Rahul, and M. Mohan, â€œVarious Distance Metric Methods for Query Based Image Retrieval,â€ vol. 7, no. 3, pp. 5818â€“5821, 2017.

M. Khan and T. Shah, â€œA copyright protection using watermarking scheme based on nonlinear permutation and its quality metrics,â€ Neural Comput. Appl., vol. 26, no. 4, pp. 845â€“855, 2014.

U. Fayyad, G. Piatetsky-shapiro, and P. Smyth, â€œFrom Data Mining to Knowledge Discovery in,â€ vol. 17, no. 3, pp. 37â€“54, 1996.

J. Zhang and M. Pan, â€œA high-dimension two-sample test for the mean using cluster,â€ Comput. Stat. Data Anal., vol. 97, pp. 87â€“97, 2016.

L. Zhou, â€œPreprocessing Method before Data Compression of Cloud Platform,â€ pp. 1223â€“1227, 2017.

M. A. Chaudhari, P. M. Phadatare, P. S. Kudale, R. B. Mohite, and R. P. Petare, â€œPreprocessing of High Dimensional Dataset for Developing Expert IR System,â€ pp. 417â€“421, 2015.

Z. Marzuki and F. Ahmad, â€œData Mining Discretization Methods and Performances Data Mining Discretization Methods and Performances,â€ no. December, pp. 3â€“6, 2014.

N. A. Mian and N. A. Zafar, â€œKey Analysis of Normalization Process using Formal Techniques in DBRE,â€ 2010.

C. Ordonez, â€œData Set Preprocessing and Transformation in a Database System,â€ vol. 15, no. 4, pp. 1â€“19, 2011.

Z. Wang, N. Zhao, W. Wang, R. Tang, and S. Li, â€œA Fault Diagnosis Approach for Gas Turbine Exhaust Gas Temperature Based on Fuzzy C-Means Clustering and Support Vector Machine,â€ Math. Probl. Eng., vol. 2015, pp. 1â€“11, 2015.

N. Grover, â€œA study of various Fuzzy Clustering Algorithms,â€ Int. J. Eng. Res., vol. 5013, no. 3, pp. 177â€“181, 2014.

L. H. Son, â€œGeneralized picture distance measure and applications to picture fuzzy clustering,â€ Appl. Soft Comput. J., pp. 1â€“12, 2016.

C. C. Aggarwal, A. Hinneburg, and D. A. Keim, â€œOn the Surprising Behavior of Distance Metrics in High Dimensional Space,â€ pp. 420â€“434, 2001.

A. B. Rathod, â€œA Comparative Study on Distance Measuring Approches for Permutation Representations,â€ pp. 251â€“255, 2016.

DOI: http://dx.doi.org/10.18517/ijaseit.9.3.6005

### Refbacks

- There are currently no refbacks.

Published by INSIGHT - Indonesian Society for Knowledge and Human Development