International Journal of Information Engineering and Electronic Business (IJIEEB)
IJIEEB Vol. 17, No. 2, 8 Apr. 2025
Cover page and Table of Contents: PDF (size: 1088KB)
Data Deduplication-based Efficient Cloud Optimisation Technique: Optimizing Cloud Storage through Data Deduplication
PDF (1088KB), PP.129-146
Views: 0 Downloads: 0
Author(s)
Ranga Kavitha
1
Mahaboob Sharief Shaik
1,*
Narala Swarnalatha
2
M. Pujitha
2
Syed Asadullah Hussaini
3
Samiullah Khan
4
Shamsher Ali
5
Index Terms
Efficient, Data, Deduplication, Optimizing, Storage, Performance, Cloud, Computing, Environment
Abstract
Effective storage management is crucial for cloud computing systems' speed and cost, given data's exponential increase. The significance of this issue has increased as the amount of data continues to increase at a disturbing pace. The act of detecting and removing duplicate data can enhance storage utilisation and system efficiency. Using less storage capacity reduces data transmission costs and enhances cloud infrastructure scalability. The use of deduplication techniques on a wide scale, on the other hand, presents a number of important obstacles. Security issues, delays in deduplication, and maintaining data integrity are all examples of difficulties that fall under this classification. This paper introduces a revolutionary method called Data Deduplication-based Efficient Cloud Optimisation Technique (DD-ECOT). Optimising storage processes and enhancing performance in cloud-based systems is its intended goal. DD-ECOT combines advanced pattern recognition with chunking to increase storage efficiency at minimal cost. It protects data during deduplication with secure hash-based indexing. Parallel processing and scalable design decrease latency, making it adaptable enough for vast, ever-changing cloud setups.The DD-ECOT system avoids these problems through employing a secure hash-based indexing method to keep data intact and by using parallel processing to speed up deduplication without impacting system performance. Enterprise cloud storage systems, disaster recovery solutions, and large-scale data management environments are some of the usage cases for DD-ECOT. Analysis of simulations shows that the suggested solution outperforms conventional deduplication techniques in terms of storage efficiency, data retrieval speed, and overall system performance. The findings suggest that DD-ECOT has the ability to improve cloud service delivery while cutting operational costs. A simulation reveals that the proposed DD-ECOT framework outperforms existing deduplication methods. DD-ECOT boosts storage efficiency by 92.8% by reducing duplicate data. It reduces latency by 97.2% using parallel processing and sophisticated deduplication. Additionally, secure hash-based indexing methods improve data integrity to 98.1%. Optimized bandwidth usage of 95.7% makes data transfer efficient. These improvements suggest DD-ECOT may save operational costs, optimize storage, and beat current deduplication methods.
Cite This Paper
Ranga Kavitha, Mahaboob Sharief Shaik, Narala Swarnalatha, M. Pujitha, Syed Asadullah Hussaini, Samiullah Khan, Shamsher Ali, "Data Deduplication-based Efficient Cloud Optimisation Technique: Optimizing Cloud Storage through Data Deduplication", International Journal of Information Engineering and Electronic Business(IJIEEB), Vol.17, No.2, pp. 129-146, 2025. DOI:10.5815/ijieeb.2025.02.07
Reference
[1]Yanamala, A. K. Y. (2024). Optimizing Data Storage in Cloud Computing: Techniques and Best Practices. International Journal of Advanced Engineering Technologies and Innovations, 1(3), 476-513.
[2]Adhab, A. H., &Hussien, N. A. (2022). Techniques of Data Deduplication for Cloud Storage: A Review.
[3]Rajkumar, K., &Dhanakoti, V. (2020, December). Methodological Methods to Improve the Efficiency of Cloud Storage by applying De-duplication Techniques in Cloud Computing. In 2020 2nd International Conference on Advances in Computing, Communication Control and Networking (ICACCCN) (pp. 876-884). IEEE.
[4]Cheng, G., Guo, D., Luo, L., Xia, J., &Gu, S. (2021). LOFS: A lightweight online file storage strategy for effective data deduplication at network edge. IEEE Transactions on Parallel and Distributed Systems, 33(10), 2263-2276.
[5]Malathi, P., &Suganthidevi, S. (2021, September). Comparative study and secure data deduplication techniques for cloud computing storage. In 2021 international conference on innovative computing, intelligent communication and smart electrical systems (ICSES) (pp. 1-5). IEEE.
[6]Akbar, M., Ahmad, I., Mirza, M., Ali, M., &Barmavatu, P. (2024). Enhanced authentication for de-duplication of big data on cloud storage system using machine learning approach. Cluster Computing, 27(3), 3683-3702.
[7]Sharma, P. C., Bansal, S., Raja, R., Thwe, P. M., Htay, M. M., &Hlaing, S. S. (2021). Concepts, strategies, and challenges of data deduplication. In Data Deduplication Approaches (pp. 37-55). Academic Press.
[8]Jeslin, J. G., & Kumar, P. M. (2022). Implementing an efficient data deduplication framework for cloud storage. Indian J. Comput. Sci. Eng, 13, 136-144.
[9]Periasamy, J. K., &Latha, B. (2021). Efficient hash function–based duplication detection algorithm for data Deduplication deduction and reduction. Concurrency and Computation: Practice and Experience, 33(3), e5213.
[10]Rasina Begum, B., &Chitra, P. (2023). SEEDDUP: a three-tier SEcurE data DedUPlication architecture-based storage and retrieval for cross-domains over cloud. IETE Journal of Research, 69(4), 2224-2241.
[11]Koushik, C. S. N., Choubey, S. B., Choubey, A., & Sinha, G. R. (2021). Data deduplication for cloud storage. In Data Deduplication Approaches (pp. 307-317). Academic Press.
[12]Nannai John, S., &Mirnalinee, T. T. (2020). A novel dynamic data replication strategy to improve access efficiency of cloud storage. Information Systems and e-Business Management, 18(3), 405-426.
[13]Vignesh, R., &Preethi, J. (2022). Secure data deduplication system with efficient and reliable multi-key management in cloud storage. Journal of Internet Technology, 23(4), 811-825.
[14]Ellappan, M., &Abirami, S. (2021). Dynamic prime chunking algorithm for data deduplication in cloud storage. KSII Transactions on Internet and Information Systems (TIIS), 15(4), 1342-1359.
[15]GnanaJeslin, J., & Mohan Kumar, P. (2022). Decentralized and privacy sensitive data de-duplication framework for convenient big data management in cloud backup systems. Symmetry, 14(7), 1392.
[16]Prajapati, P., & Shah, P. (2022). A review on secure data deduplication: Cloud storage security issue. Journal of King Saud University-Computer and Information Sciences, 34(7), 3996-4007.
[17]Mahesh, B., Pavan Kumar, K., Ramasubbareddy, S., &Swetha, E. (2020). A review on data deduplication techniques in cloud. Embedded Systems and Artificial Intelligence: Proceedings of ESAI 2019, Fez, Morocco, 825-833.
[18]Kumar, P. A., Pugazhendhi, E., & Lakshmi, K. V. (2022, January). Cloud Data Storage Optimization by Using Novel De-Duplication Technique. In 2022 4th International Conference on Smart Systems and Inventive Technology (ICSSIT) (pp. 436-442). IEEE.
[19]Tahir, M. U., Naqvi, M. R., Shahzad, S. K., & Iqbal, M. W. (2020, February). Resolving data de-duplication issues on cloud. In 2020 International Conference on Engineering and Emerging Technologies (ICEET) (pp. 1-5). IEEE.
[20]Chhabraa, N., &Balab, M. (2020). An optimized data duplication strategy for cloud computing: Dedup with ABE and bloom filters. International Journal of Future Generation Communication and Networking, 13(1), 824-834.
[21]Rajput, U., Shinde, S., Thakur, P., Patil, G., &Deokar, P. (2022). Analysis on deduplication techniques for storage of data in cloud. International Research Journal of Engineering and Technology, 9(5), 296-304.
[22]https://datasetsearch.research.google.com/search?src=0&query=Cloud%20Data%20Deduplication%20Strategies%20for%20Efficient%20Storage%20and%20Processing&docid=L2cvMTF2azZjY250ag%3D%3D