International Journal of Education and Management Engineering (IJEME)
IJEME Vol. 14, No. 4, 8 Aug. 2024
Cover page and Table of Contents: PDF (size: 1099KB)
Author(s)
Amadou Diabagate
1
Yazid Hambally Yacouba
2,*
Jean-Marc Owo
1
Adama Coulibaly
1
Index Terms
Simulation, Data Aggregation, Smart Metering, Electricity Consumption, Jump Process
Abstract
The large volume of electricity consumption data calls for the aggregation of this data. The implementation of aggregation methods is therefore a major concern to which an answer is given by presenting a case of aggregation of electricity consumption data using the jump process. A data set made it possible to carry out simulations and to present the results obtained for the daily, monthly and annual aggregations. The principle of using the jump process for the approval of these data is highlighted. This work is a concrete presentation of a simulation for the aggregation of electricity consumption data in a network of wireless sensors that can constitute a network of smart meters. The approach of this work consists in using aggregation methods to reduce the flow of data exchanges in wireless sensor networks. In fact, this work highlights several interesting properties that justify the choice of the jump process including flexibility, modeling of rare events, management of uncertainties adaptability to non-stationary data management of fluctuations in demand, consideration of volatility effects and scalability. Many significant impacts are expected, including improving network stability, optimizing resource management, reducing operational costs, integrating renewable energies, and data-driven decision-making. The jump process also presents limitations including modeling complexity, model calibration, computational complexity, interpretability of results, uncertainty management.
Cite This Paper
Amadou Diabagaté, Yazid Hambally Yacouba, Jean-Marc Owo, Adama Coulibaly, "Towards an Intelligent Electricity Data Management", International Journal of Education and Management Engineering (IJEME), Vol.14, No.4, pp. 36-48, 2024. DOI:10.5815/ijeme.2024.04.04
Reference
[1]Gupta, R.; Chaturvedi, K.T. Adaptive Energy Management of Big Data Analytics in Smart Grids. Energies 2023, 16, 6016. https://doi.org/10.3390/en16166016.
[2]Chen, Z.; Amani, A.M.; Yu, X.; Jalili, M. Control and Optimisation of Power Grids Using Smart Meter Data: A Review. Sensors 2023, 23, 2118. https://doi.org/10.3390/s23042118.
[3]S. R. Selva Jeevitha. Making ease of smart grid communication through compression of power system disturbance signals, 21 July 2023, PREPRINT (Version 1) available at Research Square [https://doi.org/10.21203/rs.3.rs-3172718/v1].
[4]Soham Dutta, Sourav Kumar Sahu, Millend Roy, Swarnali Dutta, A data driven fault detection approach with an ensemble classifier based smart meter in modern distribution system, Sustainable Energy, Grids and Networks, Volume 34, 2023, 101012, ISSN 2352-4677, https://doi.org/10.1016/j.segan.2023.101012.
[5]S. Banik, S. K. Saha, T. Banik and S. M. M. Hossain, "Anomaly Detection Techniques in Smart Grid Systems: A Review," 2023 IEEE World AI IoT Congress (AIIoT), Seattle, WA, USA, 2023, pp. 0331-0337, doi: 10.1109/AIIoT58121.2023.10174485.
[6]Lulu Wen, Kaile Zhou, Shanlin Yang, Lanlan Li, Compression of smart meter big data: A survey, Renewable and Sustainable Energy Reviews, Volume 91, 2018, Pages 59-69, ISSN 1364-0321, https://doi.org/10.1016/j.rser.2018.03.088.
[7]Lee J, Yoon S, Hwang E. Frequency Selective Auto-Encoder for Smart Meter Data Compression. Sensors. 2021; 21(4):1521. https://doi.org/10.3390/s21041521
[8]Sung, Tien-Wen et al. ‘Optimizing Data Aggregation Point Location with Grid-based Model for Smart Grids’. 1 Jan. 2022 : 3189 – 3201.
[9]Rajagopalan, Ramesh and Varshney, Pramod K., "Data aggregation techniques in sensor networks: A survey" (2006). Electrical Engineering and Computer Science - All Scholarship. 22. https://surface.syr.edu/eecs/22
[10]Geetika Dhand, S.S. Tyagi, Data Aggregation Techniques in WSN:Survey, Procedia Computer Science, Volume 92, 2016, Pages 378-384, ISSN 1877-0509, https://doi.org/10.1016/j.procs.2016.07.393.
[11]M. S. H. Nazmudeen, A. T. Wan and S. M. Buhari, "Improved throughput for Power Line Communication (PLC) for smart meters using fog computing based data aggregation approach," 2016 IEEE International Smart Cities Conference (ISC2), Trento, Italy, 2016, pp. 1-4, doi: 10.1109/ISC2.2016.7580841.
[12]Jagdish Chandra Pandey and Mala Kalra. An approach for secure data transmission in smart grids. Published Online:February 2, 2023pp 348-365https://doi.org/10.1504/IJICS.2023.128830.
[13]Pandey, Vaibhav, Amarjeet Kaur, and Narottam Chand. "A review on data aggregation techniques in wireless sensor network." Journal of Electronic and Electrical Engineering 1.2 (2010): 01-08.
[14]H. Harb, A. Makhoul, S. Tawbi and R. Couturier, "Comparison of Different Data Aggregation Techniques in Distributed Sensor Networks," in IEEE Access, vol. 5, pp. 4250-4263, 2017, doi: 10.1109/ACCESS.2017.2681207.
[15]Vaidyanathan, K., Sur, S., Narravula, S., & Sinha, P. (2004). Data aggregation techniques in sensor networks. Osu-cisrc-11/04-tr60, The Ohio State University.
[16]Ghiasi, M., et al.: Evolution of smart grids towards the Internet of energy: concept and essential components for deep decarbonisation. IET Smart Grid. 6(1), 86–102 (2023). https://doi.org/10.1049/stg2.12095.
[17]A. Lang, Y. Wang, C. Feng, E. Stai and G. Hug, "Data Aggregation Point Placement for Smart Meters in the Smart Grid," in IEEE Transactions on Smart Grid, vol. 13, no. 1, pp. 541-554, Jan. 2022, doi: 10.1109/TSG.2021.3119904.
[18]ABBASIAN DEHKORDI, Soroush, FARAJZADEH, Kamran, REZAZADEH, Javad, et al. A survey on data aggregation techniques in IoT sensor networks. Wireless Networks, 2020, vol. 26, p. 1243-1263.
[19]Guguloth Ravi, M. Swamy Das, Karthik Karmakonda, Reliable cluster based data aggregation scheme for IoT network using hybrid deep learning techniques, Measurement: Sensors, Volume 27, 2023, 100744, ISSN 2665-9174, https://doi.org/10.1016/j.measen.2023.100744.
[20]Singh, A.K., Kumar, J. A secure and privacy-preserving data aggregation and classification model for smart grid. Multimed Tools Appl 82, 22997–23015 (2023). https://doi.org/10.1007/s11042-023-14599-4.
[21]Singh, A.K., Kumar, J. A privacy-preserving multidimensional data aggregation scheme with secure query processing for smart grid. J Supercomput 79, 3750–3770 (2023). https://doi.org/10.1007/s11227-022-04794-9
[22]Dramé, Cheikh (2014) : Resolving West Africa's electricity dilemma through the pursuit of smart grid opportunities, 20th Biennial Conference of the International Telecommunications Society (ITS): "The Net and the Internet - Emerging Markets and Policies" , Rio de Janeiro, Brazil, 30th-03rd December, 2014, International Telecommunications Society (ITS), Calgary.
[23]Sebastian Sterl, Inne Vanderkelen, Celray James Chawanda, Daniel Russo, Robert J. Brecha, Ann van Griensven, Nicole P. M. van Lipzig and Wim Thiery. Smart renewable electricity portfolios in West Africa. Nat Sustain 3, 710–719 (2020). https://doi.org/10.1038/s41893-020-0539-0.
[24]S. M. Kadri, A. O. Bagré, M. B. Camara, B. Dakyo and Y. Coulibaly, "Electrical Power distribution status in West Africa: Assessment and Perspective Overview," 2019 8th International Conference on Renewable Energy Research and Applications (ICRERA), 2019, pp. 511-515, doi: 10.1109/ICRERA47325.2019.8997112.
[25]Osama Majeed Butt, Muhammad Zulqarnain, Tallal Majeed Butt. Recent advancement in smart grid technology: Future prospects in the electrical power network. Ain Shams Engineering Journal 12 (2021) 687–695.
[26]Young, Jacob R., "Smart grid technology in the developing world" (2017). Honors Projects. 68. https://digitalcommons.spu.edu/honorsprojects/68.
[27]Fernando Antonanzas-Torres, Javier Antonanzas and Julio Blanco-Fernandez. State-of-the-Art of Mini Grids for Rural Electrification in West Africa. Energies 2021, 14(4), 990; https://doi.org/10.3390/en14040990.
[28]Guy H. Orcutt, Harold W. Watts and John B. Edwards. Data Aggregation and Information Loss.The American Economic Review Vol. 58, No. 4 (Sep., 1968), pp. 773-787 (15 pages) Published By: American Economic Association
[29]Kalbfleisch, J.D. and Lawless, J.F. (1984), Least-squares estimation of transition probabilities from aggregate data. Can J Statistics, 12: 169-182. https://doi.org/10.2307/3314745
[30]G. BELIAKOV MONOTONE APPROXIMATION OF AGGREGATION OPERATORS USING LEAST SQUARES SPLINES. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 2002 10:06, 659-676
[31]Andrei Kazakov, Michael Frenklach, Dynamic Modeling of Soot Particle Coagulation and Aggregation: Implementation With the Method of Moments and Application to High-Pressure Laminar Premixed Flames, Combustion and Flame, Volume 114, Issues 3–4, 1998, Pages 484-501, ISSN 0010-2180, https://doi.org/10.1016/S0010-2180(97)00322-2. (https://www.sciencedirect.com/science/article/pii/S0010218097003222)
[32]Daniele L. Marchisio, R. Dennis Vigil, Rodney O. Fox, Implementation of the quadrature method of moments in CFD codes for aggregation–breakage problems, Chemical Engineering Science, Volume 58, Issue 15, 2003, Pages 3337-3351, ISSN 0009-2509, https://doi.org/10.1016/S0009-2509(03)00211-2. (https://www.sciencedirect.com/science/article/pii/S0009250903002112)
[33]Azari Soufiani, H., Chen, W., Parkes, D. C., & Xia, L. (2013). Generalized method-of-moments for rank aggregation. Advances in Neural Information Processing Systems, 26.
[34]Casella, G., & Berger, R. L. (2021). Statistical inference. Cengage Learning.
[35]Shenton, S. H. (1977). Maximum likelihood estimation in small samples. Griffin Monograph.
[36]Papageorgiou, G., Grant, S. W., Takkenberg, J. J., & Mokhles, M. M. (2018). Statistical primer: how to deal with missing data in scientific research?. Interactive cardiovascular and thoracic surgery, 27(2), 153-158.
[37]Lahiri, S. N. (2013). Resampling methods for dependent data. Springer Science & Business Media.
[38]Jens-Peter Kreiss, Soumendra Nath Lahiri, 1 - Bootstrap Methods for Time Series, Editor(s): Tata Subba Rao, Suhasini Subba Rao, C.R. Rao, Handbook of Statistics, Elsevier, Volume 30, 2012, Pages 3-26, ISSN 0169-7161, ISBN 9780444538581, https://doi.org/10.1016/B978-0-444-53858-1.00001-6. (https://www.sciencedirect.com/science/article/pii/B9780444538581000016)
[39]Chaubey, Y. P. (1993). Resampling-based multiple testing: Examples and methods for p-value adjustment.
[40]Huynh, H. T., & Soumare, I. (2011). Stochastic simulation and applications in finance with MATLAB programs. John Wiley & Sons.
[41]McLeish, D. L. (2004). Monte carlo simulation and finance.
[42]Donnet, S. (2012). Monte Carlo Simulation for the Pharmaceutical Industry: Concepts, Algorithms, and Case Studies by Mark Chang.
[43]Zhang, H., Chen, Z., Ao, W., & Shi, P. (2023). Improved Dynamic Event-Triggered Robust Control for Flexible Robotic Arm Systems with Semi-Markov Jump Process. Sensors, 23(12), 5523.
[44]Elliott, R. J., Chan, L., & Siu, T. K. (2006). Risk measures for derivatives with Markov-modulated pure jump processes. Asia-Pacific Financial Markets, 13, 129-149.
[45]Segall, A., & Kailath, T. (1975). The modeling of randomly modulated jump processes. IEEE Transactions on information theory, 21(2), 135-143.
[46]Daly, E., & Porporato, A. (2010). Effect of different jump distributions on the dynamics of jump processes. Physical Review E, 81(6), 061133.
[47]Li, Y., Jin, D., Wang, Z., Hui, P., Zeng, L., & Chen, S. (2013). A Markov jump process model for urban vehicular mobility: Modeling and applications. IEEE Transactions on Mobile Computing, 13(9), 1911-1926.
[48]Aït-Sahalia, Y., Cacho-Diaz, J., & Laeven, R. J. (2015). Modeling financial contagion using mutually exciting jump processes. Journal of Financial Economics, 117(3), 585-606.
[49]Wu, M. C., & Yen, S. H. (2007). Pricing real growth options when the underlying assets have jump diffusion processes: the case of R&D investments. R&D Management, 37(3), 269-276.
[50]Deng, L., & Zhu, Y. (2012). Uncertain optimal control with jump. ICIC Express Letters, Part B: Applications, 3(2), 419-424.
[51]Fouladi, S. H., & Hajiramezanali, E. (2019). Non-Linear Non-Stationary Heteroscedasticity Volatility for Tracking of Jump Processes. arXiv preprint arXiv:1902.04499.
[52]Schnaubelt, M. (2019). A comparison of machine learning model validation schemes for non-stationary time series data (No. 11/2019). FAU Discussion Papers in Economics.
[53]Toth, B., Lillo, F., & Farmer, J. D. (2010). Segmentation algorithm for non-stationary compound Poisson processes: With an application to inventory time series of market members in a financial market. The European Physical Journal B, 78, 235-243
[54]Shirai, K., & Amano, Y. (2020). Mathematical modeling and risk management of production systems with jump process via stochastic analysis. International Journal of Innovative Computing, Information and Control, 16(1), 153-171.
[55]Su, P., & Liu, S. (2015). Dual sourcing in managing operational and disruption risks in contract manufacturing. International Journal of Production Research, 53(1), 291-306.
[56]Andersen, T. G., Bollerslev, T., & Diebold, F. X. (2003). Some like it smooth, and some like it rough: Untangling continuous and jump components in measuring, modeling, and forecasting asset return volatility. Modeling, and Forecasting Asset Return Volatility (September 2003).
[57]Perez, I., & Kypraios, T. (2019). Scalable Bayesian inference for population Markov jump processes. arXiv preprint arXiv:1904.08356.
[58]Meyer, R., Schloss, L., Brewer, J., Lambertson, R., Kinney, W., Sanchez, J., & Rinerson, D. (2008, November). Oxide dual-layer memory element for scalable non-volatile cross-point memory technology. In 2008 9th Annual Non-Volatile Memory Technology Symposium (NVMTS) (pp. 1-5). IEEE.
[59]Yan, J., & Rotskoff, G. M. (2022). Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control. The Journal of Chemical Physics, 157(7).
[60]Elliott, L., & Teh, Y. (2012). Scalable imputation of genetic data with a discrete fragmentation-coagulation process. Advances in neural information processing systems, 25.
[61]Gonzalez, J., Moriarty, J., & Palczewski, J. (2017). Bayesian calibration and number of jump components in electricity spot price models. Energy Economics, 65, 375-388.
[62]Tankov, P. (2003). Financial modelling with jump processes. CRC press.
[63]Golightly, A., & Sherlock, C. (2019). Efficient sampling of conditioned Markov jump processes. Statistics and Computing, 29, 1149-1163.
[64]Rao, V., & Teg, Y. W. (2013). Fast MCMC sampling for markov jump processes and extensions. Journal of Machine Learning Research, 14(11).
[65]Mark, M., Chehrazi, N., Liu, H., & Weber, T. A. (2022). Optimal recovery of unsecured debt via interpretable reinforcement learning. Machine Learning with Applications, 8, 100280.
[66]Wu, M. C., & Yen, S. H. (2007). Pricing real growth options when the underlying assets have jump diffusion processes: the case of R&D investments. R&D Management, 37(3), 269-276
[67]Deng, L., & Zhu, Y. (2012). Uncertain optimal control with jump. ICIC Express Letters, Part B: Applications, 3(2), 419-424.
[68]Lee, K., Halder, A., & Bhattacharya, R. (2015). Performance and robustness analysis of stochastic jump linear systems using wasserstein metric. Automatica, 51, 341-347.
[69]Ntinas, V., Rubio, A., & Sirakoulis, G. C. (2020). Probabilistic resistive switching device modeling based on Markov jump processes. IEEE access, 9, 983-988.
[70]Yazid Hambally Yacouba, Amadou Diabagaté, Michel Babri and Adama Coulibaly, “Design, Aggregation and Analysis of Power Consumption Data using the Jump Process” International Journal of Advanced Computer Science and Applications(IJACSA),12(5), 2021. http://dx.doi.org/10.14569/IJACSA.2021.0120567.
[71]Artur Trindade, artur.trindade '@' elergone.pt, Elergone, NORTE-07-0202-FEDER-038564 Data type: TS, Smart Meter Data Portal, 370 Client Electricity Loads 2011 - 2014, https://smda.github.io/smart-meter-data-portal.