Abstract
As the risks associated with air turbulence are intensified by climate change and the growth of the aviation industry, it has become imperative to monitor and mitigate these threats to ensure civil aviation safety. The eddy dissipation rate (EDR) has been established as the standard metric for quantifying turbulence in civil aviation. This study aims to explore a universally applicable symbolic classification approach based on genetic programming to detect turbulence anomalies using quick access recorder (QAR) data. The detection of atmospheric turbulence is approached as an anomaly detection problem. Comparative evaluations demonstrate that this approach performs on par with direct EDR calculation methods in identifying turbulence events. Moreover, comparisons with alternative machine learning techniques indicate that the proposed technique is the optimal methodology currently available. In summary, the use of symbolic classification via genetic programming enables accurate turbulence detection from QAR data, comparable to that with established EDR approaches and surpassing that achieved with machine learning algorithms. This finding highlights the potential of integrating symbolic classifiers into turbulence monitoring systems to enhance civil aviation safety amidst rising environmental and operational hazards.
Similar content being viewed by others
References
Ando, D., P. Dahlsted, M. G. Nordahl, and H. Iba, 2007: Interactive GP with tree representation of classical music pieces. Proc. of the 2007 EvoWorkshops 2007 on EvoCoMnet, EvoFIN, EvoIASP, EvoINTERACTION, EvoMUSART, EvoSTOC and EvoTransLog: Applications of Evolutionary Computing, Valencia, Springer, 577–584, https://doi.org/10.1007/978-3-540-71805-5_63.
Angeline, P. J., 1997: Subtree crossover: Building block engine or macromutation. Genetic Programming 1997: Proceedings of the Second Annual Conference, J. Koza et al., Eds., MIT Press, 9–17.
BOEING, 2023: Commercial Market Outlook 2023–2042. BOEING. [Available online from https://boeing.com/resources/boeingdotcom/market/assets/downloads/2023-Commercial-Market-Outlook-Executive-Summary.pdf]
Bojarczuk, C. C., H. S. Lopes, and A. A. Freitas, 2000: Genetic programming for knowledge discovery in chest-pain diagnosis. IEEE Engineering in Medicine and Biology Magazine, 19(4), 38–44, https://doi.org/10.1109/51.853480.
Bradshaw, P., 2013: An Introduction to Turbulence and Its Measurement: Thermodynamics and Fluid Mechanics Series. Elsevier.
Chan, P. W., 2011: Generation of an eddy dissipation rate map at the Hong Kong international airport based on doppler lidar data. J. Atmos. Oceanic Technol., 28(1), 37–49, https://doi.org/10.1175/2010jtecha1458.1.
Chen, Q., Z. H. Wang, J. Wan, T. M. Feng, P. Chen, C. Wang, and C. Zhang, 2019: Design of a turbulence prevention system based on ATG. Proc. 2019 IEEE 1st International Conference on Civil Aviation Safety and Information Technology (ICCA-SIT), Kunming, IEEE, 445–449, https://doi.org/10.1109/ICC-ASIT48058.2019.8973122.
Clark, T. L., W. D. Hall, R. M. Kerr, D. Middleton, L. Radke, F. M. Ralph, P. J. Neiman, and D. Levinson, 2000: Origins of aircraft-damaging clear-air turbulence during the 9 December 1992 Colorado downslope windstorm: Numerical simulations and comparison with observations. J. Atmos. Sci., 57(8), 1105–1131, https://doi.org/10.1175/1520-0469(2000)057<1105:OOADCA>2.0.CO;2.
Clayson, C. A., and L. Kantha, 2008: On turbulence and mixing in the free atmosphere inferred from high-resolution soundings. J. Atmos. Oceanic Technol., 25(6), 833–852, https://doi.org/10.1175/2007JTECHA992.1.
Cornman, L. B., C. S. Morse, and G. Cunning, 1995: Real-time estimation of atmospheric turbulence severity from in-situ aircraft measurements. Journal of Aircraft, 32(1), 171–177, https://doi.org/10.2514/3.46697.
e Silva, L. C., and M. C. R. Murça, 2023: A data analytics framework for anomaly detection in flight operations. Journal of Air Transport Management, 110, 102409, https://doi.org/10.1016/j.jairtraman.2023.102409.
Eick, D., 2014: Turbulence Related Accidents & Incidents. NTSB. Available from https://ral.ucar.edu/sites/default/files/docs/eick-turbulencerelatedaccidents.pdf.
Frehlich, R., and R. Sharman, 2010: Climatology of velocity and temperature turbulence statistics determined from rawinsonde and ACARS/AMDAR data. J. Appl. Meteorol. Climatol., 49(6), 1149–1169, https://doi.org/10.1175/2010JAMC2196.1.
Freiman, J., 2023: 11 Hospitalized after Delta Flight hits Severe Turbulence en Route to Atlanta. CBS News. Available from https://cbsnews.com/news/delta-turbulence-11-hospitalized-atlanta/.
Goldberg, D. E., 1989: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley.
Golding, W. L., 2002: Turbulence and its impact on commercial aviation. Journal of Aviation/Aerospace Education & Research, 11, 8, https://doi.org/10.15394/jaaer.2002.1301.
Goldstein, E. B., and G. Coco, 2014: A machine learning approach for the prediction of settling velocity. Water Resour. Res., 50(4), 3595–3601, https://doi.org/10.1002/2013WR015116.
Hocking, W. K., and P. K. L. Mu, 1997: Upper and middle tropospheric kinetic energy dissipation rates from measurements of \({{\rm{C}}_{\rm{n}}}^2\) — review of theories, in-situ investigations, and experimental studies using the Buckland Park atmospheric radar in Australia. Journal of Atmospheric and Solar-Terrestrial Physics, 59(14), 1779–1803, https://doi.org/10.1016/S1364-6826(97)00020-5.
Hu, B., J. Tang, J. Ding, and G. Liu, 2021: Regional downscaled future change of clear-air turbulence over east Asia under RCP8.5 scenario within the CORDEX-EA-II project. International Journal of Climatology, 41(10), 5022–5035, https://doi.org/10.1002/joc.7114.
Hu, B. Y., J. P. Tang, and S. Y. Wang, 2022: Future change of clear-air turbulence over east Asia: Base on CORDEX-WRF downscaling technology. Chinese Journal of Geophysics, 65(7), 2432–2447, https://doi.org/10.6038/cjg2022P0346. (in Chinese with English abstract)
Huang, R. S., H. B. Sun, C. Wu, C. Wang, and B. B. Lu, 2019: Estimating eddy dissipation rate with QAR flight big data. Applied Sciences, 9(23), 5192, https://doi.org/10.3390/app9235192.
ICAO, 2010: Annex 3, Meteorological Service for International Air Navigation. ICAO. [Available online from https://www.icao.int/airnavigation/IMP/Documents/Annex%203%20-%2075.pdf]
Kinnear, K. E., 1994: Fitness landscapes and difficulty in genetic programming. Proc. IEEE Conf. on Evolutionary Computation. IEEE World Congress on Computational Intelligence, Orlando, FL, IEEE, 142–147, https://doi.org/10.1109/ICEC.1994.350026.
Kinnear, K. E., P. J. Angeline, and L. Spector, 1994: Advances in Genetic Programming. Vol.3, MIT Press.
Koza, J. R., 1992: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press.
Lee, H., G. Y. Li, A. Rai, and A. Chattopadhyay, 2020: Real-time anomaly detection framework using a support vector regression for the safety monitoring of commercial aircraft. Advanced Engineering Informatics, 44, 101071, https://doi.org/10.1016/j.aei.2020.101071.
Li, G. Y., H. Lee, A. Rai, and A. Chattopadhyay, 2020: Analysis of operational and mechanical anomalies in scheduled commercial flights using a logarithmic multivariate Gaussian model. Transportation Research Part C: Emerging Technologies, 110, 20–39, https://doi.org/10.1016/j.trc.2019.11.011.
McCall, J., 2005: Genetic algorithms for modelling and optimisation. Journal of Computational and Applied Mathematics, 184(1), 205–222, https://doi.org/10.1016/j.cam.2004.07.034.
O’Neill, M. Riccardo Poli, William B. Langdon, Nicholas F. McPhee, 2009: Riccardo Poli, William B. Langdon, Nicholas F. McPhee: A field guide to genetic programming. Genetic Programming and Evolvable Machines, 10, 229–230, https://doi.org/10.1007/s10710-008-9073-y.
Ravisankar, P., V. Ravi, G. R. Rao, and I. Bose, 2011: Detection of financial statement fraud and feature selection using data mining techniques. Decision Support Systems, 50(2), 491–500, https://doi.org/10.1016/j.dss.2010.11.006.
Revanasiddappa, M. B., B. S. Harish, and S. Manjunath, 2014: Document classification using symbolic classifiers. Proc. 2014 International Conf. on Contemporary Computing and Informatics (IC3I), Mysore, IEEE, 299–303, https://doi.org/10.1109/IC3I.2014.7019827.
Sette, S., and L. Boullart, 2001: Genetic programming: Principles and applications. Engineering Applications of Artificial Intelligence, 14(6), 727–736, https://doi.org/10.1016/S0952-1976(02)00013-1.
Sharman, R., C. Tebaldi, G. Wiener, and J. Wolff, 2006: An integrated approach to mid-and upper-level turbulence forecasting. Wea. Forecasting, 21(3), 268–287, https://doi.org/10.1175/WAF924.1.
Sharman, R. D., and J. M. Pearson, 2017: Prediction of energy dissipation rates for aviation turbulence. Part I: Forecasting non-convective turbulence. J. Appl. Meteorol. Climatol., 56(2), 317–337, https://doi.org/10.1175/JAMC-D-16-0205.1.
Sharman, R. D., S. B. Trier, T. P. Lane, and J. D. Doyle, 2012: Sources and dynamics of turbulence in the upper troposphere and lower stratosphere: A review. Geophys. Res. Lett., 39(12), L12803, https://doi.org/10.1029/2012gl051996.
Sheridan, K., T. G. Puranik, E. Mangortey, O. J. Pinon-Fischer, M. Kirby, and D. N. Mavris, 2020: An application of dbscan clustering for flight anomaly detection during the approach phase. Proc. AIAA Scitech 2020 Forum, Orlando, FL, AIAA, https://doi.org/10.2514/6.2020-1851.
Suganuma, M., S. Shirakawa, and T. Nagao, 2017: A genetic programming approach to designing convolutional neural network architectures. Proc. Genetic and Evolutionary Computation Conf., Berlin, ACM, 497–504, https://doi.org/10.1145/3071178.3071229.
Wang, Y. Q., N. Wagner, and J. M. Rondinelli, 2019: Symbolic regression in materials science. MRS Communications, 9(3), 793–805, https://doi.org/10.1557/mrc.2019.85.
Williams, P. D., 2017: Increased light, moderate, and severe clear-air turbulence in response to climate change. Adv. Atmos. Sci., 34(5), 576–586, https://doi.org/10.1007/s00376-017-6268-2.
Williams, P. D., and M. M. Joshi, 2013: Intensification of winter transatlantic aviation turbulence in response to climate change. Nature Climate Change, 3(7), 644–648, https://doi.org/10.1038/nclimate1866.
Wright, K., 2023: Yes, Airline Flights Are Getting Bumpier: Here’s Why. Scientific American. [Available online from https://www.scientificamerican.com/article/yes-airline-flights-are-getting-bumpier-heres-why]
Zhang, Q. Y., K. Barri, P. C. Jiao, H. Salehi, and A. H. Alavi, 2021: Genetic programming in civil engineering: Advent, applications and future trends. Artificial Intelligence Review, 54(3), 1863–1885, https://doi.org/10.1007/s10462-020-09894-7.
Zhao, W. Z., L. S. Li, S. Alam, and Y. J. Wang, 2021: An incremental clustering method for anomaly detection in flight data. Transportation Research Part C: Emerging Technologies, 132, 103406, https://doi.org/10.1016/j.trc.2021.103406.
Acknowledgements
This work was supported by the Meteorological Soft Science Project (Grant No. 2023ZZXM29), the Natural Science Fund Project of Tianjin, China (Grant No. 21JCYBJC00740), and the Key Research and Development-Social Development Program of Jiangsu Province, China (Grant No. BE2021685).
Author information
Authors and Affiliations
Corresponding author
Additional information
Article Highlights
• Turbulence can be detected by our proposed method without the need to calculate or estimate the EDR.
• This study employs a symbolic classifier based on genetic programming to acquire knowledge and facilitate evolution from QAR data.
• Our trained model had an equivalent performance compared to the EDR on new flights.
This paper is a contribution to the special issue on AI Applications in Atmospheric and Oceanic Science: Pioneering the Future.
Rights and permissions
About this article
Cite this article
Zhuang, Z., Lin, K., Zhang, H. et al. Detection of Turbulence Anomalies Using a Symbolic Classifier Algorithm in Airborne Quick Access Record (QAR) Data Analysis. Adv. Atmos. Sci. (2024). https://doi.org/10.1007/s00376-024-3195-x
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00376-024-3195-x