DOI - Vydavatelství Mendelovy univerzity v Brně

Identifikátory DOI

DOI: 10.11118/ecos2026_033

CLASSIFYING SCANNING ELECTRON MICROSCOPE DEFECTS WITH A CNN AND A CUSTOM FOURIER-TRANSFORM LAYER

Magdaléna Skřičilová1, Oldřich Trenz1
1 Department of Informatics, Faculty of Business and Economics, Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic

A scanning electron microscope has to be checked periodically, and two of its most common image faults, defocus and astigmatism, are tedious to judge by eye. This article presents a convolutional neural network that sorts pairs of microscope images into four focus and astigmatism classes so the check can run without an operator. Each sample is two shots of the same spot: one in the base position and one with a shifted working distance, because the shifted shot is what makes astigmatism visible. The decisive ingredient is a custom Fourier-transform preprocessing layer that converts each input to its magnitude spectrum before the convolutional part sees it. On a dataset of about three thousand image pairs, the base model variants with-out the Fourier layer reached 49–65% test accuracy, while the corresponding variants with the Fourier layer reached 89–94%; the best result was 94% with channel-axis concatenation. The same shallow model beat three pretrained ImageNet networks (MobileNetV2 87%, EfficientNetV2L 52%, ResNet50 44%), which we did not expect. The best fusion of the two images was concatenation along the channel axis together with the Fourier layer.

Klíčová slova: convolutional neural network, scanning electron microscope, Fourier transform, image classification, astigmatism

stránky: 308-315, online: 2026



Reference

  1. AGGARWAL, C. C. 2018. Neural Networks and Deep Learning. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-94463-0 Přejít k původnímu zdroji...
  2. AMMANN, P., OFFUTT, J. 2008. Introduction to Software Testing. Cambridge: Cambridge University Press. ISBN 978-0-521-88038-1. Přejít k původnímu zdroji...
  3. ERASMUS, S. J., SMITH, K. C. A. 1982. An automatic focusing and astigmatism correction system for the SEM and CTEM. Journal of Microscopy. 127(2), 185-199. ISSN 0022-2720. https://doi.org/10.1111/j.1365-2818.1982.tb00412.x Přejít k původnímu zdroji...
  4. HE, K., ZHANG, X., REN, S., SUN, J. 2016. Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 770-778. ISBN 978-1-4673-8851-1. https://doi.org/10.1109/CVPR.2016.90 Přejít k původnímu zdroji...
  5. KINGMA, D. P., BA, J. 2014. Adam: A Method for Stochastic Optimization. arXiv preprint. arXiv:1412.6980. https://doi.org/10.48550/arXiv.1412.6980 Přejít k původnímu zdroji...
  6. KRIZHEVSKY, A., SUTSKEVER, I., HINTON, G. E. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Communications of the ACM. 60(6), 84-90. https://doi.org/10.1145/3065386 Přejít k původnímu zdroji...
  7. LECUN, Y., BENGIO, Y., HINTON, G. 2015. Deep learning. Nature. 521(7553), 436-444. ISSN 0028-0836. https://doi.org/10.1038/nature14539 Přejít k původnímu zdroji...
  8. LEE, W., KIM, H., HAN, S., YOON, J. 2021. Robust autofocusing for scanning electron microscopy based on a dual deep learning network. Scientific Reports. 11(1), 20933. ISSN 2045-2322. https://doi.org/10.1038/s41598-021-00412-5 Přejít k původnímu zdroji...
  9. LU, Y., ZHANG, X., LI, H. 2018. A simplified focusing and astigmatism correction method for a scanning electron microscope. AIP Advances. 8, 015124. ISSN 2158-3226. https://doi.org/10.1063/1.5009683 Přejít k původnímu zdroji...
  10. NA, J., KIM, G., KANG, S.-H., KIM, S.-J., LEE, S. 2021. Deep learning-based discriminative refocusing of scanning electron microscopy images for materials science. Acta Materialia. 214, 116987. https://doi.org/10.1016/j.actamat.2021.116987 Přejít k původnímu zdroji...
  11. OGASAWARA, M., SATO, M., KOMURO, M., KAGA, R. 1999. Automatic Focusing and Astigmatism Correction Method Based on Fourier Transform of Scanning Electron Microscope Images. Japanese Journal of Applied Physics. 38(2R), 957. ISSN 0021-4922. https://doi.org/10.1143/JJAP.38.957 Přejít k původnímu zdroji...
  12. SCHUBERT, P. J., SAXENA, R., KORNFELD, J. 2024. DeepFocus: fast focus and astigmatism correction for electron microscopy. Nature Communications. 15, 948. https://doi.org/10.1038/s41467-024-45042-3 Přejít k původnímu zdroji...
  13. SKRICILOVA, M. 2024. Classification of electron microscope images using an artificial neural network [in Czech]. Master's thesis, head: Trenz, O. Brno: Mendel University in Brno. .
  14. SZANDAŁA, T. 2020. Convolutional Neural Network for Blur Images Detection as an Alternative for Laplacian Method. In: 2020 IEEE Symposium Series on Computational Intelligence (SSCI). pp. 2901-2904. ISBN 978-1-7281-2547-3. https://doi.org/10.1109/SSCI47803.2020.9308594 Přejít k původnímu zdroji...