DOI - Mendel University Press

DOI identifiers

DOI: 10.11118/ecos2026_033

CLASSIFYING SCANNING ELECTRON MICROSCOPE DEFECTS WITH A CNN AND A CUSTOM FOURIER-TRANSFORM LAYER

Magdaléna Skřičilová1, Oldřich Trenz1
1 Department of Informatics, Faculty of Business and Economics, Mendel University in Brno, Zemědělská 1, 613 00 Brno, Czech Republic

A scanning electron microscope has to be checked periodically, and two of its most common image faults, defocus and astigmatism, are tedious to judge by eye. This article presents a convolutional neural network that sorts pairs of microscope images into four focus and astigmatism classes so the check can run without an operator. Each sample is two shots of the same spot: one in the base position and one with a shifted working distance, because the shifted shot is what makes astigmatism visible. The decisive ingredient is a custom Fourier-transform preprocessing layer that converts each input to its magnitude spectrum before the convolutional part sees it. On a dataset of about three thousand image pairs, the base model variants with-out the Fourier layer reached 49–65% test accuracy, while the corresponding variants with the Fourier layer reached 89–94%; the best result was 94% with channel-axis concatenation. The same shallow model beat three pretrained ImageNet networks (MobileNetV2 87%, EfficientNetV2L 52%, ResNet50 44%), which we did not expect. The best fusion of the two images was concatenation along the channel axis together with the Fourier layer.

Keywords: convolutional neural network, scanning electron microscope, Fourier transform, image classification, astigmatism

pages: 308-315, online: 2026



References

  1. AGGARWAL, C. C. 2018. Neural Networks and Deep Learning. Cham: Springer International Publishing. https://doi.org/10.1007/978-3-319-94463-0 Go to original source...
  2. AMMANN, P., OFFUTT, J. 2008. Introduction to Software Testing. Cambridge: Cambridge University Press. ISBN 978-0-521-88038-1. Go to original source...
  3. ERASMUS, S. J., SMITH, K. C. A. 1982. An automatic focusing and astigmatism correction system for the SEM and CTEM. Journal of Microscopy. 127(2), 185-199. ISSN 0022-2720. https://doi.org/10.1111/j.1365-2818.1982.tb00412.x Go to original source...
  4. HE, K., ZHANG, X., REN, S., SUN, J. 2016. Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). pp. 770-778. ISBN 978-1-4673-8851-1. https://doi.org/10.1109/CVPR.2016.90 Go to original source...
  5. KINGMA, D. P., BA, J. 2014. Adam: A Method for Stochastic Optimization. arXiv preprint. arXiv:1412.6980. https://doi.org/10.48550/arXiv.1412.6980 Go to original source...
  6. KRIZHEVSKY, A., SUTSKEVER, I., HINTON, G. E. 2012. ImageNet Classification with Deep Convolutional Neural Networks. Communications of the ACM. 60(6), 84-90. https://doi.org/10.1145/3065386 Go to original source...
  7. LECUN, Y., BENGIO, Y., HINTON, G. 2015. Deep learning. Nature. 521(7553), 436-444. ISSN 0028-0836. https://doi.org/10.1038/nature14539 Go to original source...
  8. LEE, W., KIM, H., HAN, S., YOON, J. 2021. Robust autofocusing for scanning electron microscopy based on a dual deep learning network. Scientific Reports. 11(1), 20933. ISSN 2045-2322. https://doi.org/10.1038/s41598-021-00412-5 Go to original source...
  9. LU, Y., ZHANG, X., LI, H. 2018. A simplified focusing and astigmatism correction method for a scanning electron microscope. AIP Advances. 8, 015124. ISSN 2158-3226. https://doi.org/10.1063/1.5009683 Go to original source...
  10. NA, J., KIM, G., KANG, S.-H., KIM, S.-J., LEE, S. 2021. Deep learning-based discriminative refocusing of scanning electron microscopy images for materials science. Acta Materialia. 214, 116987. https://doi.org/10.1016/j.actamat.2021.116987 Go to original source...
  11. OGASAWARA, M., SATO, M., KOMURO, M., KAGA, R. 1999. Automatic Focusing and Astigmatism Correction Method Based on Fourier Transform of Scanning Electron Microscope Images. Japanese Journal of Applied Physics. 38(2R), 957. ISSN 0021-4922. https://doi.org/10.1143/JJAP.38.957 Go to original source...
  12. SCHUBERT, P. J., SAXENA, R., KORNFELD, J. 2024. DeepFocus: fast focus and astigmatism correction for electron microscopy. Nature Communications. 15, 948. https://doi.org/10.1038/s41467-024-45042-3 Go to original source...
  13. SKRICILOVA, M. 2024. Classification of electron microscope images using an artificial neural network [in Czech]. Master's thesis, head: Trenz, O. Brno: Mendel University in Brno. .
  14. SZANDAŁA, T. 2020. Convolutional Neural Network for Blur Images Detection as an Alternative for Laplacian Method. In: 2020 IEEE Symposium Series on Computational Intelligence (SSCI). pp. 2901-2904. ISBN 978-1-7281-2547-3. https://doi.org/10.1109/SSCI47803.2020.9308594 Go to original source...