User:Klingm01/sandbox/CrysTBoxEn

CrysTBox
Developer(s)Miloslav Klinger
Initial release9 December 2014; 9 years ago (2014-12-09)
Written inMATLAB
Operating systemMicrosoft Windows
Available inEnglish
TypeScientific
LicenseFree for non-commercial use
Websitecrystbox.fzu.cz

CrysTBox (Crystallographic Tool Box) is a suite of computer tools for crystallographic visualization and analysis of transmission electron microscope images. Relying on artificial intelligence and computer vision, CrysTBox makes routine crystallographic analyses simpler, faster and more accurate compared to human evaluators. The high level of automation, sub-pixel precision[1] and interactive visualization makes the quantitative crystallographic analysis accessible even for non-crystallographers simplifying an interdisciplinary research. Simultaneously advanced functionalities for comprehensive analyses are available for experienced material scientists.

CrysTBox is being developed in the Laboratory of electron microscopy at the Institute of Physics of the Czech Academy of Sciences. For academic purposes, it is available for free. By 2021, the suite has been deployed in research and educational facilities in more than 80 countries[2] contributing to the research of ETH Zurich[3], Lawrence Berkeley National Laboratory[4], Max Planck Institutes[5], Chinese Academy of Sciences[6], Fraunhofer Institutes[7] or Oxford University[8].


Tool box edit

As a scientific tool, CrysTBox is freely available for academic purposes, it supports data formats widely used in the community and offers interconnection with other scientific software.

Availability edit

CrysTBox is freely available on demand for non-commercial use by non-commercial subjects. Commercial use is not allowed due to the license of MATLAB used for CrysTBox compilation.

Notable research and users edit

Besides education, CrysTBox is mainly used in research with fields of application spanning from nuclear research[9] to archaeology and paleontology.[10] Among others, the suite was employed in development of additive manufacturing (including 3D printed biodegradable alloys,[7] metallic glass[11] or high-entropy alloys[12]), resistant coatings,[13] laser shock peening,[14] water cleaning technologies[15] or characterization of 50 million years old flint.[10]

Institutions whose research was supported by CrysTBox include educational facilities such as ETH Zurich,[3] University of California,[16] Uppsala University,[13] Oxford University,[8] University of Waterloo,[15] Indian Institute of Technology,[17] Nanyang Technological University[12] and University of Tokyo[18] as well as research institutes like Max-Planck Institutes,[12] Chinese Academy of Sciences,[6] Fraunhofer Institutes[7] or US National Laboratories such as Oak Ridge NL,[9] Lawrence Berkeley NL,[4] Idaho NL[9] and Lawrence Livermoore NL.[14]


Research institutes




nuclear [19]


[11] [12] [19] [9] [13] [16] [10] [15] [17] [18]



[3] [4] [5] [6] [7] [8] [14]


The suite has been used for a wide range of material research from additive manufacturing of biodegradable materials, to archaeology

CrysTBox is used by for education, fundamental and applied research.

Input data edit

The primary input is the structure of sample material. In CrysTBox, materials can be specified using Cyrstallographic information file or by creating a simple text file. A basic set of several hundred materials is included in the CrysTBox package. Other materials can be obtained via databases such as Crystallography Open Database[20] or Inorganic Crystal Structure Database[21].

Analytical tools also require the image to be processed (electron diffraction, high-resolution image etc.). Supported image formats include common formats such as PNG, JPEG, BMP or TIFF as well as specialized ones – DM2 a DM3. Example images are included allowing the user to get familiar with individual tools.

Connectivity edit

The tools can be used separately as well as chained together – for instance the sample orientation can be determined using diffractGUI and consequently visualized in cellViewer as an appropriately oriented unit cell accompanied by a simulated diffraction pattern. The tools can be also launched by other software through instructions passed via a special text file. This allows CrysTBox to be interconnected with other software such as DigitalMicrograph 1 and 2.

Limitations and disadvantages edit

CrysTBox is compiled to a stand-alone installers using MATLAB Compiler. Therefore, 1-2 GB of MATLAB libraries are installed together with the toolbox.

The diffraction simulation used in cellViewer is based on kinematic diffraction theory. This allows for a real-time response to user interaction, but it does not cover advanced diffraction features like double diffraction covered by dynamical diffraction theory.

The analytical tools provide correction for scale calibration imperfections, but does not provide adjustment for image distortions such as elliptical distortion. If high-accuracy measurement is needed or if the distortion exceeds standard levels, appropriate tools[22] should be applied prior to the analysis.

Crystallographic visualization tools edit

In order to visualize functional relations and provide better understanding of experimental data, the graphical representations emphasize user interactivity and functional interconnection. One provided tool offers different views of single material, while another depicts an intergrowth of two different materials.

cellViewer - single crystal visualization edit

 
User interface of diffractGUI.

CellViewer allows to visualize the sample material in four modes widely used in material research:

  • 3D model of atomic structure (direct space),
  • simulated diffraction pattern (reciprocal space),
  • stereographic projection (projection of 3D space of crystallographic planes and directions to 2D),
  • inverse pole figure (defined part of stereographic projection).

Graphical user interface provides user with two interactive views side by side. These views can display arbitrary combination of the four aforementioned visualization modes allowing to perceive their mutual relations. For instance, rotation of the atomic structure in direct space leads (if set so) to an instant update of the simulated diffraction pattern. If any diffraction spot is selected, corresponding crystallographic planes are shown in the unit cell etc. Such interconnections are implemented for each pair of the four available visualization modes. The electronic visualization allows to simplify understanding of widely used, yet less intuitive representations such as the inverse pole figure. For instance by drawing the coloured triangle of the inverse pole figure into the stereographic projection or to the more intuitive 3D atomic structure.

ifaceViewer - intergrowth visualization edit

 

The ifaceViewer allows for visualization of two misoriented materials and their interface such as crystal twins or grain boundaries. The user interface provides three views: two smaller views, each depicting one unit cell of selected material and orientation, and a larger view depicting an appropriate interface of the two structures. The interface can be visualized in four modes:

  • 3D model of both unit cells,
  • wire model of both unit cells,
  • cross section of the interface,
  • bulk representation (up to several hundred atoms).

All three views in the user interface are functionally interconnected. If the content of one view is rotated by the user, the other views follow. If a crystallographic plane or direction is selected in one view, it is shown in other views and corresponding crystallographic indices are stated. The tool also allows to highlight coincident site lattice or calculate the list of planes and directions which are parallel or nearly parallel in the two misoriented materials.

Automated analysis of TEM images edit

CrysTBox offers tools for automated processing of diffraction patterns and high-resolution transmission electron microscope images. Since the tools employ algorithms of artificial intelligence and computer vision, they are designed to require minimal operator effort providing higher accuracy compared to manual evaluation. Four analytical tools can be used to index diffraction patterns, measure interplanar distances, angles, sample thickness etc. Despite the high level of automation, the user is able to control the whole process and perform individual steps manually if needed.

diffractGUI - HRTEM and diffraction processing edit

 

DiffractGUI allows for an automated analysis of diffraction patterns and high-resolution images of single crystal or limited number of crystallites. It is able to determine crystal orientation, identify individual diffraction spots and measure interplanar angles and distances in picometric precision.[23] The input image may depict:

The input image is processed in the following steps:

  1. Preprocessing with accordance to the settings and image nature (resolution and noise reduction, Fourier transform for direct space images etc.).
  2. Detection of diffraction reflections at various scales[24] (difference of Gaussians typically used for spot detection, Hough transform[25][26] for CBED disk detection[27]).
  3. The strongest detections are selected across the scale space.
  4. A regular lattice is fit to the set of the strongest detections using RANSAC[28] algorithm.
  5. Lengths and angles of the lattice basis vectors are measured.
  6. Crystal lattice orientation is determined and diffraction reflections are identified using theoretical parameters of the sample material.

Compared to human evaluation, diffractGUI considers tens of diffraction spots at once and, therefore, can localize the pattern with sub-pixel precision.

ringGUI - ring diffraction analysis edit

 

RingGUI allows for an automated processing of ring diffraction images of polycrystalline or powder samples. It can be used to identify the diffraction rings, quantify the interplanar distances and thus characterize or identify the sample material. With known material, it can assist in microscope calibration. The input image is processed as follows:

  1. beam-stopper detection,
  2. localization of the ring center,
  3. quantification of the diffraction profile and estimation of its background intensity,
  4. identification of the rings in the image (peaks in the profile).

The results can be further processed and visualized in two interactive, functionally interconnected graphical elements:

  • Interactive diffraction image – allows the user to improve readability of the diffraction image by removing the beam-stopper, subtracting the background, revealing faint or spotty rings or by crystallographic identification of the depicted rings.
  • Diffraction profile – circular average of the image intensities depicts the peaks corresponding to the rings and their match with theoretical values known for given sample material.

Both, the diffraction image as well as diffraction profile can be used to select diffraction rings with a mouse click. The corresponding ring is then highlighted in both graphical representations and details are listed.

twoBeamGUI - sample thickness estimation edit

 

Sample thickness can be estimated using twoBeamGUI from a convergent beam electron diffraction pattern (CBED) in two beam approximation[29][30]. The procedure is based on an automated extraction of the intensity profile across the diffracted disk in the following steps:

  1. diffraction disk radius is determined using multi-scale Hough transform[27],
  2. the transmitted and diffracted disks are localized and the reflection is indexed,
  3. the disks are horizontally aligned, cropped out and profiles are measured across the disks,
  4. the profile across the diffracted disk is matched with a series of profiles simulated for given material, reflection and specified thickness range.

Once the procedure is completed, the measured profile and the most similar simulated profile are displayed with the diffracted disk on the background. This allows the user to verify correctness of the automated estimate and easily check the similarity of other intensity profiles within the specified thickness range.

gpaGUI - geometric phase analysis edit

 

The tool called gpaGUI provides an interactive interface for geometric phase analysis, which allows to generate 2D maps of various crystallographic quantities using high-resolution images. The high-resolution image needs to be Fourier-transformed into frequential representation. Mathematically, the frequential image is a complex matrix with the size equal to the original image. Crystallographically, it can be seen as an artificial diffraction pattern of the original image depicting intensity peaks corresponding to the crystallographic planes present in the original image. The frequential representation can be transformed back to the original image using inverse Fourier transform. If the frequential image is filtered so that only the information from a region close to a particular diffraction spot is used (the rest is set to zero), a filtered direct image obtained by inverse Fourier transform then depicts only the planes corresponding to the selected diffraction spot. Moreover, due to its complex nature, the frequential image can be used to calculate amplitude and phase. Together with a vector of one crystallographic plane depicted in the image, they can be used to generate a 2D map d-spacing.[31] If two vectors of non-parallel planes are known, the method can be used to generate maps of strain and displacement.[32]

Graphical user interface of gpaGUI is vertically divided into two halves, each of which contains:

  • Diffractogram preview allowing to select one diffraction spot corresponding to a crystallographic plane.
  • Visualization of a selected quantity (input image, filtered image or one of the maps mentioned above) allowing to select point of interest or region of interest for further analysis.
  • Results of detailed analysis of point or region of interest. The point analysis allows the user to select any pixel of the visualized map to see exact values of the particular pixel and its closest neighbourhood. If analysis of broader area is needed, a polygonal region can be outlined in the map allowing to enumerate its statistical details: mean, standard deviation, median, minimum, maximum and total area of the polygon.

Since each half of the interface allows to specify one crystallographic plane, gpaGUI allows to calculate all the aforementioned crystallographic quantities including those which require two vectors. Precision and repeatability of the whole analysis relies on accuracy of the diffraction peak localization. To overcome inaccuracy of manual peak localization (with a mouse click), gpaGUI provides a possibility to process the input image with diffractGUI in order to accurately localize and index the peaks.

See also edit

References edit

  1. ^ Klinger, Miloslav (2017-07-07). "More features, more tools, more CrysTBox". Journal of Applied Crystallography. 50 (4). International Union of Crystallography (IUCr): 1226–1234. doi:10.1107/s1600576717006793. ISSN 1600-5767.
  2. ^ "CrysTBox - Crystallographic Toolbox". Fyzikální ústav Akademie věd České republiky. 2021-11-16.
  3. ^ a b c d Cihova, M.; Schäublin, R.; Hauser, L.B.; Gerstl, S.S.A.; Simson, C.; Uggowitzer, P.J.; Löffler, J.F. (2018). "Rational design of a lean magnesium-based alloy with high age-hardening response". Acta Materialia. 158. Elsevier BV: 214–229. doi:10.1016/j.actamat.2018.07.054. ISSN 1359-6454.
  4. ^ a b c d Schoeppler, Vanessa; Stier, Deborah; Best, Richard J.; Song, Chengyu; Turner, John; Savitzky, Benjamin H.; Ophus, Colin; Marcus, Matthew A.; Zhao, Shiteng; Bustillo, Karen; Zlotnikov, Igor (2021). "Crystallization by Amorphous Particle Attachment: On the Evolution of Texture". Advanced Materials. 33 (37). Wiley: 2101358. doi:10.1002/adma.202101358. ISSN 0935-9648.
  5. ^ a b c Sandoval-Diaz, Luis; Plodinec, Milivoj; Ivanov, Danail; Poitel, Stéphane; Hammud, Adnan; Nerl, Hannah C.; Schlögl, Robert; Lunkenbein, Thomas (2020). "Visualizing the importance of oxide-metal phase transitions in the production of synthesis gas over Ni catalysts". Journal of Energy Chemistry. 50. Elsevier BV: 178–186. doi:10.1016/j.jechem.2020.03.013. ISSN 2095-4956.
  6. ^ a b c d Ma, Jiqiang; Fan, Chenglong; Chen, Wenyuan; Tan, Hui; Zhu, Shengyu; Li, Qinglin; Yang, Jun (2022). "Core-shell structure in situ reinforced aluminum matrix composites: Microstructure, mechanical and tribological properties". Journal of Alloys and Compounds. 901. Elsevier BV: 163613. doi:10.1016/j.jallcom.2022.163613. ISSN 0925-8388.
  7. ^ a b c d e Bär, Florian; Berger, Leopold; Jauer, Lucas; Kurtuldu, Güven; Schäublin, Robin; Schleifenbaum, Johannes H.; Löffler, Jörg F. (2019). "Laser additive manufacturing of biodegradable magnesium alloy WE43: A detailed microstructure analysis". Acta Biomaterialia. 98. Elsevier BV: 36–49. doi:10.1016/j.actbio.2019.05.056. ISSN 1742-7061.
  8. ^ a b c d Hong, Zuliang; Morrison, Alasdair P. C.; Zhang, Hongtao; Roberts, Steve G.; Grant, Patrick S. (2017-12-04). "Development of a Novel Melt Spinning-Based Processing Route for Oxide Dispersion-Strengthened Steels". Metallurgical and Materials Transactions A. 49 (2). Springer Science and Business Media LLC: 604–612. doi:10.1007/s11661-017-4398-x. ISSN 1073-5623.
  9. ^ a b c d e f Cappia, F.; Winston, A.; Miller, B.; Kombaiah, B.; Teng, F.; Murray, D.; Frazer, D.; Harp, J.M. (2021). "Electron microscopy characterization of the fuel-cladding interaction in medium burnup annular fast reactor MOX". Journal of Nuclear Materials. 551. Elsevier BV: 152922. doi:10.1016/j.jnucmat.2021.152922. ISSN 0022-3115.
  10. ^ a b c Natalio, Filipe; Corrales, Tomas P.; Pierantoni, Maria; Rosenhek-Goldian, Irit; Cernescu, Adrian; Raguin, Emeline; Maria, Raquel; Cohen, Sidney R. (2021). "Characterization of Eocene flint". Chemical Geology. 582. Elsevier BV: 120427. doi:10.1016/j.chemgeo.2021.120427. ISSN 0009-2541.
  11. ^ a b Marattukalam, Jithin James; Pacheco, Victor; Karlsson, Dennis; Riekehr, Lars; Lindwall, Johan; Forsberg, Fredrik; Jansson, Ulf; Sahlberg, Martin; Hjörvarsson, Björgvin (2020). "Development of process parameters for selective laser melting of a Zr-based bulk metallic glass". Additive Manufacturing. 33. Elsevier BV: 101124. doi:10.1016/j.addma.2020.101124. ISSN 2214-8604.
  12. ^ a b c d e f Sun, Zhongji; Tan, Xipeng; Wang, Chengcheng; Descoins, Marion; Mangelinck, Dominique; Tor, Shu Beng; Jägle, Eric A.; Zaefferer, Stefan; Raabe, Dierk (2021). "Reducing hot tearing by grain boundary segregation engineering in additive manufacturing: example of an AlxCoCrFeNi high-entropy alloy". Acta Materialia. 204. Elsevier BV: 116505. doi:10.1016/j.actamat.2020.116505. ISSN 1359-6454.
  13. ^ a b c d Malinovskis, Paulius; Fritze, Stefan; Riekehr, Lars; von Fieandt, Linus; Cedervall, Johan; Rehnlund, David; Nyholm, Leif; Lewin, Erik; Jansson, Ulf (2018). "Synthesis and characterization of multicomponent (CrNbTaTiW)C films for increased hardness and corrosion resistance". Materials & Design. 149. Elsevier BV: 51–62. doi:10.1016/j.matdes.2018.03.068. ISSN 0264-1275.
  14. ^ a b c d Zhao, Shiteng; Kad, Bimal; Remington, Bruce A.; LaSalvia, Jerry C.; Wehrenberg, Christopher E.; Behler, Kristopher D.; Meyers, Marc A. (2016-10-12). "Directional amorphization of boron carbide subjected to laser shock compression". Proceedings of the National Academy of Sciences. 113 (43). Proceedings of the National Academy of Sciences: 12088–12093. doi:10.1073/pnas.1604613113. ISSN 0027-8424.
  15. ^ a b c d e Gora, Stephanie; Liang, Robert; Zhou, Y. Norman; Andrews, Susan (2018). "Settleable engineered titanium dioxide nanomaterials for the removal of natural organic matter from drinking water". Chemical Engineering Journal. 334. Elsevier BV: 638–649. doi:10.1016/j.cej.2017.10.058. ISSN 1385-8947.
  16. ^ a b c Schuler, Jennifer D.; Rupert, Timothy J. (2017). "Materials selection rules for amorphous complexion formation in binary metallic alloys". Acta Materialia. 140. Elsevier BV: 196–205. doi:10.1016/j.actamat.2017.08.042. ISSN 1359-6454.
  17. ^ a b c Sunkari, U.; Reddy, S. R.; Rathod, B. D. S.; Kumar, S. S. Satheesh; Saha, R.; Chatterjee, S.; Bhattacharjee, P. P. (2020-04-08). "Heterogeneous precipitation mediated heterogeneous nanostructure enhances strength-ductility synergy in severely cryo-rolled and annealed CoCrFeNi2.1Nb0.2 high entropy alloy". Scientific Reports. 10 (1). Springer Science and Business Media LLC. doi:10.1038/s41598-020-63038-z. ISSN 2045-2322.
  18. ^ a b c Nakayama, Kei; Ishikawa, Ryo; Kobayashi, Shunsuke; Shibata, Naoya; Ikuhara, Yuichi (2020-09-08). "Dislocation and oxygen-release driven delithiation in Li2MnO3". Nature Communications. 11 (1). Springer Science and Business Media LLC. doi:10.1038/s41467-020-18285-z. ISSN 2041-1723.
  19. ^ a b Yang, Chao; Muránsky, Ondrej; Zhu, Hanliang; Thorogood, Gordon; Avdeev, Maxim; Huang, Hefei; Zhou, Xingtai (2017-04-06). "The Effect of Milling Time on the Microstructural Characteristics and Strengthening Mechanisms of NiMo-SiC Alloys Prepared via Powder Metallurgy". Materials. 10 (4). MDPI AG: 389. doi:10.3390/ma10040389. ISSN 1996-1944.{{cite journal}}: CS1 maint: unflagged free DOI (link)
  20. ^ Gražulis, Saulius; Daškevič Adriana; Merkys Andrius; Chateigner Daniel; Lutterotti Luca; Quirós Miguel; Serebryanaya Nadezhda R; Moeck Peter; Downs Robert T; Le Bail Armel (Jan 2012). "Crystallography Open Database (COD): an open-access collection of crystal structures and platform for world-wide collaboration". Nucleic Acids Res. 40 (Database issue). England: D420-7. doi:10.1093/nar/gkr900. PMC 3245043. PMID 22070882.
  21. ^ "New developments in the Inorganic Crystal Structure Database (ICSD): accessibility in support of materials research and design". Acta Crystallographica Section B Structural Science. 58: 364–369. 2002. doi:10.1107/S0108768102006948. {{cite journal}}: Cite uses deprecated parameter |authors= (help)
  22. ^ Dave Mitchell (2022-02-05). "Ellipse fitting analysis".
  23. ^ Klinger, Miloslav; Polívka, Leoš; Jäger, Aleš; Tyunina, Marina (2016-04-12). "Quantitative analysis of structural inhomogeneity in nanomaterials using transmission electron microscopy". Journal of Applied Crystallography. 49 (3). International Union of Crystallography (IUCr): 762–770. doi:10.1107/s1600576716003800. ISSN 1600-5767.
  24. ^ Lowe, David G. (2004). "Distinctive Image Features from Scale-Invariant Keypoints". International Journal of Computer Vision. 60 (2). Springer Science and Business Media LLC: 91–110. doi:10.1023/b:visi.0000029664.99615.94. ISSN 0920-5691.
  25. ^ Atherton, T.J.; Kerbyson, D.J. (1999). "Size invariant circle detection". Image and Vision Computing. 17 (11). Elsevier BV: 795–803. doi:10.1016/s0262-8856(98)00160-7. ISSN 0262-8856.
  26. ^ Yuen, HK; Princen, J; Illingworth, J; Kittler, J (1990). "Comparative study of Hough Transform methods for circle finding". Image and Vision Computing. 8 (1). Elsevier BV: 71–77. doi:10.1016/0262-8856(90)90059-e. ISSN 0262-8856.
  27. ^ a b Klinger, M.; Němec, M.; Polívka, L.; Gärtnerová, V.; Jäger, A. (2015). "Automated CBED processing: Sample thickness estimation based on analysis of zone-axis CBED pattern". Ultramicroscopy. 150. Elsevier BV: 88–95. doi:10.1016/j.ultramic.2014.12.006. ISSN 0304-3991.
  28. ^ Martin A. Fischler & Robert C. Bolles (June 1981). "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography" (PDF). Comm. ACM. 24 (6): 381–395. doi:10.1145/358669.358692. S2CID 972888.
  29. ^ Morniroli, Jean Paul (2004). Large-Angle Convergent-Beam Electron Diffraction Applications to Crystal Defects. Taylor & Francis. doi:10.1201/9781420034073. ISBN 978-2-901483-05-2.
  30. ^ Allen, Samuel M. (1981). "Foil thickness measurements from convergent-beam diffraction patterns". Philosophical Magazine A. 43 (2). Informa UK Limited: 325–335. doi:10.1080/01418618108239412. ISSN 0141-8610.
  31. ^ Hÿtch, M.J. (1997). "Geometric phase analysis of high resolution electron microscope images". Scanning Microscopy. 11: 53–66.
  32. ^ Hÿtch, M.J.; Snoeck, E.; Kilaas, R. (1998). "Quantitative measurement of displacement and strain fields from HREM micrographs". Ultramicroscopy. 74 (3). Elsevier BV: 131–146. doi:10.1016/s0304-3991(98)00035-7. ISSN 0304-3991.

External links edit