Flexible workflows for on-the-fly electron-microscopy single-particle image processing using Scipion - PubMed
- ️Tue Jan 01 2019
. 2019 Oct 1;75(Pt 10):882-894.
doi: 10.1107/S2059798319011860. Epub 2019 Oct 1.
T Majtner 1 , P Horvath 1 , J L Vilas 1 , A Jiménez-Moreno 1 , J Mota 1 , E Ramírez-Aportela 1 , R Sánchez-García 1 , P Conesa 1 , L Del Caño 1 , Y Rancel 1 , Y Fonseca 1 , M Martínez 1 , G Sharov 2 , C A García 3 , D Strelak 1 , R Melero 1 , R Marabini 4 , J M Carazo 1 , C O S Sorzano 1
Affiliations
- PMID: 31588920
- PMCID: PMC6778851
- DOI: 10.1107/S2059798319011860
Flexible workflows for on-the-fly electron-microscopy single-particle image processing using Scipion
D Maluenda et al. Acta Crystallogr D Struct Biol. 2019.
Abstract
Electron microscopy of macromolecular structures is an approach that is in increasing demand in the field of structural biology. The automation of image acquisition has greatly increased the potential throughput of electron microscopy. Here, the focus is on the possibilities in Scipion to implement flexible and robust image-processing workflows that allow the electron-microscope operator and the user to monitor the quality of image acquisition, assessing very simple acquisition measures or obtaining a first estimate of the initial volume, or the data resolution and heterogeneity, without any need for programming skills. These workflows can implement intelligent automatic decisions and they can warn the user of possible acquisition failures. These concepts are illustrated by analysis of the well known 2.2 Å resolution β-galactosidase data set.
Keywords: Scipion; electron microscopy; electron-microscopy facilities; image processing; single-particle analysis; stream processing.
open access.
Figures

Example of automatic CTF selection for the 2.2 Å resolution β-galactosidase data set. Left: CTF disabled as Xmipp CTF estimates defocus U as 1.35 µm and defocus V as 1.21 µm, resulting in 0.14 µm of astigmatism in this case (less than 1% of the micrographs are disabled by this criterion). Centre: CTF disabled owing to poor visibility of the Thon rings (about 5% of the micrographs are disabled owing to this criterion). Right: CTF disabled owing to a large discrepancy between Xmipp CTF and CTFFind4 (about 5% of the micrograph are disabled owing to this criterion). After visual inspection, we realized that CTFFind4 has failed in this case.

HTML summary of monitoring for the acquisition simulation of EMPIAR data set 10061. (a) Project summary, (b) the maximum resolution and defocusing histograms according to the CTF estimations, (c) CTF values (resolution, defocusing and phase) over time, (d) gain evolution, (e) system monitoring showing the CPU and RAM load and the swap over time and (f) the micrograph list showing the thumbnails of the aligned micrographs, the shift drift during the alignment, the estimated CTF and other estimated parameters, such as defocusing, astigmatism, maximum resolution, cross-correlation with the theoretical CTF and the astigmatism ratio.

Particle-picking stage. Left: semi-automatic picking workflow, where manual picking trains the Xmipp auto-picking and fixes the particle size for EMAN2 SPARX. Right: fully automatic picking workflow using EMAN2 SPARX and Sphire-crYOLO, where the box size is estimated by Xmipp. The AND and OR consensus strategy is followed for both workflows and the resulting selections for certain micrographs from EMPIAR data set 10061, are shown.

Automatic particle rejection for two micrographs from EMPIAR data set 10061. The red circles correspond to those particles that were labeled as incorrect, whereas the green circles correspond to those that were considered suitable to continue in the pipeline. The number beside each rejected particle corresponds to the reason why it was rejected (see Section 3).

Automatic 2D class selection. Top: classes automatically selected for further processing. Bottom: classes automatically disabled as having either a heterogeneous background or representing very few particles.

Workflow example of 2D classification (purple boxes) and initial volume reconstruction (brown boxes). Since the 2D analysis is carried out on downsampled images, the resulting initial volume is resized to the original size (green box). The volume shown at the side of the workflow corresponds to the classification of 5000 particles from the 2.2 Å resolution β-galactosidase data set, which results in 17 automatically selected classes from a total of 32 (16 for CL2D and 16 for RELION 2D). In addition, Xmipp Swarm consensus has merged 21 initial volumes (ten from EMAN, ten from Xmipp Ransac and one from Xmipp Significant).

Example of a workflow downloaded from the public repository
http://workflows.scipion.i2pc.es.

Example of a high-level tool that can create a configurable image-processing workflow in streaming. The tool gives a choice between different algorithmic alternatives for each of the steps and of the configuration of the hardware (in particular GPU and CPU) usage.

Example of a high-level web tool that can import an existing processing streaming workflow.
Similar articles
-
de la Rosa-Trevín JM, Quintana A, Del Cano L, Zaldívar A, Foche I, Gutiérrez J, Gómez-Blanco J, Burguet-Castell J, Cuenca-Alba J, Abrishami V, Vargas J, Otón J, Sharov G, Vilas JL, Navas J, Conesa P, Kazemi M, Marabini R, Sorzano CO, Carazo JM. de la Rosa-Trevín JM, et al. J Struct Biol. 2016 Jul;195(1):93-9. doi: 10.1016/j.jsb.2016.04.010. Epub 2016 Apr 20. J Struct Biol. 2016. PMID: 27108186
-
cisTEM, user-friendly software for single-particle image processing.
Grant T, Rohou A, Grigorieff N. Grant T, et al. Elife. 2018 Mar 7;7:e35383. doi: 10.7554/eLife.35383. Elife. 2018. PMID: 29513216 Free PMC article.
-
Using Scipion for stream image processing at Cryo-EM facilities.
Gómez-Blanco J, de la Rosa-Trevín JM, Marabini R, Del Cano L, Jiménez A, Martínez M, Melero R, Majtner T, Maluenda D, Mota J, Rancel Y, Ramírez-Aportela E, Vilas JL, Carroni M, Fleischmann S, Lindahl E, Ashton AW, Basham M, Clare DK, Savage K, Siebert CA, Sharov GG, Sorzano COS, Conesa P, Carazo JM. Gómez-Blanco J, et al. J Struct Biol. 2018 Dec;204(3):457-463. doi: 10.1016/j.jsb.2018.10.001. Epub 2018 Oct 5. J Struct Biol. 2018. PMID: 30296492 Free PMC article.
-
Automated data collection in single particle electron microscopy.
Tan YZ, Cheng A, Potter CS, Carragher B. Tan YZ, et al. Microscopy (Oxf). 2016 Feb;65(1):43-56. doi: 10.1093/jmicro/dfv369. Epub 2015 Dec 15. Microscopy (Oxf). 2016. PMID: 26671944 Free PMC article. Review.
-
Ruprecht J, Nield J. Ruprecht J, et al. Prog Biophys Mol Biol. 2001;75(3):121-64. doi: 10.1016/s0079-6107(01)00004-9. Prog Biophys Mol Biol. 2001. PMID: 11376797 Review.
Cited by
-
Wagner T, Raunser S. Wagner T, et al. Commun Biol. 2020 Feb 11;3(1):61. doi: 10.1038/s42003-020-0790-y. Commun Biol. 2020. PMID: 32047248 Free PMC article.
-
TranSPHIRE: automated and feedback-optimized on-the-fly processing for cryo-EM.
Stabrin M, Schoenfeld F, Wagner T, Pospich S, Gatsogiannis C, Raunser S. Stabrin M, et al. Nat Commun. 2020 Nov 11;11(1):5716. doi: 10.1038/s41467-020-19513-2. Nat Commun. 2020. PMID: 33177513 Free PMC article.
-
SINGLE: Atomic-resolution structure identification of nanocrystals by graphene liquid cell EM.
Reboul CF, Heo J, Machello C, Kiesewetter S, Kim BH, Kim S, Elmlund D, Ercius P, Park J, Elmlund H. Reboul CF, et al. Sci Adv. 2021 Jan 29;7(5):eabe6679. doi: 10.1126/sciadv.abe6679. Print 2021 Jan. Sci Adv. 2021. PMID: 33514557 Free PMC article.
-
SIMPLE 3.0. Stream single-particle cryo-EM analysis in real time.
Caesar J, Reboul CF, Machello C, Kiesewetter S, Tang ML, Deme JC, Johnson S, Elmlund D, Lea SM, Elmlund H. Caesar J, et al. J Struct Biol X. 2020 Nov 7;4:100040. doi: 10.1016/j.yjsbx.2020.100040. eCollection 2020. J Struct Biol X. 2020. PMID: 33294840 Free PMC article.
-
Rice G, Wagner T, Stabrin M, Sitsel O, Prumbaum D, Raunser S. Rice G, et al. Nat Methods. 2023 Jun;20(6):871-880. doi: 10.1038/s41592-023-01878-z. Epub 2023 May 15. Nat Methods. 2023. PMID: 37188953 Free PMC article.
References
-
- Abrishami, V., Vargas, J., Li, X., Cheng, Y., Marabini, R., Sorzano, C. Ó. S. & Carazo, J. M. (2015). J. Struct. Biol. 189, 163–176. - PubMed
-
- Abrishami, V., Zaldívar-Peraza, A., de la Rosa-Trevín, J. M., Vargas, J., Otón, J., Marabini, R., Shkolnisky, Y., Carazo, J. M. & Sorzano, C. O. S. (2013). Bioinformatics, 29, 2460–2468. - PubMed
-
- Alewijnse, B., Ashton, A. W., Chambers, M. G., Chen, S., Cheng, A., Ebrahim, M., Eng, E. T., Hagen, W. J. H., Koster, A. J., López, C. S., Lukoyanova, N., Ortega, J., Renault, L., Reyntjens, S., Rice, W. J., Scapin, G., Schrijver, R., Siebert, A., Stagg, S. M., Grum-Tokars, V., Wright, E. R., Wu, S., Yu, Z., Zhou, Z. H., Carragher, B. & Potter, C. S. (2017). J. Struct. Biol. 199, 225–236. - PMC - PubMed
-
- Biyani, N., Righetto, R. D., McLeod, R., Caujolle-Bert, D., Castano-Diez, D., Goldie, K. N. & Stahlberg, H. (2017). J. Struct. Biol. 198, 124–133. - PubMed
MeSH terms
Substances
Grants and funding
LinkOut - more resources
Full Text Sources