The field of bioimage analysis is poised for a major transformation, owing to advancements in imaging technologies and artificial intelligence. The emergence of multimodal foundation models — which are akin to large language models (such as ChatGPT) but are capable of comprehending and processing biological images — holds great potential for ushering in a revolutionary era in bioimage analysis.
This is a preview of subscription content, access via your institution
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 print issues and online access
$259.00 per year
only $21.58 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
References
Li, W., Maekiniemi, A., Sato, H., Osman, C. & Singer, R. H. Nat. Methods 19, 1558–1562 (2022).
Yeh, L.-H. et al. Preprint at bioRxiv https://doi.org/10.1101/2020.12.15.422951 (2021).
Tang, P. et al. Light Sci. Appl. 10, 237 (2021).
Hobson, C. M., Aaron, J. S., Heddleston, J. M. & Chew, T.-L. Front. Cell Dev. Biol. 9, 706126 (2021).
Antonacci, G. et al. Biophys. Rev. 12, 615–624 (2020).
Fujiwara, M. et al. Carbon 198, 57–62 (2022).
Slenders, E. et al. Light Sci. Appl. 10, 31 (2021).
Popkin, G. Nature 529, 16–18 (2016).
Pachitariu, M. & Stringer, C. Nat. Methods 19, 1634–1641 (2022).
Schmidt, U., Weigert, M., Broaddus, C. & Myers, G. Cell detection with star-convex polygons. In Medical Image Computing and Computer Assisted Intervention – MICCAI 2018 (eds. Frangi, A. F. et al. 265–273 (Springer International, 2018).
Ditchburn, R. W. & Drysdale, A. E. Vision Res. 13, 2423–2433 (1973).
Brown, T. B. et al. Preprint at https://doi.org/10.48550/arXiv.2005.14165 (2020).
Kobayashi, H., Cheveralls, K. C., Leonetti, M. D. & Royer, L. A. Nat. Methods 19, 995–1003 (2022).
Fang, Y. et al. Preprint at https://doi.org/10.48550/arXiv.2211.07636 (2022).
Yuan, L. et al. Preprint at https://doi.org/10.48550/arXiv.2111.11432 (2021).
Radford, A. et al. Preprint at https://doi.org/10.48550/arXiv.2103.00020 (2021).
Caron, M. et al. Emerging properties in self-supervised vision transformers. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV) 9630–9640 (IEEE, 2021).
Wu, C. et al. Preprint at https://doi.org/10.48550/arXiv.2303.04671 (2023).
Tay, Y. et al. Preprint at https://doi.org/10.48550/arXiv.2210.11399 (2022).
Xiao, G. et al. Preprint at https://doi.org/10.48550/arXiv.2211.10438 (2022).
Frantar, E. & Alistarh, D. Preprint at https://doi.org/10.48550/arXiv.2301.00774 (2023).
Acknowledgements
I thank S. Schmid, K. Balla, J. Bragantini, A. Jacobo, M. Lange and S. Mehta for proofreading and feedback.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The author declares no competing interests.
Rights and permissions
About this article
Cite this article
Royer, L.A. The future of bioimage analysis: a dialog between mind and machine. Nat Methods 20, 951–952 (2023). https://doi.org/10.1038/s41592-023-01930-y
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41592-023-01930-y
