{"id":1512,"date":"2019-02-06T22:47:24","date_gmt":"2019-02-07T02:47:24","guid":{"rendered":"https:\/\/www.ece.ncsu.edu\/?p=232347"},"modified":"2019-02-06T22:47:24","modified_gmt":"2019-02-07T02:47:24","slug":"artificial-intelligence-can-identify-microscopic-marine-organisms","status":"publish","type":"post","link":"https:\/\/my.ece.ncsu.edu\/communications\/2019\/artificial-intelligence-can-identify-microscopic-marine-organisms\/","title":{"rendered":"Artificial Intelligence Can Identify Microscopic Marine Organisms"},"content":{"rendered":"<p><img decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1024x576.jpg\" class=\"attachment-large size-large wp-post-image\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1024x576.jpg 1024w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-452x254.jpg 452w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-768x432.jpg 768w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1080x608.jpg 1080w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams.jpg 1422w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/p>\n<p>Researchers have developed an artificial intelligence (AI) program that can automatically provide species-level identification of microscopic marine organisms. The next step is to incorporate the AI into a robotic system that will help advance our understanding of the world\u2019s oceans, both now and in our prehistoric past.<\/p>\n<p>Specifically, the AI program has proven capable of identifying six species of foraminifera, or forams \u2013 organisms that have been prevalent in Earth\u2019s oceans for more than 100 million years.<\/p>\n<p>Forams are protists, neither plant nor animal. When they die, they leave behind their tiny shells, most less than a millimeter wide. These shells give scientists insights into the characteristics of the oceans as they existed when the forams were alive. For example, different types of foram species thrive in different kinds of ocean environments, and chemical measurements can tell scientists about everything from the ocean\u2019s chemistry to its temperature when the shell was being formed.<\/p>\n<p>However, evaluating those foram shells and fossils is both tedious and time consuming. That\u2019s why an interdisciplinary team of researchers, with expertise ranging from robotics to paleoceanography, is working to automate the process.<\/p>\n<p>\u201cAt this point, the AI correctly identifies the forams about 80 percent of the time, which is better than most trained humans,\u201d says Edgar Lobaton, an associate professor of electrical and computer engineering at North Carolina State University and co-author of a paper on the work.<\/p>\n<p>\u201cBut this is only the proof of concept. We expect the system to improve over time, because machine learning means the program will get more accurate and more consistent with every iteration. We also plan to expand the AI\u2019s purview, so that it can identify at least 35 species of forams, rather than the current six.\u201d<\/p>\n<p>The current system works by placing a foram under a microscope capable of taking photographs. An LED ring shines light onto the foram from 16 directions \u2013 one at a time \u2013 while taking an image of the foram with each change in light. These 16 images are combined to provide as much geometric information as possible about the foram\u2019s shape. The AI then uses this information to identify the foram\u2019s species.<\/p>\n<figure class=\"wp-block-image\"><img decoding=\"async\" src=\"https:\/\/news.ncsu.edu\/wp-content\/uploads\/2019\/02\/Lobaton-forams-2019-IN-TEXT.jpg\" alt=\"illustration of how the AI system is set up\" class=\"wp-image-483300\" \/><\/figure>\n<p>The scanning and identification takes only seconds, and is already as fast \u2013 or faster \u2013 than the fastest human experts.<\/p>\n<p>\u201cPlus, the AI doesn\u2019t get tired or bored,\u201d Lobaton says. \u201cThis work demonstrates the successful first step toward building a robotic platform that will be able to identify, pick and sort forams automatically.\u201d<\/p>\n<p>Lobaton and his collaborators have received a grant from the National Science Foundation (NSF), starting in January 2019, to build the fully-functional robotic system.<\/p>\n<p>\u201cThis work is important because oceans cover about 70 percent of Earth\u2019s surface and play an enormous role in its climate,\u201d says Tom Marchitto, an associate professor of geological sciences at the University of Colorado, Boulder, and corresponding author of the paper.<\/p>\n<p>\u201cForams are ubiquitous in our oceans, and the chemistry of their shells records the physical and chemical characteristics of the waters that they grew in. These tiny organisms bear witness to past properties like temperature, salinity, acidity and nutrient concentrations. In turn we can use those properties to reconstruct ocean circulation and heat transport during past climate events.<\/p>\n<p>\u201cThis matters because humanity is in the midst of an unintentional, global-scale climate \u2018experiment\u2019 due to our emission of greenhouse gases,\u201d Marchitto says. \u201cTo predict the outcomes of that experiment we need a better understanding of how Earth\u2019s climate behaves when its energy balance is altered. The new AI, and the robotic system it will enable, could significantly expedite our ability to learn more about the relationship between the climate and the oceans across vast time scales.\u201d<\/p>\n<p>The paper, \u201c<a rel=\"noreferrer noopener\" aria-label=\"Automated species-level identification of planktic foraminifera using convolutional neural networks, with comparison to human performance (opens in a new tab)\" href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0377839818301105?via%3Dihub\" >Automated species-level identification of planktic foraminifera using convolutional neural networks, with comparison to human performance<\/a>,\u201d is published in the journal <em>Marine Micropaleontology<\/em>. Lead author of the paper is Ritayan Mitra, a former postdoctoral researcher at NC State and the University of Colorado Boulder, who is now at IIT Bombay. Co-authors include Q. Ge and B. Zhong, Ph.D. students at NC State; B. Kanakiya, a former master\u2019s student at NC State; M.S. Cook of Williams College; J.S. Fehrenbacher of Oregon State University; J.D. Ortiz of Kent State University; and A. Tripati of UCLA.<\/p>\n<p>The AI work was done with support from NSF under grant number 1637039.<\/p>\n<p style=\"text-align:center\">-shipman-<\/p>\n<p><strong>Note to Editors:<\/strong> The study abstract follows.<\/p>\n<p><strong>\u201cAutomated species-level identification of planktic foraminifera using convolutional neural networks, with comparison to human performance\u201d<\/strong><\/p>\n<p><em>Authors<\/em>: R. Mitra and T.M. Marchitto, University of Colorado, Boulder; Q. Ge, B. Zhong, B. Kanakiya and E. Lobaton, North Carolina State University; M.S. Cook, Williams College; J.S. Fehrenbacher, Oregon State University; J.D. Ortiz, Kent State University; and A. Tripati, Indian Institute of Technology<\/p>\n<p><em>Published<\/em>: Jan. 25, <em>Marine Micropaleontology<\/em><\/p>\n<p><em>DOI<\/em>: 10.1016\/j.marmicro.2019.01.005<\/p>\n<p><strong>Abstract:<\/strong> Picking foraminifera from sediment samples is an essential, but repetitive and low-reward task that is well-suited for automation. The first step toward building a picking robot is the development of an automated identification system. We use machine learning techniques to train convolutional neural networks to identify six species of extant planktic foraminifera that are widely used by paleoceanographers. Identification includes distinguishing the six species from other taxa. Training and identification are based on reflected light microscope digital images taken at 16 different illumination angles using a light ring. Overall machine accuracy is better than 80% even with limited training. We compare machine performance to that of human pickers (six experts and five novices) by tasking each with the identification of 540 specimens based on images. Experts achieved comparable precision but poorer recall relative to the machine, with an average accuracy of 63%. Novices scored lower than experts on both precision and recall, for an overall accuracy of 53%. The machine achieved fairly uniform performance across the six species, while participants\u2019 scores were strongly species-dependent, commensurate with their past experience and expertise. The machine was also less sensitive to specimen orientation (umbilical versus spiral views) than the humans. These results demonstrate that our approach can provide a versatile \u2018brain\u2019 for an eventual automated robotic picking system.<\/p>\n<p><em>This post was <a href=\"https:\/\/news.ncsu.edu\/2019\/02\/artificial-intelligence-can-identify-microscopic-marine-organisms\/\">originally published<\/a> in NC State News.<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"<p><img decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1024x576.jpg\" class=\"attachment-large size-large wp-post-image\" alt=\"\" loading=\"lazy\" srcset=\"https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1024x576.jpg 1024w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-452x254.jpg 452w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-768x432.jpg 768w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams-1080x608.jpg 1080w, https:\/\/ece.ncsu.edu\/wp-content\/uploads\/2019\/02\/forams.jpg 1422w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\">How AI advances can help us understand prehistoric oceans.<\/p>\n","protected":false},"author":9,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"ncst_dynamicHeaderBlockName":"","ncst_dynamicHeaderData":"","ncst_content_audit_freq":"","ncst_content_audit_date":"","ncst_content_audit_display":false,"ncst_backToTopFlag":"","footnotes":""},"categories":[179],"tags":[],"class_list":["post-1512","post","type-post","status-publish","format-standard","hentry","category-news"],"displayCategory":null,"acf":{"ncst_posts_meta_modified_date":null},"_links":{"self":[{"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/posts\/1512","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/users\/9"}],"replies":[{"embeddable":true,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/comments?post=1512"}],"version-history":[{"count":2,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/posts\/1512\/revisions"}],"predecessor-version":[{"id":2647,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/posts\/1512\/revisions\/2647"}],"wp:attachment":[{"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/media?parent=1512"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/categories?post=1512"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/my.ece.ncsu.edu\/communications\/wp-json\/wp\/v2\/tags?post=1512"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}