{"id":4710,"date":"2021-07-05T15:16:40","date_gmt":"2021-07-05T06:16:40","guid":{"rendered":"https:\/\/www.ibs.re.kr\/bimag\/?post_type=tribe_events&#038;p=4710"},"modified":"2021-07-05T22:16:43","modified_gmt":"2021-07-05T13:16:43","slug":"2021-07-09","status":"publish","type":"tribe_events","link":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/","title":{"rendered":"DeepCME: A deep learning framework for solving the Chemical Master Equation"},"content":{"rendered":"<p>We will discuss about \u201cDeepCME: A deep learning framework for solving the Chemical Master Equation,\u201d Gupta et al., bioRxiv, 2021<\/p>\n<p>Stochastic models of biomolecular reaction networks are commonly employed in systems and synthetic biology to study the effects of stochastic fluctuations emanating from reactions involving species with low copy-numbers. For such models, the Kolmogorov\u2019s forward equation is called the chemical master equation (CME), and it is a fundamental system of linear ordinary differential equations (ODEs) that describes the evolution of the probability distribution of the random state-vector representing the copy-numbers of all the reacting species. The size of this system is given by the number of states that are accessible by the chemical system, and for most examples of interest this number is either very large or infinite. Moreover, approximations that reduce the size of the system by retaining only a finite number of important chemical states (e.g. those with non-negligible probability) result in high-dimensional ODE systems, even when the number of reacting species is small. Consequently, accurate numerical solution of the CME is very challenging, despite the linear nature of the underlying ODEs. One often resorts to estimating the solutions via computationally intensive stochastic simulations. The goal of the present paper is to develop a novel deep-learning approach for solving high-dimensional CMEs by reformulating the stochastic dynamics using Kolmogorov\u2019s backward equation. The proposed method leverages superior approximation properties of Deep Neural Networks (DNNs) and is algorithmically based on reinforcement learning. It only requires a moderate number of stochastic simulations (in comparison to typical simulation-based approaches) to train the \u201cpolicy function\u201d. This allows not just the numerical approximation of the CME solution but also of its sensitivities to all the reaction network parameters (e.g. rate constants). We provide four examples to illustrate our methodology and provide several directions for future research.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>We will discuss about \u201cDeepCME: A deep learning framework for solving the Chemical Master Equation,\u201d Gupta et al., bioRxiv, 2021 Stochastic models of biomolecular reaction networks are commonly employed in &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;DeepCME: A deep learning framework for solving the Chemical Master Equation&#8221;<\/span><\/a><\/p>\n","protected":false},"author":3,"featured_media":0,"template":"","meta":{"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","_uag_custom_page_level_css":"","_tribe_events_status":"","_tribe_events_status_reason":"","footnotes":""},"tags":[],"tribe_events_cat":[219],"class_list":["post-4710","tribe_events","type-tribe_events","status-publish","hentry","tribe_events_cat-journal-club","cat_journal-club"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.5 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group\" \/>\n<meta property=\"og:description\" content=\"We will discuss about \u201cDeepCME: A deep learning framework for solving the Chemical Master Equation,\u201d Gupta et al., bioRxiv, 2021 Stochastic models of biomolecular reaction networks are commonly employed in &hellip; Continue reading &quot;DeepCME: A deep learning framework for solving the Chemical Master Equation&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/\" \/>\n<meta property=\"og:site_name\" content=\"Biomedical Mathematics Group\" \/>\n<meta property=\"article:modified_time\" content=\"2021-07-05T13:16:43+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2021-07-09\\\/\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2021-07-09\\\/\",\"name\":\"DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#website\"},\"datePublished\":\"2021-07-05T06:16:40+00:00\",\"dateModified\":\"2021-07-05T13:16:43+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2021-07-09\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2021-07-09\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2021-07-09\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Events\",\"item\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/events\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"DeepCME: A deep learning framework for solving the Chemical Master Equation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#website\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\",\"name\":\"Biomedical Mathematics Group\",\"description\":\"\uae30\ucd08\uacfc\ud559\uc5f0\uad6c\uc6d0 \uc758\uc0dd\uba85\uc218\ud559\uadf8\ub8f9\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#organization\",\"name\":\"IBS Biomedical Mathematics Group\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/cms\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/ibs-circle-1.png\",\"contentUrl\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/cms\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/ibs-circle-1.png\",\"width\":250,\"height\":250,\"caption\":\"IBS Biomedical Mathematics Group\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/","og_locale":"en_US","og_type":"article","og_title":"DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group","og_description":"We will discuss about \u201cDeepCME: A deep learning framework for solving the Chemical Master Equation,\u201d Gupta et al., bioRxiv, 2021 Stochastic models of biomolecular reaction networks are commonly employed in &hellip; Continue reading \"DeepCME: A deep learning framework for solving the Chemical Master Equation\"","og_url":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/","og_site_name":"Biomedical Mathematics Group","article_modified_time":"2021-07-05T13:16:43+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/","url":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/","name":"DeepCME: A deep learning framework for solving the Chemical Master Equation - Biomedical Mathematics Group","isPartOf":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#website"},"datePublished":"2021-07-05T06:16:40+00:00","dateModified":"2021-07-05T13:16:43+00:00","breadcrumb":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2021-07-09\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ibs.re.kr\/bimag\/"},{"@type":"ListItem","position":2,"name":"Events","item":"https:\/\/www.ibs.re.kr\/bimag\/events\/"},{"@type":"ListItem","position":3,"name":"DeepCME: A deep learning framework for solving the Chemical Master Equation"}]},{"@type":"WebSite","@id":"https:\/\/www.ibs.re.kr\/bimag\/#website","url":"https:\/\/www.ibs.re.kr\/bimag\/","name":"Biomedical Mathematics Group","description":"\uae30\ucd08\uacfc\ud559\uc5f0\uad6c\uc6d0 \uc758\uc0dd\uba85\uc218\ud559\uadf8\ub8f9","publisher":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ibs.re.kr\/bimag\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.ibs.re.kr\/bimag\/#organization","name":"IBS Biomedical Mathematics Group","url":"https:\/\/www.ibs.re.kr\/bimag\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ibs.re.kr\/bimag\/#\/schema\/logo\/image\/","url":"https:\/\/www.ibs.re.kr\/bimag\/cms\/wp-content\/uploads\/2021\/02\/ibs-circle-1.png","contentUrl":"https:\/\/www.ibs.re.kr\/bimag\/cms\/wp-content\/uploads\/2021\/02\/ibs-circle-1.png","width":250,"height":250,"caption":"IBS Biomedical Mathematics Group"},"image":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#\/schema\/logo\/image\/"}}]}},"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"dimag-thumbnail":false,"twentyseventeen-featured-image":false,"twentyseventeen-thumbnail-avatar":false},"uagb_author_info":{"display_name":"BIMAG","author_link":"https:\/\/www.ibs.re.kr\/bimag\/author\/hphongblog\/"},"uagb_comment_info":0,"uagb_excerpt":"We will discuss about \u201cDeepCME: A deep learning framework for solving the Chemical Master Equation,\u201d Gupta et al., bioRxiv, 2021 Stochastic models of biomolecular reaction networks are commonly employed in &hellip; Continue reading \"DeepCME: A deep learning framework for solving the Chemical Master Equation\"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/4710","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events"}],"about":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/types\/tribe_events"}],"author":[{"embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/users\/3"}],"version-history":[{"count":3,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/4710\/revisions"}],"predecessor-version":[{"id":4713,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/4710\/revisions\/4713"}],"wp:attachment":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/media?parent=4710"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tags?post=4710"},{"taxonomy":"tribe_events_cat","embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events_cat?post=4710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}