Symbolic regression is a powerful technique to discover analytic equations that describe data, which can lead to explainable models and the ability to predict unseen data. In contrast, neural networks have achieved amazing levels of accuracy on image recognition and natural language processing tasks, but they are often seen as black-box models that are difficult to interpret and typically extrapolate poorly. In this article, we use a neural network-based architecture for symbolic regression called the equation learner (EQL) network and integrate it with other deep learning architectures such that the whole system can be trained end-to-end through backpropagation. To demonstrate the power of such systems, we study their performance on several substantially different tasks. First, we show that the neural network can perform symbolic regression and learn the form of several functions. Next, we present an MNIST arithmetic task where a convolutional network extracts the digits. Finally, we demonstrate the prediction of dynamical systems where an unknown parameter is extracted through an encoder. We find that the EQL-based architecture can extrapolate quite well outside of the training data set compared with a standard neural network-based architecture, paving the way for deep learning to be applied in scientific exploration and discovery<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"
We will discuss about \u201cIntegration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\u201d IEEE Transactions on neural networks and learning systems 32.9 (2020): 4166-4177. Abstract Symbolic regression … <\/p>\n
Continue reading “Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery”<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":0,"template":"","meta":{"_editorskit_title_hidden":false,"_editorskit_reading_time":0,"_editorskit_is_block_options_detached":false,"_editorskit_block_options_position":"{}","_uag_custom_page_level_css":"","_tribe_events_status":"","_tribe_events_status_reason":"","footnotes":""},"tags":[],"tribe_events_cat":[219],"class_list":["post-8754","tribe_events","type-tribe_events","status-publish","hentry","tribe_events_cat-journal-club","cat_journal-club"],"yoast_head":"\nHyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group\" \/>\n<meta property=\"og:description\" content=\"We will discuss about \u201cIntegration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\u201d IEEE Transactions on neural networks and learning systems 32.9 (2020): 4166-4177. Abstract Symbolic regression … Continue reading "Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/\" \/>\n<meta property=\"og:site_name\" content=\"Biomedical Mathematics Group\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-15T00:47:43+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2024-01-05-jc\\\/\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2024-01-05-jc\\\/\",\"name\":\"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#website\"},\"datePublished\":\"2023-11-30T08:49:19+00:00\",\"dateModified\":\"2023-12-15T00:47:43+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2024-01-05-jc\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2024-01-05-jc\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/event\\\/2024-01-05-jc\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Events\",\"item\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/events\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#website\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\",\"name\":\"Biomedical Mathematics Group\",\"description\":\"\uae30\ucd08\uacfc\ud559\uc5f0\uad6c\uc6d0 \uc758\uc0dd\uba85\uc218\ud559\uadf8\ub8f9\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#organization\",\"name\":\"IBS Biomedical Mathematics Group\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/cms\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/ibs-circle-1.png\",\"contentUrl\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/cms\\\/wp-content\\\/uploads\\\/2021\\\/02\\\/ibs-circle-1.png\",\"width\":250,\"height\":250,\"caption\":\"IBS Biomedical Mathematics Group\"},\"image\":{\"@id\":\"https:\\\/\\\/www.ibs.re.kr\\\/bimag\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/","og_locale":"en_US","og_type":"article","og_title":"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group","og_description":"We will discuss about \u201cIntegration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\u201d IEEE Transactions on neural networks and learning systems 32.9 (2020): 4166-4177. Abstract Symbolic regression … Continue reading \"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\"","og_url":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/","og_site_name":"Biomedical Mathematics Group","article_modified_time":"2023-12-15T00:47:43+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/","url":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/","name":"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery - Biomedical Mathematics Group","isPartOf":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#website"},"datePublished":"2023-11-30T08:49:19+00:00","dateModified":"2023-12-15T00:47:43+00:00","breadcrumb":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.ibs.re.kr\/bimag\/event\/2024-01-05-jc\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.ibs.re.kr\/bimag\/"},{"@type":"ListItem","position":2,"name":"Events","item":"https:\/\/www.ibs.re.kr\/bimag\/events\/"},{"@type":"ListItem","position":3,"name":"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery"}]},{"@type":"WebSite","@id":"https:\/\/www.ibs.re.kr\/bimag\/#website","url":"https:\/\/www.ibs.re.kr\/bimag\/","name":"Biomedical Mathematics Group","description":"\uae30\ucd08\uacfc\ud559\uc5f0\uad6c\uc6d0 \uc758\uc0dd\uba85\uc218\ud559\uadf8\ub8f9","publisher":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.ibs.re.kr\/bimag\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.ibs.re.kr\/bimag\/#organization","name":"IBS Biomedical Mathematics Group","url":"https:\/\/www.ibs.re.kr\/bimag\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.ibs.re.kr\/bimag\/#\/schema\/logo\/image\/","url":"https:\/\/www.ibs.re.kr\/bimag\/cms\/wp-content\/uploads\/2021\/02\/ibs-circle-1.png","contentUrl":"https:\/\/www.ibs.re.kr\/bimag\/cms\/wp-content\/uploads\/2021\/02\/ibs-circle-1.png","width":250,"height":250,"caption":"IBS Biomedical Mathematics Group"},"image":{"@id":"https:\/\/www.ibs.re.kr\/bimag\/#\/schema\/logo\/image\/"}}]}},"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"dimag-thumbnail":false,"twentyseventeen-featured-image":false,"twentyseventeen-thumbnail-avatar":false},"uagb_author_info":{"display_name":"Hyeontae Jo","author_link":"https:\/\/www.ibs.re.kr\/bimag\/author\/ibs-htj\/"},"uagb_comment_info":0,"uagb_excerpt":"We will discuss about \u201cIntegration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\u201d IEEE Transactions on neural networks and learning systems 32.9 (2020): 4166-4177. Abstract Symbolic regression … Continue reading \"Hyeontae Jo, Integration of Neural Network-Based Symbolic Regression in Deep Learning for Scientific Discovery\"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/8754","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events"}],"about":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/types\/tribe_events"}],"author":[{"embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/users\/4"}],"version-history":[{"count":3,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/8754\/revisions"}],"predecessor-version":[{"id":8775,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events\/8754\/revisions\/8775"}],"wp:attachment":[{"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/media?parent=8754"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tags?post=8754"},{"taxonomy":"tribe_events_cat","embeddable":true,"href":"https:\/\/www.ibs.re.kr\/bimag\/wp-json\/wp\/v2\/tribe_events_cat?post=8754"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}