Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks
Events
Loading … Spinner

Mendeley | Further Information

{"title"=>"Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks", "type"=>"journal", "authors"=>[{"first_name"=>"Roby", "last_name"=>"Velez", "scopus_author_id"=>"56315585200"}, {"first_name"=>"Jeff", "last_name"=>"Clune", "scopus_author_id"=>"23388416900"}], "year"=>2017, "source"=>"PLoS ONE", "identifiers"=>{"sgr"=>"85034566696", "arxiv"=>"1705.07241", "pui"=>"619286349", "isbn"=>"1111111111", "scopus"=>"2-s2.0-85034566696", "doi"=>"10.1371/journal.pone.0187736", "issn"=>"19326203"}, "id"=>"6cbc3c49-acaf-3ed1-be06-b90e01785095", "abstract"=>"A long-term goal of AI is to produce agents that can learn a diversity of skills throughout their lifetimes and continuously improve those skills via experience. A longstanding obstacle towards that goal is catastrophic forgetting, which is when learning new information erases previously learned information. Catastrophic forgetting occurs in artificial neural networks (ANNs), which have fueled most recent advances in AI. A recent paper proposed that catastrophic forgetting in ANNs can be reduced by promoting modularity, which can limit forgetting by isolating task information to specific clusters of nodes and connections (functional modules). While the prior work did show that modular ANNs suffered less from catastrophic forgetting, it was not able to produce ANNs that possessed task-specific functional modules, thereby leaving the main theory regarding modularity and forgetting untested. We introduce diffusion-based neuromodulation, which simulates the release of diffusing, neuromodulatory chemicals within an ANN that can modulate (i.e. up or down regulate) learning in a spatial region. On the simple diagnostic problem from the prior work, diffusion-based neuromodulation 1) induces task-specific learning in groups of nodes and connections (task-specific localized learning), which 2) produces functional modules for each subtask, and 3) yields higher performance by eliminating catastrophic forgetting. Overall, our results suggest that diffusion-based neuromodulation promotes task-specific localized learning and functional modularity, which can help solve the challenging, but important problem of catastrophic forgetting.", "link"=>"http://www.mendeley.com/research/diffusionbased-neuromodulation-eliminate-catastrophic-forgetting-simple-neural-networks", "reader_count"=>39, "reader_count_by_academic_status"=>{"Unspecified"=>4, "Professor > Associate Professor"=>1, "Researcher"=>4, "Student > Ph. D. Student"=>12, "Student > Postgraduate"=>2, "Student > Master"=>9, "Other"=>1, "Student > Bachelor"=>3, "Lecturer"=>1, "Lecturer > Senior Lecturer"=>1, "Professor"=>1}, "reader_count_by_user_role"=>{"Unspecified"=>4, "Professor > Associate Professor"=>1, "Researcher"=>4, "Student > Ph. D. Student"=>12, "Student > Postgraduate"=>2, "Student > Master"=>9, "Other"=>1, "Student > Bachelor"=>3, "Lecturer"=>1, "Lecturer > Senior Lecturer"=>1, "Professor"=>1}, "reader_count_by_subject_area"=>{"Unspecified"=>7, "Engineering"=>6, "Mathematics"=>1, "Agricultural and Biological Sciences"=>1, "Neuroscience"=>2, "Psychology"=>2, "Computer Science"=>20}, "reader_count_by_subdiscipline"=>{"Engineering"=>{"Engineering"=>6}, "Neuroscience"=>{"Neuroscience"=>2}, "Psychology"=>{"Psychology"=>2}, "Agricultural and Biological Sciences"=>{"Agricultural and Biological Sciences"=>1}, "Computer Science"=>{"Computer Science"=>20}, "Mathematics"=>{"Mathematics"=>1}, "Unspecified"=>{"Unspecified"=>7}}, "group_count"=>2}

Scopus | Further Information

{"@_fa"=>"true", "link"=>[{"@_fa"=>"true", "@ref"=>"self", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/85034566696"}, {"@_fa"=>"true", "@ref"=>"author-affiliation", "@href"=>"https://api.elsevier.com/content/abstract/scopus_id/85034566696?field=author,affiliation"}, {"@_fa"=>"true", "@ref"=>"scopus", "@href"=>"https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85034566696&origin=inward"}, {"@_fa"=>"true", "@ref"=>"scopus-citedby", "@href"=>"https://www.scopus.com/inward/citedby.uri?partnerID=HzOxMe3b&scp=85034566696&origin=inward"}], "prism:url"=>"https://api.elsevier.com/content/abstract/scopus_id/85034566696", "dc:identifier"=>"SCOPUS_ID:85034566696", "eid"=>"2-s2.0-85034566696", "dc:title"=>"Diffusion-based neuromodulation can eliminate catastrophic forgetting in simple neural networks", "dc:creator"=>"Velez R.", "prism:publicationName"=>"PLoS ONE", "prism:eIssn"=>"19326203", "prism:volume"=>"12", "prism:issueIdentifier"=>"11", "prism:pageRange"=>nil, "prism:coverDate"=>"2017-11-01", "prism:coverDisplayDate"=>"November 2017", "prism:doi"=>"10.1371/journal.pone.0187736", "citedby-count"=>"2", "affiliation"=>[{"@_fa"=>"true", "affilname"=>"University of Wyoming", "affiliation-city"=>"Laramie", "affiliation-country"=>"United States"}], "pubmed-id"=>"29145413", "prism:aggregationType"=>"Journal", "subtype"=>"ar", "subtypeDescription"=>"Article", "article-number"=>"e0187736", "source-id"=>"10600153309", "openaccess"=>"1", "openaccessFlag"=>true}

Counter

  • {"month"=>"11", "year"=>"2017", "pdf_views"=>"54", "xml_views"=>"6", "html_views"=>"435"}
  • {"month"=>"12", "year"=>"2017", "pdf_views"=>"21", "xml_views"=>"0", "html_views"=>"367"}
  • {"month"=>"1", "year"=>"2018", "pdf_views"=>"15", "xml_views"=>"0", "html_views"=>"48"}
  • {"month"=>"2", "year"=>"2018", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"50"}
  • {"month"=>"3", "year"=>"2018", "pdf_views"=>"33", "xml_views"=>"3", "html_views"=>"60"}
  • {"month"=>"4", "year"=>"2018", "pdf_views"=>"20", "xml_views"=>"1", "html_views"=>"53"}
  • {"month"=>"5", "year"=>"2018", "pdf_views"=>"19", "xml_views"=>"1", "html_views"=>"52"}
  • {"month"=>"6", "year"=>"2018", "pdf_views"=>"5", "xml_views"=>"5", "html_views"=>"45"}
  • {"month"=>"7", "year"=>"2018", "pdf_views"=>"22", "xml_views"=>"4", "html_views"=>"26"}
  • {"month"=>"8", "year"=>"2018", "pdf_views"=>"19", "xml_views"=>"1", "html_views"=>"12"}
  • {"month"=>"9", "year"=>"2018", "pdf_views"=>"9", "xml_views"=>"0", "html_views"=>"15"}
  • {"month"=>"10", "year"=>"2018", "pdf_views"=>"8", "xml_views"=>"1", "html_views"=>"23"}
  • {"month"=>"11", "year"=>"2018", "pdf_views"=>"41", "xml_views"=>"0", "html_views"=>"294"}
  • {"month"=>"12", "year"=>"2018", "pdf_views"=>"28", "xml_views"=>"3", "html_views"=>"209"}
  • {"month"=>"1", "year"=>"2019", "pdf_views"=>"36", "xml_views"=>"0", "html_views"=>"73"}
  • {"month"=>"2", "year"=>"2019", "pdf_views"=>"14", "xml_views"=>"1", "html_views"=>"91"}
  • {"month"=>"3", "year"=>"2019", "pdf_views"=>"21", "xml_views"=>"1", "html_views"=>"70"}
  • {"month"=>"4", "year"=>"2019", "pdf_views"=>"29", "xml_views"=>"0", "html_views"=>"33"}
  • {"month"=>"5", "year"=>"2019", "pdf_views"=>"18", "xml_views"=>"0", "html_views"=>"22"}

PMC Usage Stats

  • {"unique-ip"=>"17", "full-text"=>"14", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2017", "month"=>"12"}
  • {"unique-ip"=>"8", "full-text"=>"7", "pdf"=>"3", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"1"}
  • {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"2", "abstract"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"3"}
  • {"unique-ip"=>"16", "full-text"=>"17", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"1"}
  • {"unique-ip"=>"18", "full-text"=>"22", "pdf"=>"7", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"9"}
  • {"unique-ip"=>"13", "full-text"=>"14", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"12"}
  • {"unique-ip"=>"15", "full-text"=>"18", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"11"}
  • {"unique-ip"=>"1", "full-text"=>"1", "pdf"=>"0", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"4"}
  • {"unique-ip"=>"9", "full-text"=>"8", "pdf"=>"4", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"5"}
  • {"unique-ip"=>"7", "full-text"=>"5", "pdf"=>"3", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"6"}
  • {"unique-ip"=>"6", "full-text"=>"3", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"2", "cited-by"=>"0", "year"=>"2018", "month"=>"7"}
  • {"unique-ip"=>"16", "full-text"=>"15", "pdf"=>"8", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"10"}
  • {"unique-ip"=>"12", "full-text"=>"15", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2018", "month"=>"8"}
  • {"unique-ip"=>"8", "full-text"=>"9", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"1", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"2"}
  • {"unique-ip"=>"26", "full-text"=>"17", "pdf"=>"1", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"4", "supp-data"=>"14", "cited-by"=>"0", "year"=>"2019", "month"=>"3"}
  • {"unique-ip"=>"7", "full-text"=>"9", "pdf"=>"2", "scanned-summary"=>"0", "scanned-page-browse"=>"0", "figure"=>"0", "supp-data"=>"0", "cited-by"=>"0", "year"=>"2019", "month"=>"4"}
Loading … Spinner
There are currently no alerts