From 67315da4f081332f93290a58b3a3d37ad28a1110 Mon Sep 17 00:00:00 2001 From: "Jens E. Pedersen" Date: Tue, 19 Mar 2024 22:57:59 +0100 Subject: [PATCH 01/11] Added roadmap draft --- docs/source/_toc.yml | 1 + docs/source/roadmap.md | 51 ++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 52 insertions(+) create mode 100644 docs/source/roadmap.md diff --git a/docs/source/_toc.yml b/docs/source/_toc.yml index 8d4f836..2a4092a 100644 --- a/docs/source/_toc.yml +++ b/docs/source/_toc.yml @@ -6,6 +6,7 @@ parts: - file: what title: What is it? - file: about + - file: roadmap - caption: User guide chapters: - file: usage diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md new file mode 100644 index 0000000..43ac91f --- /dev/null +++ b/docs/source/roadmap.md @@ -0,0 +1,51 @@ +# NIR roadmap + +NIR is in its early stages but is developing fast. +Here, we present an organizational roadmap for the immediate future of NIR governance, followed by a list of concrete projects that are currently developing NIR. + +## Organizational roadmap + +With [the NIR preprint](https://arxiv.org/abs/2311.14641), we have demonstrated the feasibility of NIR. +Not only as a scientific idea, but as a practical and valuable tool for the development of neuromorphic systems. +However, NIR has been born in a research environment. +To make it self-sustaining, we are preparing to launch a series of projects that will ensure the continued development of NIR, while continuing to increase its value to the community. + +The most important pillar of NIR is the joint value for both industrial and academic partners alike. +Therefore, the first phase of our roadmap will be to reach out to potential partners and invite them to joints projects for which we can raise funds---either through commercial or public sources. +The coming phases will revolve around the fundraising and organization of these projects. +Eventually, we will kickoff the projects and establish a steering group for NIR as the projects mature and futher direction is needed. + +``` + _______________ _______________ _______________ _______________ +| Phase 1 | -> | Phase 2 | -> | Phase 3 | -> | Phase 4 | +| May 2024 | | July 2024 | | Sep. 2024 | | Dec. 2024 | +| Outreach | | Fundraising | | Kickoff | | Steering grp. | +|_______________| |_______________| |_______________| |_______________| +``` + +## Active projects + +The follwing projects are concrete intiatives that are working to improve NIR. +Feel free to reach out to the project owners if you are interested in contributing or if you have any projects you would like to add. + +## Improved SpiNNaker support +**Duration**: August 2024
+**Owner**: [Bernhard Vogginger](https://github.com/bvogginger)
+**Description**: We are working on improving the support for the SpiNNaker 2 platform, including streaming data and additional neuron models. + +## Improved Lava & Loihi support +**Duration**: October 2024
+**Owner**: [Steven Abreu](https://github.com/stevenabreu7/)
+**Description**: We are working on improving the support for the Lava and Loihi platforms, focusing on neuron model support and applications. + +### Energy comparisons on different computational substrates +**Duration**: Until July 2024
+**Owner**: [Sadasivan Shankar](https://profiles.stanford.edu/sadasivan-shankar)
+**Description**: It would be helpful to understand exactly how much energy we can save by lifting a NIR graph to neuromrophic hardware. In this project, we are developing a mapping from NIR graph to energy efficiency, given a computational platform. That is, we can take a NIR graph and calculate a rough estimate of the energy consumption of the graph on a given platform. This will help us to understand the potential energy savings **before** it is deployed. + +## Additional neuron models and plasticity +**Timeline**: Start October 2024
+**Owner**: [Jens Egholm Pedersen](https://github.com/jegp)
+**Description**: We are working on adding additional neuron models and plasticity rules to NIR, including the Fitzhugh-Nagumo model. Plasticity will require additional primitives that can, themselves, modify primitive parameters. + + From 8a62a81955083a25f671efdbc03fcb3ff813b7f5 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:50:47 +0100 Subject: [PATCH 02/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 43ac91f..530aad4 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -28,7 +28,7 @@ Eventually, we will kickoff the projects and establish a steering group for NIR The follwing projects are concrete intiatives that are working to improve NIR. Feel free to reach out to the project owners if you are interested in contributing or if you have any projects you would like to add. -## Improved SpiNNaker support +### Improved SpiNNaker 2 support **Duration**: August 2024
**Owner**: [Bernhard Vogginger](https://github.com/bvogginger)
**Description**: We are working on improving the support for the SpiNNaker 2 platform, including streaming data and additional neuron models. From 5d50958a372860ef15e95695e86856d0e581e9c0 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:50:53 +0100 Subject: [PATCH 03/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 530aad4..1032281 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -11,7 +11,7 @@ However, NIR has been born in a research environment. To make it self-sustaining, we are preparing to launch a series of projects that will ensure the continued development of NIR, while continuing to increase its value to the community. The most important pillar of NIR is the joint value for both industrial and academic partners alike. -Therefore, the first phase of our roadmap will be to reach out to potential partners and invite them to joints projects for which we can raise funds---either through commercial or public sources. +Therefore, the first phase of our roadmap will be to reach out to potential partners and invite them to joint projects for which we can raise funds---either through commercial or public sources. The coming phases will revolve around the fundraising and organization of these projects. Eventually, we will kickoff the projects and establish a steering group for NIR as the projects mature and futher direction is needed. From ebd730b298421453c34f876b6579a757efdc8071 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:50:58 +0100 Subject: [PATCH 04/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 1032281..d58b561 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -13,7 +13,7 @@ To make it self-sustaining, we are preparing to launch a series of projects that The most important pillar of NIR is the joint value for both industrial and academic partners alike. Therefore, the first phase of our roadmap will be to reach out to potential partners and invite them to joint projects for which we can raise funds---either through commercial or public sources. The coming phases will revolve around the fundraising and organization of these projects. -Eventually, we will kickoff the projects and establish a steering group for NIR as the projects mature and futher direction is needed. +Eventually, we will kick off the projects and establish a steering group for NIR as the projects mature and further direction is needed. ``` _______________ _______________ _______________ _______________ From 760ef61ced306072915acd05df68dd276a388be7 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:51:06 +0100 Subject: [PATCH 05/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index d58b561..bff0206 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -31,7 +31,7 @@ Feel free to reach out to the project owners if you are interested in contributi ### Improved SpiNNaker 2 support **Duration**: August 2024
**Owner**: [Bernhard Vogginger](https://github.com/bvogginger)
-**Description**: We are working on improving the support for the SpiNNaker 2 platform, including streaming data and additional neuron models. +**Description**: We are working on improving the support for the SpiNNaker 2 platform. This includes speeding up SNN processing with the machine learning accelerator, supporting more neuron models and streaming data. ## Improved Lava & Loihi support **Duration**: October 2024
From 161b72160369249838c4483a5b5f594d6d941589 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:52:11 +0100 Subject: [PATCH 06/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index bff0206..04b6dfa 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -41,7 +41,7 @@ Feel free to reach out to the project owners if you are interested in contributi ### Energy comparisons on different computational substrates **Duration**: Until July 2024
**Owner**: [Sadasivan Shankar](https://profiles.stanford.edu/sadasivan-shankar)
-**Description**: It would be helpful to understand exactly how much energy we can save by lifting a NIR graph to neuromrophic hardware. In this project, we are developing a mapping from NIR graph to energy efficiency, given a computational platform. That is, we can take a NIR graph and calculate a rough estimate of the energy consumption of the graph on a given platform. This will help us to understand the potential energy savings **before** it is deployed. +**Description**: It would be helpful to understand exactly how much energy we can save by lifting a NIR graph to neuromorphic hardware. In this project, we are developing a mapping from NIR graph to energy efficiency, given a computational platform. That is, we can take a NIR graph and calculate a rough estimate of the energy consumption of the graph on a given platform. This will help us to understand the potential energy savings **before** it is deployed. ## Additional neuron models and plasticity **Timeline**: Start October 2024
From 2943c5de72c4bf40fc5fb70d7f991077728e8311 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:52:15 +0100 Subject: [PATCH 07/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 04b6dfa..533aeef 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -33,7 +33,7 @@ Feel free to reach out to the project owners if you are interested in contributi **Owner**: [Bernhard Vogginger](https://github.com/bvogginger)
**Description**: We are working on improving the support for the SpiNNaker 2 platform. This includes speeding up SNN processing with the machine learning accelerator, supporting more neuron models and streaming data. -## Improved Lava & Loihi support +### Improved Lava & Loihi support **Duration**: October 2024
**Owner**: [Steven Abreu](https://github.com/stevenabreu7/)
**Description**: We are working on improving the support for the Lava and Loihi platforms, focusing on neuron model support and applications. From e98e8baddd4fc7970fd1889500a859e7c35e2db1 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Wed, 27 Mar 2024 14:52:20 +0100 Subject: [PATCH 08/11] Update docs/source/roadmap.md Co-authored-by: Bernhard Vogginger --- docs/source/roadmap.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 533aeef..0c55796 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -43,7 +43,7 @@ Feel free to reach out to the project owners if you are interested in contributi **Owner**: [Sadasivan Shankar](https://profiles.stanford.edu/sadasivan-shankar)
**Description**: It would be helpful to understand exactly how much energy we can save by lifting a NIR graph to neuromorphic hardware. In this project, we are developing a mapping from NIR graph to energy efficiency, given a computational platform. That is, we can take a NIR graph and calculate a rough estimate of the energy consumption of the graph on a given platform. This will help us to understand the potential energy savings **before** it is deployed. -## Additional neuron models and plasticity +### Additional neuron models and plasticity **Timeline**: Start October 2024
**Owner**: [Jens Egholm Pedersen](https://github.com/jegp)
**Description**: We are working on adding additional neuron models and plasticity rules to NIR, including the Fitzhugh-Nagumo model. Plasticity will require additional primitives that can, themselves, modify primitive parameters. From 595920574bb7faca0061f3b54940483d0b3dba46 Mon Sep 17 00:00:00 2001 From: "Jens E. Pedersen" Date: Wed, 27 Mar 2024 15:20:10 +0100 Subject: [PATCH 09/11] Added events page --- docs/source/_toc.yml | 1 + docs/source/about.md | 9 ++++++++- docs/source/events.md | 25 +++++++++++++++++++++++++ docs/source/roadmap.md | 14 ++++++++++---- 4 files changed, 44 insertions(+), 5 deletions(-) create mode 100644 docs/source/events.md diff --git a/docs/source/_toc.yml b/docs/source/_toc.yml index 2a4092a..1882b8a 100644 --- a/docs/source/_toc.yml +++ b/docs/source/_toc.yml @@ -7,6 +7,7 @@ parts: title: What is it? - file: about - file: roadmap + - file: events - caption: User guide chapters: - file: usage diff --git a/docs/source/about.md b/docs/source/about.md index e337e37..bed7224 100644 --- a/docs/source/about.md +++ b/docs/source/about.md @@ -4,6 +4,10 @@ The Neuromorphic Intermediate Representation (NIR) is a joint effort between res It is a product of many clever actors, thinking deeply about the interplay between computation and physics, and it would be incorrect to claim that NIR is owned by any single actor. Rather, NIR is a community effort that serves to simplify the development of neuromorphic algorithms and applications, and it is only possible because of the many contributors who put in years of work across many organizations and universities. +```{admonition} NIR Community +Connect to our community via [Discord](https://discord.gg/JRMRGP9h3c) or one of our many [online events](events). +``` + ## Design principles NIR is designed according to two founding principles: @@ -12,6 +16,10 @@ NIR is designed according to two founding principles: 2. Balance between productivity and correctness * We are entering an area of research where scientific giants have made many lasting marks. We are aware that we will not get everything right in the first go, but we are compelled to try. We are equally compelled to keep learning and improving, and the NIR spec will change as we grow. +```{admonition} NIR Roadmap +See more about the development and progress of NIR in our [roadmap](roadmap). +``` + ## Connectivity Each computational unit is a node in a static graph. Given 3 nodes $A$ which is a LIF node, $B$ which is a Linear node and $C$ which is another LIF node, we can define edges in the graph such as: @@ -19,7 +27,6 @@ Given 3 nodes $A$ which is a LIF node, $B$ which is a Linear node and $C$ which ## Format The intermediate represenation can be stored as hdf5 file, which benefits from compression. - ## Authors Authors (in alphabetical order): * [Steven Abreu](https://github.com/stevenabreu7) diff --git a/docs/source/events.md b/docs/source/events.md new file mode 100644 index 0000000..254f061 --- /dev/null +++ b/docs/source/events.md @@ -0,0 +1,25 @@ +# NIR community events + +NIR is meant to be practical and valuable from day one. +We are dedicated to interacting and paying back to the community both to (1) listen to the needs of the community and (2) to share our progress and learnings so that the entire community can benefit. +Below, you will find a list of events that we are hosting or participating in where you can meet us and learn more about NIR. + +```{admonition} Would you like to invite us? +Would you like to invite us to an event or workshop? Get in touch with via [Discord](https://discord.gg/JRMRGP9h3c) or [GitHub](https://github.com/neuromorphs/nir). +``` + +## 2024 + +* [Telluride Neuromorphic Cognition Engineering Workshop](https://sites.google.com/view/telluride-2024), workshop, **July** + * A workshop on neuromorphic engineering and cognition. NIR will feature in the [Neuromorphic systems for space application](https://sites.google.com/view/telluride-2024/topic-areas-2024/spa24-neuromorphic-systems-for-space-applications) topic area. +* [NICE workshop](https://flagship.kip.uni-heidelberg.de/jss/HBPm?mI=257&m=showAgenda&showAbstract=-1#9564), workshop, **April 26** + * A tutorial on NIR with on-site SpiNNaker2 hardware. +* [Open-Neuromorphic workshop](https://open-neuromorphic.org/workshops/neuromorphic-intermediate-representation/), video, **February 5** + * Video introducing NIR with practical examples on [Speck](https://www.synsense.ai/products/speck-2/) and [SpiNNaker2](https://spinncloud.com/portfolio/spinnaker2/) from several of the NIR core developers + +## 2023 + +* [NIR preprint on arXiv](https://arxiv.org/abs/2311.14641), paper, **December** + * The first publication of NIR, detailing the specification and several real-life experiments +* [Telluride Neuromorphic Cognition Engineering Workshop](https://sites.google.com/view/telluride-2023/home), workshop, **July** + * A workshop on neuromorphic engineering and cognition. This is where NIR was born. \ No newline at end of file diff --git a/docs/source/roadmap.md b/docs/source/roadmap.md index 0c55796..4c4b7ba 100644 --- a/docs/source/roadmap.md +++ b/docs/source/roadmap.md @@ -3,6 +3,13 @@ NIR is in its early stages but is developing fast. Here, we present an organizational roadmap for the immediate future of NIR governance, followed by a list of concrete projects that are currently developing NIR. +```{admonition} Community involvement +:class: tip +We are dedicated to interacting and paying back to the community and we are continuously improving the accessibility of NIR by (1) releasing educational material, (2) updating our docs, and (3) engaging with the community in open events. + +For more information, see our [events](events) page and join the discussion on our [Discord](https://discord.gg/JRMRGP9h3c) server. +``` + ## Organizational roadmap With [the NIR preprint](https://arxiv.org/abs/2311.14641), we have demonstrated the feasibility of NIR. @@ -23,6 +30,7 @@ Eventually, we will kick off the projects and establish a steering group for NIR |_______________| |_______________| |_______________| |_______________| ``` + ## Active projects The follwing projects are concrete intiatives that are working to improve NIR. @@ -31,7 +39,7 @@ Feel free to reach out to the project owners if you are interested in contributi ### Improved SpiNNaker 2 support **Duration**: August 2024
**Owner**: [Bernhard Vogginger](https://github.com/bvogginger)
-**Description**: We are working on improving the support for the SpiNNaker 2 platform. This includes speeding up SNN processing with the machine learning accelerator, supporting more neuron models and streaming data. +**Description**: We are working on improving the support for the SpiNNaker 2 platform. This includes speeding up SNN processing with the machine learning accelerator, supporting more neuron models and streaming data. More information can be found at the [SpiNNaker 2 project milestone 5](https://gitlab.com/spinnaker2/py-spinnaker2/-/milestones/5). ### Improved Lava & Loihi support **Duration**: October 2024
@@ -46,6 +54,4 @@ Feel free to reach out to the project owners if you are interested in contributi ### Additional neuron models and plasticity **Timeline**: Start October 2024
**Owner**: [Jens Egholm Pedersen](https://github.com/jegp)
-**Description**: We are working on adding additional neuron models and plasticity rules to NIR, including the Fitzhugh-Nagumo model. Plasticity will require additional primitives that can, themselves, modify primitive parameters. - - +**Description**: We are working on adding additional neuron models and plasticity rules to NIR, including the Fitzhugh-Nagumo model. Plasticity will require additional primitives that can, themselves, modify primitive parameters. \ No newline at end of file From d5a2c7a98eace24dac36219bf321fe131b740e5f Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Thu, 28 Mar 2024 11:11:24 +0100 Subject: [PATCH 10/11] Update docs/source/events.md Co-authored-by: Bernhard Vogginger --- docs/source/events.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/events.md b/docs/source/events.md index 254f061..ac262d4 100644 --- a/docs/source/events.md +++ b/docs/source/events.md @@ -5,7 +5,7 @@ We are dedicated to interacting and paying back to the community both to (1) lis Below, you will find a list of events that we are hosting or participating in where you can meet us and learn more about NIR. ```{admonition} Would you like to invite us? -Would you like to invite us to an event or workshop? Get in touch with via [Discord](https://discord.gg/JRMRGP9h3c) or [GitHub](https://github.com/neuromorphs/nir). +Would you like to invite us to an event or workshop? Get in touch with us via [Discord](https://discord.gg/JRMRGP9h3c) or [GitHub](https://github.com/neuromorphs/nir). ``` ## 2024 From 99e8ee28133cc0a0c49826f1f2b9940696145065 Mon Sep 17 00:00:00 2001 From: Jens Egholm Pedersen Date: Thu, 28 Mar 2024 11:11:40 +0100 Subject: [PATCH 11/11] Update docs/source/events.md Co-authored-by: Bernhard Vogginger --- docs/source/events.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/source/events.md b/docs/source/events.md index ac262d4..2f80b5b 100644 --- a/docs/source/events.md +++ b/docs/source/events.md @@ -15,7 +15,7 @@ Would you like to invite us to an event or workshop? Get in touch with us via [D * [NICE workshop](https://flagship.kip.uni-heidelberg.de/jss/HBPm?mI=257&m=showAgenda&showAbstract=-1#9564), workshop, **April 26** * A tutorial on NIR with on-site SpiNNaker2 hardware. * [Open-Neuromorphic workshop](https://open-neuromorphic.org/workshops/neuromorphic-intermediate-representation/), video, **February 5** - * Video introducing NIR with practical examples on [Speck](https://www.synsense.ai/products/speck-2/) and [SpiNNaker2](https://spinncloud.com/portfolio/spinnaker2/) from several of the NIR core developers + * Video introducing NIR with practical examples on [Speck](https://www.synsense.ai/products/speck-2/) and [SpiNNaker2](https://spinnaker2.gitlab.io/) from several of the NIR core developers ## 2023