Efficiency Improvement Approaches for a Mesh Network in a Distributed Memory System on Chip

Danila Khaidukov, Aleksandr Alekseev

Abstract


This paper studies architectural approaches to improving the efficiency of a mesh network in a distributed memory system on chip. The focus is on solutions applicable at early design stages, enabling analysis of trade-offs between network performance and hardware resource costs. The approaches include routing algorithm selection, network shape modification, scaling of physical and virtual channels, and duplication of the network infrastructure. Network efficiency is evaluated using throughput, average request latency, and performance per resource as the main metrics. Latency is estimated using an analytical model previously developed by the authors and tailored to distributed memory systems, while throughput is evaluated via cycle-accurate simulation. All approaches are compared within a unified experimental scenario, ensuring consistent assessment of their impact on traffic distribution, saturation behavior, and latency structure. The results show that the most efficient configurations improve traffic distribution with a moderate increase in hardware resources, whereas simple capacity scaling without structural changes leads to diminishing returns. The presented analysis provides practical guidance for selecting mesh network architectures in distributed memory systems at early design stages.

Full Text:

PDF (Russian)

References


Peccerillo, Biagio, et al. "A survey on hardware accelerators: Taxonomy, trends, challenges, and perspectives." Journal of Systems Architecture 129 (2022): 102561.

McKee, Sally A. "Reflections on the memory wall." Proceedings of the 1st conference on Computing frontiers. 2004.

Chen, Xiaowen. Efficient Memory Access and Synchronization in NoC-based Many-core Processors. Diss. KTH Royal Institute of Technology, 2019.

Gholami, Amir, et al. "Ai and memory wall." IEEE Micro 44.3 (2024): 33-39.

Milton, Jonathan, and Payman Zarkesh-Ha. "Impacts of topology and bandwidth on distributed shared memory systems." Computers 12.4 (2023): 86.

Gries, Matthias. "Methods for evaluating and covering the design space during early design development." Integration 38.2 (2004): 131-183.

Jerger, Natalie Enright, Tushar Krishna, and Li-Shiuan Peh. On-chip networks. Springer Nature, 2022.

Chen, Wai Kai. The electrical engineering handbook. Elsevier, 2004.

Palermo, Gianluca, et al. "A system-level methodology for fast multi-objective design space exploration." Proceedings of the 13th ACM Great Lakes symposium on VLSI. 2003.

Deshwal, Aryan, et al. "MOOS: A multi-objective design space exploration and optimization framework for NoC enabled manycore systems." ACM Transactions on Embedded Computing Systems (TECS) 18.5s (2019): 1-23.

Xue, Runzhen, et al. "Multi-objective optimization in cpu design space exploration: Attention is all you need." arXiv preprint arXiv:2410.18368 (2024).

Bakhoda, Ali, John Kim, and Tor M. Aamodt. "Throughput-effective on-chip networks for manycore accelerators." 2010 43rd Annual IEEE/ACM international symposium on microarchitecture. IEEE, 2010.

Lallas, Efthymios N. "An Evaluation of Routing Algorithms in Traffic Engineering and Quality of Service Provision of Network on Chips." Engineering 13.1 (2021): 1-17.

Khaidukov, Danila, and Alexandr Alekseev. "Routing Collision Mitigation Approaches in a Distributed Memory System on Chip". Nanoindustiya [Nanoindustry] 11s 18.135 (2025): 1298-1304.

Dimitrakopoulos, Giorgos, Anastasios Psarras, and Ioannis Seitanidis. Microarchitecture of Network-on-chip Routers. Vol. 1025. Berlin, Germany: Springer, 2015.

Hansson, Andreas, Kees Goossens, and Andrei Rădulescu. "Avoiding message‐dependent deadlock in network‐based systems on chip." VLSI design 2007.1 (2007): 095859.

Moscibroda, Thomas, and Onur Mutlu. "A case for bufferless routing in on-chip networks." Proceedings of the 36th annual international symposium on Computer architecture. 2009.

Fallin, Chris, et al. "MinBD: Minimally-buffered deflection routing for energy-efficient interconnect." 2012 IEEE/ACM Sixth International Symposium on Networks-on-Chip. IEEE, 2012.

Ausavarungnirun, Rachata, and Onur Mutlu. "Energy-Efficient Deflection-based On-chip Networks: Topology, Routing, Flow Control." arXiv preprint arXiv:2112.02516 (2021).

Fernandes, Ramon, et al. "OcNoC: Efficient one-cycle router implementation for 3d mesh network-on-chip." 2015 28th International Conference on VLSI Design. IEEE, 2015.

Concer, Nicola, Michele Petracca, and Luca P. Carloni. "Distributed flit-buffer flow control for networks-on-chip." Proceedings of the 6th IEEE/ACM/IFIP international conference on Hardware/Software codesign and system synthesis. 2008.

Chuang, Shang-Tse, et al. "Matching output queueing with a combined input/output-queued switch." IEEE Journal on Selected Areas in Communications 17.6 (1999): 1030-1039.

Papaphilippou, Philippos, and Thiem Van Chu. "Efficient deadlock avoidance for 2-D mesh NoCs that use OQ or VOQ routers." IEEE Transactions on Computers 73.5 (2024): 1414-1426.

Dally, William J. "Virtual-channel flow control." ACM SIGARCH Computer Architecture News 18.2SI (1990): 60-68.

Nicopoulos, Chrysostomos A., et al. "ViChaR: A dynamic virtual channel regulator for network-on-chip routers." 2006 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'06). IEEE, 2006.

Mallappa, Uday, Chung-Kuan Cheng, and Bill Lin. "JARVA: Joint Application-Aware Oblivious Routing and Static Virtual Channel Allocation." IEEE Des. Test 39.6 (2022): 16-27.

Rao, Supriya, et al. "Vix: Virtual input crossbar for efficient switch allocation." Proceedings of the 51st Annual Design Automation Conference. 2014.

Noh, Seongmin, et al. "Multiplane virtual channel router for network-on-chip design." 2006 First International Conference on Communications and Electronics. IEEE, 2006.

Nadi, M., M. H. Ghadiry, and M. K. Dermany. "The effect of number of virtual channel on NOC EDP." Journal of applied mathematics & informatics 2010 (2010): 539-551.

Carara, Everton, Fernando Moraes, and Ney Calazans. "Router architecture for high-performance NoCs." Proceedings of the 20th annual conference on Integrated circuits and systems design. 2007.

Gulzari, Usman Ali, et al. "Comparative analysis of 2D mesh topologies with additional communication links for on-chip networks." Computer Networks 241 (2024): 110193.

Kozhin, A., E. Kozhin, and D. Shpagilev. "Investigation of Network-on-Chip Topologies for Multicore Processors with the Elbrus Architecture." Electronics Science Technology Business 198.7 (2020): 132-136.

Moadeli, Mahmoud, Alireza Shahrabi, and Wim Vanderbauwhede. "Analytical modelling of communication in the rectangular mesh noc." 2007 International Conference on Parallel and Distributed Systems. IEEE, 2007.

Balfour, James, and William J. Dally. "Design tradeoffs for tiled CMP on-chip networks." ACM International conference on supercomputing 25th anniversary volume. 2006.

Das, Reetuparna, et al. "Catnap: Energy proportional multiple network-on-chip." Proceedings of the 40th annual international symposium on Computer architecture. 2013.

Yoon, Young Jin, et al. "Virtual channels vs. multiple physical networks: A comparative analysis." Proceedings of the 47th Design Automation Conference. 2010.

Mishra, Asit K., Onur Mutlu, and Chita R. Das. "A heterogeneous multiple network-on-chip design: an application-aware approach." Proceedings of the 50th annual design automation conference. 2013.

Bjerregaard, Tobias, and Shankar Mahadevan. "A survey of research and practices of network-on-chip." ACM Computing Surveys (CSUR) 38.1 (2006): 1-es.

Khan, Sarzamin, et al. "Comparative analysis of network‐on‐chip simulation tools." IET Computers & Digital Techniques 12.1 (2018): 30-38.

Catania, Vincenzo, et al. "Noxim: An open, extensible and cycle-accurate network on chip simulator." 2015 IEEE 26th international conference on application-specific systems, architectures and processors (ASAP). IEEE, 2015.

Khaidukov, Danila, and Alexandr Alekseev. "An Analytical Latency Estimation Approach in a Mesh Network in a Distributed Memory System on Chip ". International Journal of Open Information Technologies 14.1 (2026): 66-80.

Thomas, Marlin U. "Queueing systems. volume 1: Theory (leonard kleinrock)." SIAM Review 18.3 (1976): 512-514.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность ИТ конгресс СНЭ

ISSN: 2307-8162