Challenges/Opportunities to Enable Dependable Scale-out System with Groq Deterministic Tensor-Streaming Processors

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 310
  • Download : 0
The Groq tensor streaming processor (TSP) architecture is an hardware accelerator that provides a new paradigm for achieving both flexibility and massive parallelism without the limitations and communication overheads of conventional CPU or GPU architectures. In particular, the Groq TSP execution and performance is deterministic as the flow of instructions through the the hardware is completely orchestrated and scheduled, making processing both efficient and predictable. When scaling out to multiple TSPs, the same deterministic execution needs to be provided in a distributed system. In this work, we explore the challenges and opportunities to scale such deterministic architecture across multiple processors to ensure a dependable scale-out system. In particular, maintaining synchronization across multiple TSPs to enable a software-scheduled network is a challenge; yet, the high-radix, low diameter topology enables N + 1 redundancy to improve the reliability of the system.
Publisher
Institute of Electrical and Electronics Engineers Inc.
Issue Date
2022-06-29
Language
English
Citation

52nd Annual IEEE/IFIP International Conference on Dependable Systems and Networks, DSN-S 2022, pp.19 - 22

DOI
10.1109/DSN-S54099.2022.00016
URI
http://hdl.handle.net/10203/301251
Appears in Collection
EE-Conference Papers(학술회의논문)
Files in This Item
There are no files associated with this item.

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0