RISC-V Summit

In this talk we will cover the latest developments in running modern transformers , such as LLama-2, on Semidynamics RISC-V "All-In-One" solution, comprising a core, a Vector Unit and a Tensor Unit. In this talk you'll learn about how ONNX RT is used to deploy modern models on Semidynamics solution, on how the ratio of the vector to tensor compute is important for balanced execution and how the all-in-one can be scaled-out to reach different performance
levels.