 |
Computing and communication are two key constraints limiting system throughput. Computation to communication ratio features the number of operations performed per memory access. A high CTC indicates that the layer is computationally intensive, and the inference latency is determined by the number of computational resources. On the contrary, a low CTC means the off-chip bandwidth greatly affects the performance
The threshold of CTC ratio C_0 of a specified FPGA can be calculated by this formulation. N is the number of DSP slices provided by the FPGA, ¥á is the utilization of DSPs. F is the clock frequency, and B is the off-chip memory bandwidth.
The theoretical CTC value of the convolutional layer in a dynamic neural network can be calculated by this formulation. Where W and H denote the width and height, C denotes the number of channels, K denotes the kernel size and ¥ã denotes the activation ratio of channels at the current layer. The subscripts i and o represent the input and output feature maps, respectively. |
IEEE/ICACT20230038 Slide.06
[Big Slide]
[YouTube]