IEEE/ICACT20250226 Slide.11        [Big Slide]       Oral Presentation
Next we added a gated network to selectively filter and prioritize the most informative features from each sensor dynamically. Specifically, the gated fusion network produces attention maps by applying 3 Ąż 3 convolution followed by a sigmoid activation to the concatenated inputs. The sigmoid function produces values between 0 and 1. They are used to emphasize the relative importance of each modality. For example, in scenarios like rain or fog, the network dynamically assigns higher weights to radar features. And for sunny or clear condition, more weight will be assigned to camera feature, respectively. By applying these values as weights into the original input feature maps, the network can adjust the strength of each feature dynamically.

[Go to Next Slide]
Select Voice: