IEEE/ICACT20250091 Slide.15        [Big Slide]       Oral Presentation
In the PPO update phase, each transition in the replay buffer is retrieved. We use the GAE to estimate the advantage. The advantage can be calculated by equation 16. The target value 𝑉_𝑡^𝑡𝑎𝑟𝑔𝑒𝑡 can be calculated by equation 17.

[Go to Next Slide]
Select Voice: