 |
The following is a table summarizing the values for the average ESS SoC and the shifted amount of power previously identified.
We confirmed in episode 2200 that the reward has a maximum value and a value that is repeated afterward.
The average value of ESS SoC in Episode 100 is 6.5 and 6.33 at 3100.
In this case, the decrease in the average value of ESS SoC decreased to 97.4%.
The shifted power decreased significantly to about 80% from 94.41 near Episode 100 to 75.57 at 3100.
Our goal is to optimize ESS SoC optimization and minimize user satisfaction reduction.
To this end, the RL was modeled.
In this simulation, ESS SoC should have a higher value and shifted power should have a lower value.
From the above results, it can be seen that even if the average ESS SoC is similar, a policy to significantly reduce shifted power has been learned near episode 3100.
|
IEEE/ICACT20220153 Slide.21
[Big Slide]