图1-1。 新加坡太阳能安装的分布。 ....................................................................................................................................................................................................................................................................................................................................................................................... 1-2。 Installed capacity of PV systems ..................................................................... 15 Fig. 1-3。 用户类型的PV系统数.. ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................. 1-4欧洲年度太阳能PV安装容量2000-2021。 ................................................................................................................................................................................................................................................................................................................................................................................................................................. 1-5 European Top 10 Solar PV Markets 2000-2021............................................... 16 Fig. 1-6 Forecast of PV installations in European countries in 2025 ............................ 17 Fig. 1-7太阳能逆变器系统......................................................................................................................................................................................................................................................................................................................................................... 17 2-1。 提出的两个时间计电压/var控制框架。 ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 2-2。 beta分布。 ............................................................................................. 30 Fig. 3-1。 RL的一般结构。 34 3-2。 DQN的一般框架。 .......................................................................... 35 Fig. 3-3。 DNN的结构。 ........................................................................................... 38 Fig. 3-4。 DDPG的框架。 4-1。 4-2。 4-3。1-1。新加坡太阳能安装的分布。.......................................................................................................................................................................................................................................................................................................................................................................................1-2。Installed capacity of PV systems ..................................................................... 15 Fig.1-3。用户类型的PV系统数.. .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................1-4欧洲年度太阳能PV安装容量2000-2021。.................................................................................................................................................................................................................................................................................................................................................................................................................................1-5 European Top 10 Solar PV Markets 2000-2021............................................... 16 Fig.1-6 Forecast of PV installations in European countries in 2025 ............................ 17 Fig.1-7太阳能逆变器系统......................................................................................................................................................................................................................................................................................................................................................... 172-1。 提出的两个时间计电压/var控制框架。 ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 2-2。 beta分布。 ............................................................................................. 30 Fig. 3-1。 RL的一般结构。 34 3-2。 DQN的一般框架。 .......................................................................... 35 Fig. 3-3。 DNN的结构。 ........................................................................................... 38 Fig. 3-4。 DDPG的框架。 4-1。 4-2。 4-3。2-1。提出的两个时间计电压/var控制框架。...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................2-2。beta分布。............................................................................................. 30 Fig.3-1。RL的一般结构。 34 3-2。 DQN的一般框架。 .......................................................................... 35 Fig. 3-3。 DNN的结构。 ........................................................................................... 38 Fig. 3-4。 DDPG的框架。 4-1。 4-2。 4-3。RL的一般结构。343-2。DQN的一般框架。.......................................................................... 35 Fig.3-3。DNN的结构。........................................................................................... 38 Fig.3-4。DDPG的框架。4-1。4-2。4-3。4-3。..................................................................................... 38 Fig.多时间计量控制的框架。............................................ 42 Fig.MA-DDPG的框架。............................................................................ 45 Fig.提议的MA-DDPG多时间尺度电压控制的框架.......... 46图5-1 IEEE 33-BUS分配系统框架。............................................................................................................................................................................................................................................................................................................................................5-2。Original voltage magnitude ............................................................................. 51 Fig.5-3。 奖励300集以下的奖励表现。 ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................. 5-4。 450集以下奖励表现。 ....................................................... 55 Fig. 5-5。 Reward performance under 500 episode ......................................................... 56 Fig. 5-6。 带有不同发作的电压幅度轮廓。 .................................... 56 Fig. 5-7。 总线的电压更改曲线14。 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-8。 Reward distribution profile ............................................................................. 58 Fig. 5-9。 在少量罚款和小奖励下奖励表现。 ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-10。 .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-3。奖励300集以下的奖励表现。.............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-4。 450集以下奖励表现。 ....................................................... 55 Fig. 5-5。 Reward performance under 500 episode ......................................................... 56 Fig. 5-6。 带有不同发作的电压幅度轮廓。 .................................... 56 Fig. 5-7。 总线的电压更改曲线14。 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-8。 Reward distribution profile ............................................................................. 58 Fig. 5-9。 在少量罚款和小奖励下奖励表现。 ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-10。 .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-4。450集以下奖励表现。....................................................... 55 Fig.5-5。 Reward performance under 500 episode ......................................................... 56 Fig. 5-6。 带有不同发作的电压幅度轮廓。 .................................... 56 Fig. 5-7。 总线的电压更改曲线14。 .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-8。 Reward distribution profile ............................................................................. 58 Fig. 5-9。 在少量罚款和小奖励下奖励表现。 ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-10。 .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-5。Reward performance under 500 episode ......................................................... 56 Fig.5-6。带有不同发作的电压幅度轮廓。.................................... 56 Fig.5-7。总线的电压更改曲线14。....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-8。Reward distribution profile ............................................................................. 58 Fig.5-9。 在少量罚款和小奖励下奖励表现。 ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................... 5-10。 .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-9。在少量罚款和小奖励下奖励表现。.........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-10。 .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................5-10。.........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................在巨大的罚款和巨额奖励下奖励表现。5-11。 在巨大的罚款和小奖励下奖励表现。 .............................................................................................................................................................................................. 5-12。 Voltage magnitude profile ............................................................................. 60 Fig. 5-13。 逆变器控制代理，OLTC代理和CBS 的全局奖励曲线5-11。在巨大的罚款和小奖励下奖励表现。..............................................................................................................................................................................................5-12。 Voltage magnitude profile ............................................................................. 60 Fig. 5-13。 逆变器控制代理，OLTC代理和CBS 的全局奖励曲线5-12。Voltage magnitude profile ............................................................................. 60 Fig.5-13。 逆变器控制代理，OLTC代理和CBS 的全局奖励曲线5-13。逆变器控制代理，OLTC代理和CBS