Description
I install RLzoo and use its PPO to train an agent for DM Control Suite. I tested environments CheetahRun-v0 and CartpoleSwingup-v0, but the current PPO could solve neither of both. Could you please help me? I attach the testing reward for CartpoleSwingup-v0 below.
Testing... | Algorithm: PPO_CLIP | Environment: CartpoleSwingup-v0
Episode: 0/100 | Episode Reward: 28.4757 | Running Time: 0.5145
Episode: 1/100 | Episode Reward: 28.9385 | Running Time: 0.9912
Episode: 2/100 | Episode Reward: 28.6354 | Running Time: 1.4690
Episode: 3/100 | Episode Reward: 29.3395 | Running Time: 1.9561
Episode: 4/100 | Episode Reward: 28.6659 | Running Time: 2.4513
Episode: 5/100 | Episode Reward: 29.1282 | Running Time: 2.9346
Episode: 6/100 | Episode Reward: 28.1226 | Running Time: 3.4143
Episode: 7/100 | Episode Reward: 28.2178 | Running Time: 3.8957
Episode: 8/100 | Episode Reward: 28.2538 | Running Time: 4.3784
Episode: 9/100 | Episode Reward: 28.1161 | Running Time: 4.8581
Episode: 10/100 | Episode Reward: 28.2593 | Running Time: 5.3397
Episode: 11/100 | Episode Reward: 28.5096 | Running Time: 5.8084
Episode: 12/100 | Episode Reward: 27.9026 | Running Time: 6.2774
Episode: 13/100 | Episode Reward: 28.5970 | Running Time: 6.7430
Episode: 14/100 | Episode Reward: 28.6751 | Running Time: 7.2089
Episode: 15/100 | Episode Reward: 28.5764 | Running Time: 7.6745
Episode: 16/100 | Episode Reward: 28.2926 | Running Time: 8.1450
Episode: 17/100 | Episode Reward: 28.1627 | Running Time: 8.6118
Episode: 18/100 | Episode Reward: 28.3646 | Running Time: 9.1045
Episode: 19/100 | Episode Reward: 29.0091 | Running Time: 9.5852
Episode: 20/100 | Episode Reward: 28.6220 | Running Time: 10.0611
Episode: 21/100 | Episode Reward: 28.0959 | Running Time: 10.5363
Episode: 22/100 | Episode Reward: 28.3945 | Running Time: 11.0277
Episode: 23/100 | Episode Reward: 27.9222 | Running Time: 11.4943
Episode: 24/100 | Episode Reward: 29.1726 | Running Time: 11.9824
Episode: 25/100 | Episode Reward: 27.4740 | Running Time: 12.4491
Episode: 26/100 | Episode Reward: 29.0847 | Running Time: 13.0193
Episode: 27/100 | Episode Reward: 28.7490 | Running Time: 13.5816
Episode: 28/100 | Episode Reward: 29.4471 | Running Time: 14.0713
Episode: 29/100 | Episode Reward: 28.9889 | Running Time: 14.5420
Episode: 30/100 | Episode Reward: 27.9317 | Running Time: 15.0105
Episode: 31/100 | Episode Reward: 28.6057 | Running Time: 15.4807
Episode: 32/100 | Episode Reward: 27.9958 | Running Time: 15.9642
Episode: 33/100 | Episode Reward: 28.7247 | Running Time: 16.4500
Episode: 34/100 | Episode Reward: 28.7462 | Running Time: 16.9543
Episode: 35/100 | Episode Reward: 27.8867 | Running Time: 17.4389
Episode: 36/100 | Episode Reward: 28.2105 | Running Time: 17.9195
Episode: 37/100 | Episode Reward: 28.7734 | Running Time: 18.4043
Episode: 38/100 | Episode Reward: 28.7227 | Running Time: 18.8784
Episode: 39/100 | Episode Reward: 28.0787 | Running Time: 19.4129
Episode: 40/100 | Episode Reward: 28.7410 | Running Time: 19.9047
Episode: 41/100 | Episode Reward: 28.2244 | Running Time: 20.3926
Episode: 42/100 | Episode Reward: 28.6137 | Running Time: 20.8720
Episode: 43/100 | Episode Reward: 28.1213 | Running Time: 21.3447
Episode: 44/100 | Episode Reward: 28.7770 | Running Time: 21.8240
Episode: 45/100 | Episode Reward: 28.4468 | Running Time: 22.3140
Episode: 46/100 | Episode Reward: 28.3316 | Running Time: 22.7774
Episode: 47/100 | Episode Reward: 28.9745 | Running Time: 23.2579
Episode: 48/100 | Episode Reward: 28.5198 | Running Time: 23.7473
Episode: 49/100 | Episode Reward: 28.2299 | Running Time: 24.2266
Episode: 50/100 | Episode Reward: 27.5498 | Running Time: 24.7056
Episode: 51/100 | Episode Reward: 28.1589 | Running Time: 25.1900
Episode: 52/100 | Episode Reward: 28.2864 | Running Time: 25.6784
Episode: 53/100 | Episode Reward: 28.6884 | Running Time: 26.1567
Episode: 54/100 | Episode Reward: 28.1469 | Running Time: 26.6400
Episode: 55/100 | Episode Reward: 28.5643 | Running Time: 27.1302
Episode: 56/100 | Episode Reward: 28.3990 | Running Time: 27.6151
Episode: 57/100 | Episode Reward: 28.4950 | Running Time: 28.0974
Episode: 58/100 | Episode Reward: 27.8701 | Running Time: 28.5832
Episode: 59/100 | Episode Reward: 28.7812 | Running Time: 29.0694
Episode: 60/100 | Episode Reward: 27.9976 | Running Time: 29.5470
Episode: 61/100 | Episode Reward: 28.6969 | Running Time: 30.0193
Episode: 62/100 | Episode Reward: 28.6212 | Running Time: 30.4909
Episode: 63/100 | Episode Reward: 27.4787 | Running Time: 30.9708
Episode: 64/100 | Episode Reward: 28.4545 | Running Time: 31.4938
Episode: 65/100 | Episode Reward: 28.5045 | Running Time: 31.9696
Episode: 66/100 | Episode Reward: 27.7482 | Running Time: 32.4473
Episode: 67/100 | Episode Reward: 28.2154 | Running Time: 32.9266
Episode: 68/100 | Episode Reward: 28.5635 | Running Time: 33.3989
Episode: 69/100 | Episode Reward: 28.1430 | Running Time: 33.8813
Episode: 70/100 | Episode Reward: 28.6439 | Running Time: 34.3629
Episode: 71/100 | Episode Reward: 28.0486 | Running Time: 34.8364
Episode: 72/100 | Episode Reward: 28.7735 | Running Time: 35.3201
Episode: 73/100 | Episode Reward: 28.5547 | Running Time: 35.8198
Episode: 74/100 | Episode Reward: 28.8559 | Running Time: 36.3093
Episode: 75/100 | Episode Reward: 28.3621 | Running Time: 36.7830
Episode: 76/100 | Episode Reward: 28.5224 | Running Time: 37.2498
Episode: 77/100 | Episode Reward: 27.8541 | Running Time: 37.7178
Episode: 78/100 | Episode Reward: 28.5152 | Running Time: 38.1858
Episode: 79/100 | Episode Reward: 28.2094 | Running Time: 38.6564
Episode: 80/100 | Episode Reward: 27.7631 | Running Time: 39.1511
Episode: 81/100 | Episode Reward: 28.6392 | Running Time: 39.6275
Episode: 82/100 | Episode Reward: 29.1371 | Running Time: 40.1082
Episode: 83/100 | Episode Reward: 28.3666 | Running Time: 40.6566
Episode: 84/100 | Episode Reward: 28.5571 | Running Time: 41.1946
Episode: 85/100 | Episode Reward: 27.9868 | Running Time: 41.7414
Episode: 86/100 | Episode Reward: 28.3500 | Running Time: 42.3022
Episode: 87/100 | Episode Reward: 28.3478 | Running Time: 42.8577
Episode: 88/100 | Episode Reward: 28.2653 | Running Time: 43.4031
Episode: 89/100 | Episode Reward: 27.4543 | Running Time: 43.9250
Episode: 90/100 | Episode Reward: 28.3082 | Running Time: 44.4695
Episode: 91/100 | Episode Reward: 28.7126 | Running Time: 44.9914
Episode: 92/100 | Episode Reward: 28.8012 | Running Time: 45.5375
Episode: 93/100 | Episode Reward: 28.3971 | Running Time: 46.0787
Episode: 94/100 | Episode Reward: 28.2597 | Running Time: 46.6196
Episode: 95/100 | Episode Reward: 28.6428 | Running Time: 47.1560
Episode: 96/100 | Episode Reward: 28.4852 | Running Time: 47.6989
Episode: 97/100 | Episode Reward: 29.4192 | Running Time: 48.2465
Episode: 98/100 | Episode Reward: 29.0577 | Running Time: 48.7841
Episode: 99/100 | Episode Reward: 28.3379 | Running Time: 49.3224