How the replay_buffer store datas

[wearesunshines]

I saw that the elements have different dimensions. Can you help me? Thank you !

[DKuan]

For the training of GRU, we have to save the experience in the same size(steps), so we must deal with the replay_buffer differently from the file you see, like DQN, without RNN or LSTM.