Can the rebuilding of a world be sped up? #118
-
I have been using this library for a while for running my experiments and I have noticed a bottleneck. When using a profiler, I can see that the following line from the |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
Thank you for your detailed observations, and you're absolutely right—the performance bottleneck of the library is indeed on that line of code. In terms of its impact on user experience, there have been discussions about it, and for most environments, the episode length is fixed at 1000, which limits the performance impact to a constant factor. However, with the introduction of more complex termination mechanisms, such as resetting upon reaching a goal, this is indeed a pressing issue that needs to be addressed. We have explored solutions before, but they require some logical restructuring of the current underlying code. Given the scope of the changes and the time required for the refactoring, we've put this plan on hold for now. However, rest assured that this issue is of high development priority. Thank you again for your feedback. |
Beta Was this translation helpful? Give feedback.
Thank you for your detailed observations, and you're absolutely right—the performance bottleneck of the library is indeed on that line of code.
In terms of its impact on user experience, there have been discussions about it, and for most environments, the episode length is fixed at 1000, which limits the performance impact to a constant factor. However, with the introduction of more complex termination mechanisms, such as resetting upon reaching a goal, this is indeed a pressing issue that needs to be addressed.
We have explored solutions before, but they require some logical restructuring of the current underlying code. Given the scope of the changes and the time required for the refacto…