Also I’d imagine that in the reinforcement learning route each ‘entity’ is a separate model which would have steep computational overhead implications or you just use one model in the environment and it is vanilla reinforcement learning which still isn’t very vanilla btw.

If you go the reinforcement route you’d need to use the correct reinforcement policy which can be tricky to know without testing if your not familiar with calculus and testing is easier but still requires pretty niche and deep knowledge of model testing.