The problem there lies with the risk of the managers scamming the investors.
Manager mismanages investment. Manager somehow contrives to buy the asset at firesale price. There are multiple ways of the doing this. Manager then manages asset better ( or just benefits from general economic rebound ). Managers win. Investors lose.
It happened in the early 90's and it will happen again now, and on a large scale.