In the past, the private equity world has been largely populated by ultra-rich investors, endowments and pension funds. That is about to change.