Can a man be too young for active surveillance?

There is a “conventional wisdom” that active surveillance (AS) is only for older men, and that younger men are better off having immediate radical treatment, typically prostatectomy (RP).