A couple months ago, Nan Ransohoff published a piece arguing there should be 'general managers' for more of the world's important problems (here). I think a great example of how this can be operationalized in AI safety is Pangram, a company that detects LLM-generated text. They've gotten a lot of press recently (The Atlantic article) and the problem they're solving is relevant to ensuring societal stability in the AGI transition period.

It can be really useful to have people willing to go really deep on solving one particular problem rather than contributing to the AI safety omnicause. My guess is that existing AI safety fellowships like MATS would not produce an organization like Pangram, although my crux here is that Pangram is actually more beneficial than this talent going and doing the default post-MATS path.

I'm curious if there are any other tractable subproblems in AI safety that would benefit from having a Pangram-shaped organization own them. One that sticks out to me is providing high-quality data for increasing LLM articulacy: ensuring that LLMs are able to communicate effectively with human operators so that humans can stay in the loop longer (I have a writeup on this coming up).