That's a good example of why you want to define clear tasks for each role, to identify things that you are missing (planning how to promote your product after launch), and new responsibilities (feature configuration), but also not to hire people that won't be a good fit for the job.

There will always be people who make product decisions based on user feedback, mock-ups, and A/B test results. That might even be the last job LLMs don't take over.