Nihar Malaviya, Penguin Random House’s C.E.O., is a behind-the-scenes operator with a significant task: leading the company after a period of messy, and expensive, turbulence.