VintageSnarker said: "I thought the actor was just silly or camp instead of intimidating and genuinely misogynistic.”
That's probably because the Higgins that you are familiar with and think the character should be like is the Rex Harrison incarnation not really what the text lets on. I always get the impression from reading both Shaw's pygmalion and the libretto of My Fair Lady that Higgins is a man child. Children have more clear-cut moral principles than adults and tend to stick with them better. Higgins clearly states why he behaves the way he does in the text, and although it comes across as misogynistic, he does have unwavering principles that does not change with people nor occasions until Eliza.
To bring up another point, the Pygmalion in My Fair Lady is actually Eliza, not Higgins if you think about it. The clay didn't choose to become a lady, and the transformation is enabled by Pygmalion. Eliza, however, knows what she wants, and she's the one goes to Higgins's house and asks for lessons. In other words, Eliza is the enabler of her own journey. Her transformation might be catalyzed by Higgins, but she is the one that started the process. My Fair Lady is also about Higgins's transformation. While Eliza becomes "proper and prim" through the journey, Higgins starts to feel tenderness as he grows "accustomed to her face." The transformation was enabled by Eliza. It is only through her that Higgins sort of "grows up."