when you could see that the barbs the Dream Lord was throwing at the Doctor were affecting him, it didn’t seem like they affected him enough

But I liked that. I like to think he's recovering from the Time War, and recovering the person he was before then. Not that he'll ever become no-longer-affected-at-all, but it's natural that the barbs should stop sinking in so deeply.