I have always done this, too.
I’m especially fascinated by the ones who walk by, who enter and exit a scene. Somebody had to make the decision that the scene would be better if there were an anonymous person walking around in the background. Somebody is off-stage, cuing these people when to come in, how fast to walk, and when to leave.
I think it would be really hard to consciously make a scene look normal.