Driver side mirror motor

Hello guys,

I am having an issue I don't know any of you have had in the past. After unlocking the car with the remote and opening the front driver side door, I hear the mirror motor function all the way until I close the door. This would have made sense if the memory set up was re-adjusting my mirror. This is not the case, I just hear it whirring and this messes up the setting of the mirror as it either points up or down. What might be causing this?
Note this is only happening to the driver side mirror.

Thanks.