I think I have to replace the side mirror switch. Both sides will not move up and down but only side to side.
is it as easy as replacing the window switches?

Thanks

 

Yep - just carefully pry them out, disconnect the cable, replace and push back into place.

Edit: Oops - I misread your post thinking you meant the window switch. However, I think the mirror switch is a pressure fit as well.

 

...just be sure to not drop the lead down into the door during the process