realtime

When I pulled my battery out in the early winter (for winterization) I noticed I had a little acid corrosion on the battery hold down piece. I cleaned the piece and hold-down bolt as well as the battery area in general. I used some baking soda to neutralize any residual acid (was that a mistake??). Now there is a little orange-rust colored "dust" stuck in the nooks and crannies - Its nothing structural but obviously I dont want anything that even faintly resembles rust anywhere in the car. I tried vaccuming but it doesnt come up - I didnt want to use any water or water based cleaning solutions for fear of it making it worse - any suggestions as to how to get that rust-dust out?
TIA,
Dan