With all due respect to the above posters, I'd say be VERY careful about sanding/brushing the outside of the brick. If you look at most bricks, the outside edge is smooth, and has a shine to it. That's part of the process of firing the brick, and that finish is there for a reason.
If you chip, or wear the outer coating away, then you expose the inside of the brick to the elements. There
are paint removers that will remove the paint from the surface of the brick, without damaging the finish of it.
Michigan, like Ontario, is prone to freeze and thaw cycles, and if water is allowed into the brick, there's the potential for a whole lot of damage.
I researched this topic quite extensively a few years ago. We live in an 1860's Victorian cottage, and a previous owner had painted the beautiful yellow, local brick, over in white.
I looked into all sorts of solutions for removing the paint, and finally decided to repaint the house in a cream colour. The cost of removing the paint was prohibitive. This may not be so expensive for you, depending on how much of the brick is stained.
During my research, looking for a solution for my home, I found numerous sites, warning about sandblasting, sanding, brushing and scraping brick. The consensus seemed to be, to use a paint remover, and there are several good ones on the market.
Even that wasn't a good option in my case, because, as I said, it would have been too costly to treat the whole exterior of the house.
Here's an interesting article:
Strip and peel methods tedious but effective for removing paint from brick I found some environmentally friendly paint removers
here. However, I think Lowes or Home Depot would also have some products.