I don't have a brush, but I find my hair and comb have never had enough lint or dust to be a problem because I keep my comb in the cute little bag that it came with. I only need to clean it around every two weeks, or even a month, and that's due to sebum and oil buildup. When I do, I use a toothbrush and my shampoo to clean it off.
Are you guys leaving your stuff out in the open? Even if it's in a drawer, your combs/brushes are going to collect more dust than if you keep them in a bag.
Bookmarks