Stop text highlighting

This is s pretty simple question (I hope). When I press on a scrollable text field the grey text is "highlighted" as I hold to scroll making it a darker color and hard to read. I simply want to remove this highlighting. How do I do this?