Hair follicles on penis shaft?

There are these indents on the underside of my penis shaft that have been there for a few years now and from each dent, there is a hair stemming from it. If I leave them alone for a while they don't look as irritated, but they never seem to fully go away. They practically look like scars. Why have I got these and how can I make them go away?