180 grit will take care of that area. Sand it down to the primerbase on that area of the car. The primer down there is a little bit different, and sticks much better than the other areas of the car. It has a rubbery (yet smooth) texture to it - think of a pencil eraser...
So the new paint won't have that orange peel look to it, but it will stick to the good primer.