Depends on how the apps that use Java are built. But, yes, getting rid of previous versions of Java should not be a issue most of the time.
Personally, I say get rid of all versions of Java and the developers that write crapplications for it, but hey who am I to say