Dependencies - why does a package installed later become un-removable without nuking the whole system?

At times a package I install later on wants to take packages previously installed while going out. Some even try to take out core system packages. This mean trying out something is fraught with risk of permanently staining the installation.

Why does this happen?