Do I have to plant a pot-grown tree in a pot?

Yes, in fact that is what we recommend. Most fruit trees do better if planted in the ground. Although we supply many of our fruit trees in temporary pots (known as "pot-grown" or "container-grown") that does certainly does not mean you have to grow them on in pots.