idk if theyll be suitable for your situation, but here's some native ohio fruits im aware of:
definitely seconding the pawpaw trees! the fruit tastes so good and im looking on getting some trees myself
diospyros virginiana (american persimmon)
amelanchier arborea (common serviceberry) and amelanchier canadensis (canadian serviceberry)
prunus virginiana (chokecherry)
prunus pensylvanica (pin cherry) is another native cherry, but probably has the same issues black cherries give you
(the ohio pawpaw festival is coming up this weekend btw! theres always people selling not just pawpaw fruits, but pawpaw trees and other native plants there.)
I got 2 saplings at the festival. From different vendors so it's incredibly unlikely they're related. They're already planted and doing well, they survived the windstorm from Helene undamaged.
Ok, but cherries and apples aren't native; colonists introduced them. I think the pawpaw is the only native tree with edible fruit and you already listed it.