Symbolically, sure, but then you're not dealing with infinities you're just representing them.
It's a meme it's playing fast and loose with things but the general gist is that mathematics, to this day, doesn't really care about Gödel/Church/Turing, incompleteness, the halting problem, whatever angle you want to look at it from. Formalists lost the war and they simply went on doing maths as if nothing had happened, as if a system could be simultaneously complete and consistent. There's people out there preaching to the unenlightened masses but it's an uphill battle.
Math went on because it doesn't matter. Nobody cares about incompleteness. If you can prove ZFC is inconsistent, do it and we'll all move to a new system and most of us wouldn't even notice (since nobody references the axioms outside of set theorists and logicians anyway). If you can prove it's incomplete, do it and nobody will care since the culprit will be an arcane theorem far outside the realm of non-logic fields of math.
We have sorta the same problem with imaginary numbers, and I remember some programmable calculators can process complex numbers using symbolic representation (which happens to work similarly to Cartesian coordinates, so that's convenient)
But from what I remember any infinity bigger than counting numbers (say the set of real numbers) cannot be differentiated from each other, so we don't have established rules.
To be fair, I last tinkered with infinities in the aughts and then as a hobbyist. The Grand Hilbert Hotel can accomodate more compound infinities and still retain perfect utilization since the last time I visited.
Computable. There are countably many computable numbers since there are only countably many possible programs. Non-computable numbers can't be exactly referred to / described / constructed by a program, so if your point of view is that everything is a program, you would say they don't exist.
homotopy type theory has a way to describe the reals in full generality via cauchy sequences, so if type checking ever gets proven to be decidable, this won't be true any longer. it's chapter 11 in the hott book.