The issue didn't exist for me on Android 13, the telephoto lens always made similar noises when changing zoom levels or even shaking the phone but apparently, that's just a thing that happens rather than a bug.
See if it's still within warranty and if it's the case send it back to Google, the lens might be faulty. If not, try to get a quote from a repair shop that can replace that lens. Your issue sounds definitely like a mechanical problem.