If someone pulled a prank on you while you were away for a while, and took your refrigerator door and swapped the hinges and door handle sides, would you even notice?
Would you be confused? Would you be mad? Would you even care?
LOL, I'd never do this, but it seems harmless silly enough...
Yes it is. You change something about a person's environment, and when they ask "did you change that thing?" you deny it. If you never reveal that you actually changed the thing, it's called gaslighting.
It's named after a movie in which one character did this to another character with the intensity of gas lamps on the wall, with the intention of making her doubt her own perceptions.