Air Canada has been ordered to compensate a B.C. man because its chatbot gave him inaccurate information.
Jake Moffatt was booking a flight to Toronto and asked the bot about the airline's bereavement rates – reduced fares provided in the event someone needs to travel due to the death of an immediate family member.
Moffatt said he was told that these fares could be claimed retroactively by completing a refund application within 90 days of the date the ticket was issued, and submitted a screenshot of his conversation with the bot as evidence supporting this claim.
The airline refused the refund because it said its policy was that bereavement fare could not, in fact, be claimed retroactively.
Air Canada argued that it could not be held liable for information provided by the bot.
It’s your fucking system. You’re liable for what it says.
I got a bereavement care when my father died the night before my flight to see him. The phone agent did this without my asking for it. Humans good, chatbots bad.
I wonder how anyone in their right mind would propose the defense "we can't be held liable for what the chatbot we purposefully put on our website said". Did Air Canada's lawyers truly think this would fly?
If you don't want to be held to AI hallucinations, don't put an AI chatbot on your website, seems easy enough.
My organization won’t even allow auto translation widgets on our site. Instead, we refer people to using web translation services on their own, with clear language that says we’re not liable for third party mistranslations. (In multiple languages, by a company that has signed an indemnity agreement with us if their translation becomes an issue.)
It’s a bit heavy-handed, but the lawyers hold more sway than the communications folks, and I don’t disagree with the approach – you don’t want users misunderstanding what your site says, and being able to blame you for it.
This article does not actually mention the chatbot being AI. As chatbots have been around for many years, it is possible this is just a normal non-'AI' chatbot that someone programmed that information with (potentially old information that had long since changed, but no one has updated).
Either way, they are liable for what it tells customers. If it is AI, well... no company should be using AI to make legally binding statements, or advertisements to customers (without human review).
At the moment, companies deploying an AI, should be doing so with AI as the product, not integrated into selling non-AI related products, or services.
If they get the precedent they are not responsible for what the AI chat bot says, then this goes for any chat box on any site and they all become worthless. Any chat bot gets a disclaimer basically saying "this thing is a dirty lier and nothing it says matters." People will start to call human customer service to confirm what the chat bot said and the savings in employee costs are gone.
It's not a long term strategy. The person who made this decision is thinking about their quarterly or yearly bonus. By the time the problems hit, they've long since cashed out.
CS will be a multi modal chatbot too, just with a voice. I don’t think they want any human support at all. To a business, the only reason overhead exists is to cut it, and support has always been overhead.
They're not fighting for the $800. They're fighting for the right to continue to use their shitty chatbot to reduce their support staff costs while not being liable for any bullshit it tells people.
There will be cases like this in every jurisdiction.
You are pretty optimistic they would pay $100k for this job. It is probs far less, which makes this even worse, they are not saving that much money really.
And they'll cancel a flight on the slightest pretext. I've gone back to the hotel and waited 3 days while I watch from the room window flight after flight of other carriers taking off.
I'm curious to know more about your experiences. At home we try to only travel air canada and never had any issues. I've had so many terrible experiences with American, United and such that if I can choose air canada, I'll always do it.