Experimental Video Game Made Purely With AI Failed Because Tech Was 'Unable to Replace Talent'
Experimental Video Game Made Purely With AI Failed Because Tech Was 'Unable to Replace Talent' - IGN
The article doesn't say much. So I checked the source for more information. It doesn't say much more, but IMO in a much better way, in two concise paragraphs. In the sourced financial report, it is in the intro, two paragraphs:
An example R&D initiative, sponsored by the Innovation team was Project Ava, where a team, initially from Electric Square Malta, attempted to create a 2D game solely using Gen AI. Over the six-month process, the team shared their findings across the Group, highlighting where Gen AI has the potential to augment the game development process, and where it lags behind. Whilst the project team started small, it identified over 400 tools, evaluating and utilising those with the best potential. Despite this, we ultimately utilised bench resource from seven different game development studios as part of the project, as the tooling was unable to replace talent.
One of the key learnings was that whilst Gen AI may simplify or accelerate certain processes, the best results and quality needed can only be achieved by experts in their field utilising Gen AI as a new, powerful tool in their creative process. As a research project, the game will not be released to the public, but has been an excellent initiative to rapidly spread tangible learnings across the Group, provide insights to clients and it demonstrates the power and level of cross-studio collaboration that currently exists. Alongside Project Ava, the team is undertaking a range of Gen AI R&D projects, including around 3D assets, to ensure that we are able to provide current insights in an ever- evolving part of the market
The central quote and conclusion being:
One of the key learnings was that whilst Gen AI may simplify or accelerate certain processes, the best results and quality needed can only be achieved by experts in their field utilising Gen AI as a new, powerful tool in their creative process.
Which is obvious and expected for anyone familiar with the technology. Of course, experiments and confirming expectations has value too. And I'm certain actually using tools and finding out which ones they can use where is very useful to them specifically.
The overall point may be relatively obvious, but the details are not.
Which steps of which processes is it good at, and which not? What can be easily integrated into existing tooling? Where is is best completely skipped?
Yes, exactly. That's what I was referring to in my last sentence.
Honestly it sounds extremely generous by saying the best results can be achieved by experts with GenAI. In my opinion the best results can be achieved without it entirely.
Folks really didn't understand how AI will work. It's not going to be some big we're dropping 1000 people.
It's going to reduce demand over time.
And in that regard it's no different than any other productivity tool or automation, I have seen software being bought that immediately Eliminated 80 odd jobs.
I've heard it as "No one is losing their job to AI, but they will lose their jobs to someone who is using AI."
Think of AI like computers and spreadsheet software in the early 80s. I bet a lot of accountants were pretty freaked out about what this new technology was going to mean for their jobs.
Did technology replace those accountants? No, but companies probably didn't need as many accountants as they did before. AI will likely reduce the number of programmers that a company needs, but it won't eliminate them
Case in point: I'm using ChatGPT to help me write cover letters. I make sure to proofread them and sometimes it hallucinates my expertise, but it makes it a lot faster.
Also not going to happen. It's massively overrated.
It will start with going from 5 writers to 3, or going from 10 animators to 6.
Then 10 years from now as it gets more advanced we will be down to maybe 1 writer and 2 animators.
going from 10 animators to 6
It’s still crazy to me that like half of Across the Spider-Verse was AI generated
It's going to reduce demand over time.
At least in video games it's probably going to be more that scope increases while headcount stays the same.
If most of your budget is labor, and the cost of the good is fixed, with the number of units sold staying around the same, there's already an equilibrium.
So companies can either (a) reduce headcount to spend a few years making a game comparable to games today when it releases, or (b) keep the same headcount and release a game that reviews well and is what the market will expect in a few years.
So for example, you don't want to reduce the number of writers or voice actors to keep a game with a handful of main NPCs and a bunch of filler NPCs when you can keep the same number of writers and actors but extend their efforts to straight up have entire cities where every NPC has branching voiced dialogue generated by extending the writing and performances of that core team.
But you still need massive amounts of human generated content to align the generative AI to the world lore, character tone, style of writing, etc.
Pipelines will change, scope will increase, but the number of people used for a AAA will largely stay the same and may even slightly grow.
Folks really don't understand how AI will work. It's not going to be some big we're dropping 1000 people.
ai automates the behavior of an average agent, not a talented one
And when it doesn't it still tells you that it does, incapable of correction.
Unless you specify that you want a talented output. A lot of people don't realize that you need to tell AIs what kind of output you want them to give you, if you don't then they'll default to something average. That's the cause of a lot of disappointment with tools like ChatGPT.
Ahhh so the secret to using ChatGPT successfully is to tell it to give you good output?
Like “make sure the code actually works” and “don’t repeat yourself like a fucking idiot” and “don’t hallucinate false information”!
So I need to praise it and call it a good boy?
I always love watching you comment something that's literally true regarding LLMs but against the groupthink and get downvoted to hell.
Clearly people aren't aware that the pretraining pass is necessarily a regression to the mean and it requires biasing it using either prompt context or a fine tuning pass towards excellence in outputs.
There's a bit of irony to humans shitting on ChatGPT for spouting nonsense when so many people online happily spout BS that they think they know but don't actually know.
Of course a language model trained on the Internet ends up being confidently incorrect. It's just a mirror of the human tendencies.
Interestingly enough, I've started adding something similar to my AI prompts because a Lemmy user had it in theirs and I liked their images.
No shit.
Using AI to automate super tedious and repetitive tasks is great and everybody should start doing it
Yeah, there's many times I type "class for:" followed by a a dump of SQL, JSON, XML or whatever and it'll make a class with properties named correctly with the right types. I still have to figure out tricky data relationships and that sort of thing, but the boring tasks of creating interfaces to databases and objects for serializing stuff goes a lot faster now.
So a much larger percentage of my time is devoted to solving problems rather than doing all the boring grunt work usually involved with getting data in and out of the app.
Yeah current gen AI is still very much a human tool - an assistant - maybe a companion if you stretch it to it's edge. I for one welcome a personal AI buddy
Too many people see AI doing work as an either or thing. AI won't replace people outright, it'll just reduce the amount of people you need.
Duh.
That's a great image.
RIP Norm.
The game will not be released to the public as it was just a research project, and Keywords didn't provide any additional information about what type of 2D game it created.
So we just have to trust them on this? Yeah, no.
"House made entirely of cement is a failure because you still need doors and windows and stuff."
I am astonished by an established, commercial website having good structure.
It looks like a documentation website. Sidebar with clear categories and navigation. I really like it.
Well, I'm glad somebody did the experiment at least.
Huh, would you look at that.
This is a quote that should end in 'yet'. I am very confident in saying there will be an AAA game released that will be designed and implemented 95%+ by a machine. I am less confident in providing a timeline. If you consider the history of machine learning is ~70 years old (in one sense, one can argue other dates) and you plot the advances from tic-tac-toe to what machines can do today (chess being a prime example), it doesn't take much vision to see that it won't be but a matter of time before this is a real thing.
Sure it may produce a game but much of what makes a game good is making it fun and memorable. If we can eventually create a general AI then absolutely I think such a thing is possible. Otherwise it will be a copypasta mishmash and having a cohesive and fluent design is a huge if.
lmfao
This kid is not going places.
you're right, you won't.
Add ", yet" to the headline and come back in a year or two.
Currently AI may fail to produce a video game, but so was the case for images, videos, and texts only a few years ago.
Failure is a good thing because it's preceded by attempt.
Yeah. Just because it can't do it now, doesn't mean it won't ever. And also refer to my other comment for how this is a bad study as they didn't even provide any details on the game itself, let alone release the game. But anyone can do a similar study for themselves at home, since AI is free to use!
Not yet able to replace talent
They forgot to import the talent module.
give it a few more years.
Just like self driving! In 2010 it was almost there, just needed a few more years...
We'll have cold fusion in 10 more years‽
I really don't think there's more examples of optimistic predictions than there are pessimistic ones.
The discoveries made in recent years definitely point to an emergent incredibly useful set of tools that it would be amiss to pretend wouldn't eventually replace junior developers in different disciplines. It's just that without juniors there will never be any seniors. And someone needs to babysit those juniors. So what we get is not something that can replace an entire workforce in a long long while even if top brass would love that
Yes actually (except more than a few years).
Waymo is already operating a robotaxi service in 3 cities, now they just need to expand and find a way to make it not lose money.
Go see videos of how well FSD V12 performs and you're up for a surprise. Full self driving sucks untill it doesn't. AIDRIVR puts up good content if you want recommendations.
"Replacing Talent" is not what AI is meant for, yet, it seems to be every penny-pinching, bean counting studio's long term goal with it.
Yep AI at best can supplement talent, not replace it.
I'm not a developer, but I use AI tools at work (mostly LLMs).
You need to treat AI like a junior intern.... You give it a task, but you still need to check the output and use critical thinking. You cant just take some work from an intern, blindly incorporate it into your presentation, and then blame the intern if the work is shoddy....
AI should be a time saver for certain tasks. It cannot (currently) replace a good worker.
I do think given time, AI can improve to the level that it can do nearly all of the same things junior level people in many different sectors can.
The problem and unfortunate thing for companies I forsee is that it can't turn juniors into seniors if the AI "replaces" juniors, which means that company will run out of seniors with retirement or will have to pay piles and piles of cash for people just to hire the few non-AI people left with industry knowledge to babysit the AIs.
The problem is the crazy valuations of AI companies is based on it replacing talent and soon. Supplementing talent is far less exciting and far less profitable.
Current AI*
I don't see any reason to expect this to be the case indefinitely. It has been getting better all the time and lately been doing so at a quite rapid pace. In my view it's just a matter of time untill it surpasses human capabilities. It can already do so in specific narrow fields. Once we reach AGI all bets are off.
Not even that, it's a tool. Like the same way Photoshop, or 3ds max are tools . You still need the talent to use the tools.
https://www.cognition-labs.com/introducing-devin There are people out there deliberately working to make that vision a reality. Replacing software engineers is the entire point of Devin AI.
sed “s/studio’s/tech industry c-suite’s/“As an engineer, the amount of non-engineering idiots in tech corporate leadership trying to apply inappropriate technical solutions to something because it became a buzzword is just absurdly high.
Just make the modulus of elasticity more agile. Problem solved!
But that's pretty much why AI is developed.
It was more like a scientific discovery