03-27-2024, 05:35 PM | #1 |
Join Date: Dec 2017
|
Artificial Intelligence Gamecrafting Tools
Is there any discussion in the forums or elsewhere about stuffing something like an SJG licensed copy of ChatGPT or GROK or some other AI word crafting system with a convenient big chunk of G.U.R.P.S. rules, descriptions, stories and other information, then making it available as a service to rent hourly, or create software products for purchase? It seems to me this sort of gaming tool might generate fun adventure seeds, campaign background structures, and for sure some fascinating fnord.
I'm guessing this might be a topic occasionally kicked around among SJG staff, but maybe there's no appetite yet for something potentially huge with unknown return on investment and uncertain fun value. Thoughts? |
04-01-2024, 04:45 PM | #2 | |
Join Date: Nov 2008
Location: Yukon, OK
|
Re: Artificial Intelligence Gamecrafting Tools
Quote:
If you wanted to use those apps to generate an adventure idea seems like you could jsut set out the ideas without any mechanics.
__________________
My GURPS publications GURPS Powers: Totem and Nature Spirits; GURPS Template Toolkit 4: Spirits; Pyramid articles. Buying them lets us know you want more! My GURPS fan contribution and blog: REFPLace GURPS Landing Page My List of GURPS You Tube videos (plus a few other useful items) My GURPS Wiki entries |
|
04-01-2024, 04:47 PM | #3 |
Join Date: Feb 2005
Location: Berkeley, CA
|
Re: Artificial Intelligence Gamecrafting Tools
Current-gen AI tools aren't particularly good at generating rules-legal RPG text (probably a combination of limitations of AI and an inadequate data set), and if you don't care about rules integration you can just use generative AI directly.
|
04-08-2024, 03:15 AM | #4 |
Join Date: Dec 2017
|
Re: Artificial Intelligence Gamecrafting Tools
Hmm . . . I really do want the AI to generate rules-legal answers to questions, as well as larger text responses to more complex challenges. Ideally, the point of beginning to explore Large Language Models would be to identify what currently CAN be done. Does a relatively vague and confusing fnord response make a game more interesting? Maybe once, but probably not twenty times each hour.
On the other hand, can we identify functionality we want, communicate it to the AI engine supplier, and receive engine updates with our desired features? If not, well, that sucks. Maybe find a different AI engine supplier, maybe backburner the whole thing for a year and then try again. Ray Kurzweil and others who actually know something about AI describe their experiments as, "Dumping all the writings of my Father into an LLM and then asking questions. The answers are often remarkably like I'd expect from a conversation with him." Imagine dumping all the purely SJG material for G.U.R.P.S. Fantasy into an LLM and asking it some questions. If the responses are not rules-legal, is there any obvious way we could convince the LLM what makes a good answer? Maybe the game rules need to be accompanied by many, many correct examples of play? Maybe giving the LLM visibility into some online VTT games transcripts would be helpful. Of course, you can see how this spirals into an expensive time bloat, scope bloat monster of a research project. There would have to be some way to generate revenue from some identifiable result, relatively quickly. Maybe a weird but changing toward better online gaming experience that would be fun enough to attract subscription gamers is possible? Cannot know, if nothing is attempted. |
04-08-2024, 07:32 PM | #5 | |
☣
Join Date: Sep 2004
Location: Southeast NC
|
Re: Artificial Intelligence Gamecrafting Tools
Quote:
Asking an LLM for a GURPS character sheet, for example, gives something that looks like a GURPS character sheet, but usually doesn't stand up to close scrutiny. Math is wrong, traits are often made up or misapplied, skill lines frequently have note symbols (†‡) when there are no notes to reference, simply because the LLM has seen that at the end of skill lines and assumes they are just supposed to be there. LLM's are pretty good at coming up with character backgrounds and descriptions (though they sometimes either go weird or cliche). But if you want something that checks to make sure your text meets specific requirements aside from being readable text that looks relevant, an LLM is not really the approach you want. You probably want something running within or alongside some software like GCA or a VTT, with the rules built in.
__________________
RyanW - Actually one normal sized guy in three tiny trenchcoats. |
|
04-09-2024, 07:35 AM | #6 |
Join Date: Apr 2011
|
Re: Artificial Intelligence Gamecrafting Tools
I am on the support team for a forum software and we often see posts generated by AI that are pretending to answer support questions. They always sound reasonable, but invariably give nonsense answers. I have seen and reported such posts here too. Using AI as a game-rules tool would be a complete waste of time.
|
04-09-2024, 09:43 PM | #7 | |
☣
Join Date: Sep 2004
Location: Southeast NC
|
Re: Artificial Intelligence Gamecrafting Tools
Quote:
Think Watson, not ChatGPT.
__________________
RyanW - Actually one normal sized guy in three tiny trenchcoats. |
|
04-12-2024, 10:32 AM | #8 | |
Join Date: Aug 2004
Location: Carrboro, NC
|
Re: Artificial Intelligence Gamecrafting Tools
Quote:
LLMs are surprisingly useful for document summaries, flavor text, etc. Unfortunately, their text also sounds authoritative, because that's what they're imitating. |
|
04-12-2024, 10:49 AM | #9 |
Join Date: Feb 2005
Location: Berkeley, CA
|
Re: Artificial Intelligence Gamecrafting Tools
Given a sufficiently large data set, correct answers will look more similar than incorrect answers, but if you were to ask a human to learn to build GURPS characters by reading a thousand character sheets (without reading the rules) you probably wouldn't get the same odd behaviors you see from LLMs, but it's not very likely that they would build legal characters.
|
04-17-2024, 07:16 AM | #10 |
Join Date: Aug 2004
Location: Pacheco, California
|
Re: Artificial Intelligence Gamecrafting Tools
The problem with an Automated Interpolation Gamemaster is that it will forget all context outside of its thousand or so word context window and simply respond to what the player is typing in now.
There's no point in automating that sort of GM style as I already exist.
__________________
-HJC |
Tags |
artificial intelligence, chatgpt, grok |
|
|