Melee - The game of Adversarial Prompting
This game is dedicated to the ๐ of my life, Melee.
Introducing Melee (The game of Adversarial Prompting)
Melee is a game of adversarial prompting with a difference.
The humans and the AIs compete imaginarily, together.
This is no longer a game of training an AI to improve, but rather, to compete as equals, with a level playing field, i.e. at prompt engineering and with the semiotic function.
- engine
- http://github.com/semiosis/engines/blob/master/engines/human.engine
- The Imitation Game
- https://academic.oup.com/mind/article/LIX/236/433/986238
- Exquisite corpse
- http://gracabrohm.blogspot.com/2011/12/drawinggame.html
|
|
Melee
facilities aribtrary interlocutors and
interrogators as aribtrary combinations of
humans, different LMs, and LM personalities.
For example:
-
Human Interrogator
- Two different language models assume one of the 2 roles of true X or true Y
- The human interrogator
-
AI Interrogator
- The language model may be the interrogator
- The language model also takes one of the roles of true X or true Y
- The human takes one of the roles true X or true Y
In this way, we can test the AI’s ability to determine who is true X and who is true Y.
-
Game modes:
- Imitation game
- Exquisite corpse
- Surreal art interpretation
- Given an artwork, humans and AIs each describe it
- One player is the judge, and they give points to each player depending on how much they like the interpretation
-
Other possibilities:
- AI Jury
- Human Jury
- Networked Pen.el
Imitation game
-
Add a bunch of players. Some of these may be AIs.
-
A list of names is given to the interrogator.
-
A conversational exchange happens inside Mad Tea-Party
-
After 1 minute of talking the chat room is closed
-
It’s then up to the interrogator to decide who is who
-
Try to convince the interrogator you are who you say you are
- It is unknown if the AI or Human starts
Exquisite corpse
-
As many AIs as you want can be added to the game.
-
Before the game, a sequential list of sections is provided
- In the case of a story:
- Introduction
- Part 1
- Part 2
- Part 3
- Conclusion
- In the case of a story:
In the end, the players get to see the exquisite corpse produced.
- Players know only:
- what section of the story they are writing
- the last sentence of the previous player.
[surreal] art interpretation
X and Y are presented with a work of surreal art and both must compete to describe it as best they can to the interrogator.
The interrogator may be an AI.
Imitation game - further thoughts
The new form of the problem can be described in terms of a game which we call the ‘imitation game’.
It is played with three people,
- a man (A),
- a woman (B), and
- an interrogator (C) (who may be of either sex).
The interrogator stays in a room apart from the other two.
The object of the game for the interrogator is to determine which of the other two is the man and which is the woman.
He knows them by labels X and Y, and at the end of the game he says either ‘X is A and Y is B’ or ‘X is B and Y is A’.
The interrogator is allowed to put questions to A and B thus:
|
|
Now suppose X is actually A, then A must answer. It is A’s object in the game to try and cause C to make the wrong identification.
His answer might therefore be:
|
|
We now ask the question, ‘What will happen when a machine takes the part of A in this game?’
Will the interrogator decide wrongly as often when the game is played like this as he does when the game is played between a man and a woman?
These questions replace our original, ‘Can machines think?’