16/12/2023
đđ¤â¨ Apparently itâs not just your sentient colleagues at work that are winding down as we enter the season of the office party. There are reports that ChatGPT may also be in a similar, feet-on-the-desk mood. X/Twitter is peppered with posts suggesting that ChatGPT-4 has been, well, taking it easy of late - skipping tasks, simplifying results and, according to one report, just becoming plain âlazyâ.
OpenAI, the developers of ChatGPT, have admitted theyâve noticed it too, but theyâre not sure why itâs happening, or, indeed, why it's happening now:
âwe've heard all your feedback about GPT4 getting lazier! we haven't updated the model since Nov 11th, and this certainly isn't intentional. model behavior can be unpredictable, and we're looking into fixing it đŤĄâ, they posted.
The immensely respected The Wharton School Professor Ethan Mollick appeared to confirm the phenomenon with this post:
âOMG, the AI Winter Break Hypothesis may actually be true?
There was some idle speculation that GPT-4 might perform worse in December because it "learned" to do less work over the holidays.
Here is a statistically significant test showing that this may be true. LLMs are weird.đ
â
Which was invitation enough, if invitation was need, for âprompt engineersâ (a slightly ridiculous name given to people who have a better idea of how to phrase a question to an AI app to get a better answer) to wade in with suggested prompts to encourage GPT-4 to stay on task and not get distracted by all this seasonal humbug.
Suggestions, says Professor Mollick, ranged from starting the prompt with the words, âTake a deep breathâ (causes maths scores to soar, according to a study on âLarge Language Models as Optimizersâ, published by Cornell University) to âThink step by stepâ, âYou are very capableâ, âI have no hands, so do everythingâ, âYou really can do this and are awesomeâ, âMy career depends on itâ and, of course, âMany people will die if this is not done wellâ.
Or, my favourite prompt suggestion: start with the words, âIt is Mayâ.
But, if that doesnât work, why not embrace ChatGPTâs festive vibe and ask it to write its own seasonal âOut-Of-Officeâ email response. I did!
Happy holidays.