Recently I've been working on a problem at work and asked an AI for help using a new and poorly documented feature to make some fairly specific files that can be used as test inputs. It would repeatedly say "here you go" and give me instructions that didn't work. When I responded with "are you sure? when I tried it I get this outcome" it would say "oh I'm sorry, here is the correct way to do it" and get it wrong again. After about four attempts it would start saying "this is the final and definitely correct way of doing it" and it would still be wrong.