I think a good mental model of what you can expect from a chat bot is imagining that somebody read tje bank statement to you and them asked you a bunch of questions. Could you follow that, not make smy mistakes, not forget anything? Cam you perform the task "from the top of your head", not writing anything down, not pulling up excell or a calculator? If you can there's a good chance AI will be able to do that too. The fact that it sometimes can do more is pure miracle. And if you want it to do those things consistently you need to provide it with access to the tools you'd need to perform thus task consistently.
Go row by row. See a certain phrase in the transaction description? Look a few rows ahead. Spot associated fees with just a glance. Write that group of transactions down somewhere else.
That's it.
I tried different kinds of prompts, from imperative to declarative, including telling the AI to write a script for its own internal use, but they just don't seem to get it.
AI has purely linear input channel. It gets tokens one by one. Context is a form of short term memory. I know, that because you give it written text it seems like you provide it with a document it should be able to process in any way it likes, but the system is set up as if you read the document to AI, word by word and asked questions about it, that it needs to answer "of the top of its head".
> It's simple, I can do it myself:
> Go row by row. See a certain phrase in the transaction description? Look a few rows ahead.
Can you do it without looking at the document? Just by ear? Every time correctly? Without missing something?