Behavior change is the key AI metric
The speakers argued that product teams should measure the success of financial AI through concrete customer behavior changes rather than superficial engagement metrics.
The argument
Engagement metrics can be misleading if users are simply trapped in frustrating chatbot loops. True success is demonstrated when users take meaningful financial actions, such as paying down high-interest debt or opening savings accounts after an AI interaction.
The thesis, stress-tested
✓ What validates it
- ✓Financial institutions reporting higher conversion rates on high-yield products directly following AI interactions
▸ Risks discussed
- ▸Forced chatbot pathways can artificially inflate engagement while masking customer frustration
Hear it yourself
"We need to we are and we need to be very closely regulated. And so that is giving a lot of constraint into what AI can do, but then also you end up in a weird situation where, okay, there are these constraints, so the AI cannot do that much, but let's stick it on anyway. And so, there is, you know, a a frustrating situation which you're trying to ask this financial co pilot that's meant to change your life, how much did I spend on groceries last month, and it doesn't understand your prompt. So, yeah. That I think I see as a problem."
09:30
AFFILIATE LINK · ZORTIX MAY EARN A COMMISSION · NEVER A RECOMMENDATION TO TRADE