Emily's Cat
Rarely prone to hissy-fits
Yeah. My employer is in the process of moving our entire data warehouse onto cloud-based Snowflake, and we will need tokens in order to access our own damned data that is needed to run the business. The token cost varies by the time the code runs, the volume of data returned, and the traffic load at that time. There’s no way to know what the cost will be, and building new code is going to be a nightmare because it’s never perfect the first time.I think the even bigger problem is not just being expensive, it's that you don't know how expensive it will be. You don't know in advance how many tokens a certain task will need to complete, and even less so after the several tries and tweaks to the prompt. You only know how much you've used when the invoice comes.
So far as I can tell, we’ve given all of our data to a gunman who is holding it hostage.