LLMs' fanciness and increasing intelligence don't change the realityβultimately, they're just API calls. As such, they suffer from the same problems as API calls, such as throttling, timeouts, and exponential delays. π β‘οΈ
β‘οΈ But you can use clever ways to make LLM calls faster.
9 months ago