• frezik@midwest.social
    link
    fedilink
    arrow-up
    0
    ·
    4 months ago

    Just cache the common questions.

    AI models work in a feedback loop. The fact that you’re asking the question becomes part of the response next time. They could cache it, but the model is worse off for it.

    Also, they are Google/Microsoft/OpenAI. They will do it because they can and nobody is stopping them.