Show HN: Gavio: open-source interceptor pipeline for production LLM applications

 (github.com)

3 points | by cees007 5 hours ago

1 comments

  • cees007 5 hours ago
    One design decision I'm still thinking about is interceptors.

    Right now almost everything is implemented as an interceptor:

    - PII - Retry - Audit - Cost - Logging - Mock providers

    I'm curious whether people think this is the right abstraction, or whether some

    [-]