FAQ
Is Boson open source?
Boson Cloud (backend, web app, and platform services) is not open source. Boson’s SDKs are open source so you can review and integrate instrumentation—but they are designed to work only with Boson’s official backend (hosted cloud or a customer-deployed Boson instance Boson provides). They are not a generic client for other observability products.
Should we trace 100% of production traffic?
Usually no. Start by capturing:
- 100% of errors
- 100% of critical endpoints / agent runs
- a sampled subset of normal traffic
Do we need to store prompts and outputs?
Store enough to debug, but avoid collecting data you cannot protect.
- redact secrets and PII
- truncate large payloads
- store references to blobs when needed
See Redaction and Payload limits.
How do we prevent regressions when prompts change?
Use Evaluations and gate promotions with baselines:
- PR suite (small and fast)
- nightly suite (full and thorough)
See Run evals in CI.
What should we put in a dataset?
Representative examples that capture:
- real user intents
- edge cases (safety/policy/tool failures)
- multilingual segments (if applicable)
See Datasets.