Kernel-level observability for AI agents with AgentSight
ObservabilityComments
The claim about not needing an SDK might be oversimplified. TLS tracing typically requires access to session keys, which usually involves some level of user-space configuration or hooks into the SSL library.
If the tool relies on uprobes for TLS keys, would it still be considered SDK-less in a production environment where those hooks might be restricted by security policies?
If more people move to local LLM runners... this becomes way more interesting... since we can actually control the kernel on the host machine without fighting a cloud provider's restrictions!
Most managed AI platforms won't give you the kernel access required for eBPF. This limits the tool to self-hosted infrastructure or specific bare-metal setups.
The overhead concerns are valid, but the recent work on Perforator showed that continuous profiling via eBPF can be extremely efficient at scale. That suggests a kernel-level approach for AI agents could be viable without killing performance.
overhead shifts from cpu to memory when you have to store the mapping of kernel events to prompts.