Traces
15 min
the https //app kloudmate com/traces section in kloudmate gives you end to end visibility into how requests travel across your services you can explore trace data, including spans, events, and attributes, to detect errors, identify bottlenecks, and pinpoint issues at any point in a request’s lifecycle here’s what you can do in the traces section get a complete overview of all captured traces across your services search and filter traces using span attributes, http method, status, severity, and more save and reuse frequently used search queries analyze individual spans across four focused result views drill into trace details including events, attributes, timeline, and raw data correlate logs and examine service level interactions traces section walkthrough click on traces in the left navigation menu to open the traces section at the top of the page, you’ll see a span volume graph that visualizes trace activity over the selected time range the x axis represents time and the y axis shows the number of spans captured this graph gives you a quick pulse check on traffic patterns and helps spot anomalies before you dive into individual traces https //docs kloudmate com/sending data to kloudmate to learn more about how to send data to kloudmate searching and filtering search bar search across traces using span attributes click the search bar to see a list of available attributes click the filter icon on the right to open the full attribute picker active filters appear as tags in the search bar and can be removed individually sidebar filters use the left sidebar to filter results by service http method http status severity database name each filter section includes a search box for quick lookup when filters are active, a “showing recent filters” notice appears at the top of the sidebar saved queries click saved queries to view and apply any previously saved searches to save a new query, click the dropdown arrow next to the saved queries button and select add new , this saves your current search and filter configuration so you can reuse it anytime traces result views spans the spans tab is the default view it lists every individual span captured within the selected time range and active filters each row displays the timestamp , span name , services , duration , and error columns, giving you the most granular level of detail across your trace data this view is best for finding a specific operation, debugging a particular service, or scanning for anomalies across high volume traffic trace summary the trace summary tab groups spans into complete traces, giving you a higher level view of end to end request journeys rather than individual operations each row represents a single trace, showing its entry point , the number of services and spans involved , total duration , and any errors use this view to compare traces side by side, identify which requests are slowest, and understand overall request complexity across your services root spans the root spans tab filters the results to show only the first span in each trace , representing the entry point of a request into your system root spans are useful for understanding incoming request patterns and monitoring service entry point health without the noise of downstream child spans error spans the error spans tab filters the results to show only spans that contain errors, making it immediately clear where failures are occurring across your services when this tab is active, the span volume graph renders in red , making it easy to spot recurring error patterns or sudden error spikes before looking at individual rows the sidebar filter counts also scope down to only the services and attributes present in the error set any active search filters appear as removable tags in the search bar analyzing a trace in detail click on any row in the results table to open the full trace detail view trace summary timeline service graph trace summary panel breaks down all spans grouped by service, with a span count per service click the arrow next to any service to expand and browse individual spans within it the left panel of the trace detail view shows a service breakdown table listing every service involved in the trace alongside its % exec time — the percentage of the total trace duration attributed to that service a horizontal bar graph makes it easy to visually compare relative contribution at a glance services are color coded (matching the timeline at the bottom) so you can quickly cross reference which service is responsible for which spans timeline the timeline at the bottom of the trace detail view shows the full span hierarchy the left side displays the nested span tree with parent child relationships across services, and the right side shows each span as a horizontal bar scaled to the total execution time this makes it easy to identify sequential bottlenecks, parallel operations, and exactly where time is being spent within a request clicking on any span bar highlights the corresponding operation in the service graph and displays its details in the trace summary panel use the hide internal spans toggle to reduce noise and focus on cross service interactions service graph click service graph in the top right corner of any trace detail to switch the right panel to a visual topology of that trace each service is represented as a node, with directed edges showing the call path and edge labels indicating the number of calls between services use the zoom controls to navigate, or expand to full screen this view helps you quickly understand the full topology of a request, how many services were involved, in what order they were called, and which services branched into parallel calls investigate with k ai click investigate with k ai on any trace to get an instant ai powered analysis k ai reads the trace and returns a summary , key observations , and a verdict , telling you whether the trace needs attention and why this is the fastest way to triage a trace without manually reading through every span related resources https //docs kloudmate com/sending data to kloudmate https //docs kloudmate com/service map