blob: 46a6cd32c6711c8ba86f54b7a59679039c541d96 [file] [log] [blame]
Ryan Savitskia7dccea2022-05-10 22:21:47 +01001Unreleased:
Primiano Tucci2ab19f62020-07-01 21:28:31 +01002 Tracing service and probes:
Daniele Di Proietto173d60b2024-02-21 15:29:19 +00003 *
4 Trace Processor:
5 *
6 UI:
Primiano Tucci272ffb02024-03-12 20:03:10 +00007 * Per-cpu scheduling tracks now distinguish real-time priority threads with
8 a hatched pattern and name prefix. Based on priority during switch-in.
Daniele Di Proietto173d60b2024-02-21 15:29:19 +00009 SDK:
10 *
11
12
Daniele Di Proiettof9543642024-03-07 17:18:41 +000013v43.2 - 2024-03-07:
14 UI:
15 * Added redirection to pinned UI version when using
16 `trace_processor_shell --httpd` and pinned version is available.
17
18
Daniele Di Proietto78cf90e2024-03-05 17:03:03 +000019v43.1 - 2024-03-05:
20 Tracing service and probes:
21 * Cherry-pick of https://r.android.com/2988674, which fixes the android x86
22 standalone build.
23
24
Daniele Di Proietto173d60b2024-02-21 15:29:19 +000025v43.0 - 2024-03-05:
26 Tracing service and probes:
27 * Buffers marked as `transfer_on_clone` will be flushed independently when
28 cloning.
29 * ftrace: added drain_buffer_percent option to read kernel ring buffer
30 based on occupancy in addition to existing periodic reads. Requires Linux
31 kernel v6.1+.
32 * ftrace: changed default kernel per-cpu ring buffer sizes if a config
33 doesn't request an explicit size via buffer_size_kb. Added
34 buffer_size_lower_bound option that lets the service choose a bigger ring
35 buffer size than requested.
Ryan Savitski39108cf2024-03-04 13:40:56 +000036 * "linux.process_stats" data source: added options to record: process age,
37 time spent running in userspace, and time spent running in kernel mode,
38 using /proc/pid/stat. See "record_process_age" and
39 "record_process_runtime" options.
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000040 Trace Processor:
Daniele Di Proietto173d60b2024-02-21 15:29:19 +000041 * Added `decompress_packets` mode to the traceconv tool.
Daniele Di Proietto956b18d2024-02-26 17:24:00 +000042 * Support memory mapped file access on Windows.
Daniele Di Proietto173d60b2024-02-21 15:29:19 +000043 * Deprecated `common` standard library module, it will be removed by v45.
44 Some of the functionality have been migrated to other parts of standard
45 library.
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000046 UI:
Daniele Di Proietto173d60b2024-02-21 15:29:19 +000047 * Added a "defaultPlugins" list to allow control over which plugins are
48 enabled by default.
49 * Added a feature to allow enabling/disabling plugins permanently from the
50 plugins page.
51 * Added plugin load times to the plugin page.
52 * Added scrolling to the pinned track area.
53 * Added commands for expanding and closing all tracks.
54 * Added {expand,collapse}GroupsByPredicate to plugin API.
55 * Added SimpleSliceTrack & SimpleCounterTrack which have the same
56 functionality of debug tracks but may be added on trace load from within
57 plugins.
58 * Added naive track crash containment, which means tracks that crash should
59 not crash the entire UI.
60 * Don't render "idle" kernel thread slices in thread state tracks.
61 * Fixed crash when using autofill in text inputs in chrome.
62 * Fixed bug where "incomplete" slices were sometimes not rendered.
63 * Fixed crash when calls to CacheStorage fail via promise rejection.
64 * Fixed bug causing slices to occasionally disappear in tracks v2.
65 * Fixes crash in tracksV2 when visible window is negative.
66 * Fix bug when toggling the sidebar without a trace loaded would either
67 crash the UI or simply not work.
68 * Various TabsV2 QoL improvements.
69 * Various AndroidLongBatteryTracing plugin improvements.
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000070
71
72v42.0 - 2024-02-02:
73 Tracing service and probes:
Ryan Savitski983f90b2024-01-16 16:10:59 +000074 * Linux/Android: kernel scheduling data (sched_switch and sched_waking
75 ftrace events) is now serialised in a more compact format by default
76 (previously required setting ftrace_config.compact_sched.enabled).
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +000077 UI:
Primiano Tucci77c4ccd2024-01-16 16:33:14 +000078 * Added "Realtime (Trace TZ)" timestamp formatting option to see timestamps
79 in the local time of the traced device. It requires recent versions of the
80 tracing service which set the system_info.timezone_off_mins field.
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000081 * Added tab support to the plugin API.
82 * Added a plugin to improve visualization of Android power traces containing
83 ODPM (on-device power rail monitor) data.
84 * Added support to attach the UI via ?rpc_port=1234 to multiple instances of
85 trace_processor --httpd --http-port=1234 (see UI docs).
86 * Fixed OOM detection message on in-memory tables.
87 * Fixed rendering of events at the every beginning and end of the trace.
88 * Fixed rendering of low density slices.
89 * Fixed bug in filterVisibleSlices (Thanks to Liangliang Sui).
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +000090 SDK:
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000091 * Fixed a bug that would cause DataSource::OnStop to be called twice upon
92 service disconnection with HandleStopAsynchronously().
93 * Fixed a long standing bug that caused the last TracePacket for every
94 sequence to be lost during scraping, for data sources that do not support
95 flushing. The fix works with old versions of the tracing service.
Lalit Magantie7b5ffb2024-01-02 17:10:27 +000096
97
Daniele Di Proietto81bf7ab2024-02-01 13:32:57 +000098v41.0 - 2024-01-11:
Lalit Magantie7b5ffb2024-01-02 17:10:27 +000099 Tracing service and probes:
100 * Added support for ADB_SERVER_SOCKET in the websocket bridge.
101 * Added support for reading Pressure Stall Information (PSI) from the kernel.
102 Trace Processor:
103 * Added capability to control trace processor using stdin/stdout when using
104 shell binary. This acts as a simpler alternative to the existing HTTP
105 control API.
106 * Fixed multiple edge-case issues in RestoreInitialTables.
107 SDK:
Daniele Di Proietto01080e92023-12-01 18:59:14 +0000108 * Fixed a long standing bug that caused the last TrackEvent event for each
109 thread to be lost during scraping. The fix works with old versions of the
110 tracing service.
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +0000111
112
Lalit Maganti7514a692023-12-05 12:01:02 +0000113v40.0 - 2023-12-04:
114 Tracing service and probes:
115 * Added support for collecting battery voltage from the Android Power HAL.
116 * Added support for emitting machine id from producers on remote hosts.
117 Trace Processor:
118 * Added of flow id from trace as a column in the flow table.
119 * Fixed computation of trace_bounds table when using UI native acceleration.
120 UI:
121 * Switched to use "v2" querying and rendering system for tracks by default.
122
123
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +0000124v39.0 - 2023-11-15:
125 Tracing service and probes:
Primiano Tuccife6137c2023-10-17 12:06:34 +0100126 * Added reporting of TZ offset under system_info.timezone_off_mins .
Primiano Tucci89eb3242023-10-31 16:13:04 +0000127 * Added no_flush option to DataSourceDescriptor to avoid unnecessary IPC
128 roundtrips to flush data sources like track_event that rely uniquely on
129 server-side scraping.
Primiano Tucci0b3de742023-11-09 22:55:33 +0000130 * Added support for running on Linux & Android systems configured with 16K
131 pagetables.
Daniele Di Proietto2789b5b2023-04-14 09:53:03 +0000132 Trace Processor:
Lalit Maganti7514a692023-12-05 12:01:02 +0000133 * Added android_boot metric.
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +0000134 * Added new PerfettoSQL syntax (CREATE PERFETTO VIEW) for adding schemas to views.
Lalit Maganti7514a692023-12-05 12:01:02 +0000135 * Added support for the perf.data import format.
136 * Added dvfs and cpu_idle to stdlib.
Hector Dearman73bb5e22023-05-02 16:38:29 +0100137 UI:
Lalit Maganti7514a692023-12-05 12:01:02 +0000138 * Added a new type of debug tracks: counter.
Daniele Di Proietto5b5ae0b2023-11-15 16:16:28 +0000139 * Improved visualization of timestamps for durations.
Hector Dearman73bb5e22023-05-02 16:38:29 +0100140
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100141
Lalit Magantib6177832023-10-09 18:43:03 +0100142v38.0 - 2023-10-10:
143 Tracing service and probes:
144 * Added capability to transfer and clear buffers on CLONE_SNAPSHOT.
145 * Added new service for relaying IPC messages from local producers to a
146 remote tracing instance.
147 Trace Processor:
148 * Added new PerfettoSQL syntax (INCLUDE PERFETTO MODULE) for including
149 tables/views/functions defined in SQL modules.
150 * Added new PerfettoSQL syntax (CREATE PERFETTO TABLE) for defining analytic
151 tables in SQL.
152 * Added new PerfettoSQL syntax (CREATE PERFETTO MACRO) for defining macros
153 in SQL.
154 * Added TO_REALTIME function to convert timestamps to the realtime clock.
155 * Added support for parsing binder_command and binder_return events.
156 UI:
157 * Added support for zooming when using deep-links.
158 * Added track for displaying screenshots in traces.
159 * Added support for displaying UTC timestamps.
160 * Added capability to list, search and debug plugin tracks.
161 * Added plugins with commands for pinning tracks for latency and large
162 screen debugging in Android.
163
164
Daniele Di Proiettod2482cf2023-08-10 13:55:01 +0000165v37.0 - 2023-08-10:
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100166 Tracing service and probes:
167 * Fixed a bug which would cause sessions cloned with CLONE_SNAPSHOT to not
168 inherit the trace filtering config.
169 * Fixed a bug that would cause flushes to be acked prematurely in
170 traced_probes if the android.package_list data source is present.
Daniele Di Proiettod2482cf2023-08-10 13:55:01 +0000171 SDK:
172 * Fix build with MSVC.
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100173 UI:
174 * Added command palette (CTRL/Meta+Shift+P).
175 * Added grouping of global tracks into groups to reduce visual pollution.
176 * Added ability to toggle timestamps between trace / boot / wall time.
177 * Added recording UI for callstack sampler.
178 * Added "Viz" page to run chart query results with Vega-Lite.
179 * Highlight debuggable apps, which might have worse performance
180 characteristics, with a chip on the corresponding tracks.
181 Misc:
182 * master -> main branch migration. HEAD is now main, master is for now a
183 mirror and will become a stale frozen snapshot.
184
Daniele Di Proiettod2482cf2023-08-10 13:55:01 +0000185
Harkiran Bolaria8c8b0a82023-07-06 14:26:13 +0000186v36.1 - 2023-07-06:
187 Trace Processor:
188 * Fix compile on Windows.
189
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100190
Lalit Maganti72dc31f2023-07-05 17:19:42 +0100191v36.0 - 2023-07-05:
192 Tracing service and probes:
193 * Fixed unnecessary reads of thread files /proc when scraping process names.
194 Trace Processor:
195 * Rewrote filtering engine to be significantly faster on a wide range of
196 common queries.
197 * Significantly improved quality of PerfettoSQL error messages.
198 * Added API to retrieve last executed statement from iterator.
199 * Added support for filtering rows by a regex.
200 UI:
201 * Fixed flow events working for async tracks.
202 * Added table viewer for slice-like tables.
203 SDK:
204 * Reduce binary size impact of macro and template expansions.
205
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100206
Hector Dearmana0413512023-06-07 21:22:26 +0100207v35.0 - 2023-06-07:
208 Tracing service and probes:
209 * Compression has been moved from perfetto_cmd to traced. Now compression is
210 supported even with write_into_file. The `compress_from_cli` config option
211 can be used to restore the old behavior.
212 * Changed the android.statsd datasource to batch multiple atoms into
213 a single trace packet. This improves performance and information
214 density.
215 Trace Processor:
216 * Fixed protozero parsing code to support field ids larger than
217 2^16 - 1. protozero now supports field ids up to 1,000,000
218 See https://github.com/google/perfetto/issues/510.
219 UI:
220 * Add support for deep links into the UI via query parameters.
221 * Fixed multiple issues around the display of track event log
222 messages See https://github.com/google/perfetto/issues/507.
223
224
Hector Dearman73bb5e22023-05-02 16:38:29 +0100225v34.0 - 2023-05-02:
226 Tracing service and probes:
Daniele Di Proietto89111ad2023-03-14 11:57:01 +0000227 * --continuous-dump in tools/java_heap_dump now keeps recording until it
228 receives CTRL+C.
Primiano Tucci8146d0b2023-05-02 21:56:49 +0100229 * Add CLONE_SNAPSHOT triggers for non-destructive snapshots of the trace
230 buffer without tracing interruption.
Daniele Di Proiettoc24118a2023-02-01 13:49:41 +0000231 UI:
Hector Dearman73bb5e22023-05-02 16:38:29 +0100232 * Add support for parsing large integers from Trace Processor into
233 bigint. This is the default behaviour for unknown fields and can
234 be enabled specifically via the LONG and LONG_NULL column types.
Daniele Di Proiettoc24118a2023-02-01 13:49:41 +0000235 SDK:
Hector Dearman2f174a52023-03-21 15:21:54 +0000236 * Changed the type of the static constexpr metadata on protozero
237 generated bindings from a function returning the metadata to
238 metadata itself. For a field 'foo' the variable kFoo previously
239 defined as:
240 `static constexpr FieldMetadata_Foo kFoo() = { return {}; };`
241 it is now defined as:
242 `static constexpr FieldMetadata_Foo kFoo;`
243 This is a breaking change for users who directly access field
244 metadata.
Daniele Di Proietto93a232a2023-04-17 10:03:08 +0000245 * The new DataSourceBase::OnFlush() method allows users to properly handle
246 Flush requests.
Lalit Maganti51eba122023-03-02 13:52:08 +0000247
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100248
Hector Dearman320af652023-05-02 17:20:52 +0100249v33.1 - 2023-03-03:
250 Identical to v33.0. Version was bumped to work around prebuilt infra failures.
251
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100252
Lalit Maganti51eba122023-03-02 13:52:08 +0000253v33.0 - 2023-03-02:
254 All:
255 * Switched to a C++17-only project by removing C++11 opt-out. This completes
256 the migration started in v31.0.
257 SDK:
Daniele Di Proietto73c07ed2023-02-17 15:04:31 +0000258 * Tracing::Initialize() can be called more than once to initialize different
259 backends separately.
Lalit Maganti51eba122023-03-02 13:52:08 +0000260 * Reduce binary size impact of autogenerated code.
Daniele Di Proiettoc24118a2023-02-01 13:49:41 +0000261
Primiano Tucci5b044cc2023-08-10 18:33:14 +0100262
Daniele Di Proietto722ff232023-02-13 17:04:42 +0000263v32.2 - 2023-02-16:
264 SDK:
265 * Fix MSVC warnings.
266
267
Daniele Di Proietto5df28fc2023-02-01 15:42:18 +0000268v32.1 - 2023-02-01:
269 Trace Processor:
270 * Fix build on windows.
271
272
Daniele Di Proietto9eccbc42023-02-01 13:55:40 +0000273v32.0 - 2023-02-01:
Daniele Di Proiettoc24118a2023-02-01 13:49:41 +0000274 Tracing service and probes:
Primiano Tucci7c327c22022-11-23 12:24:49 +0000275 * Added an explicit TraceUuid packet. The tracing service now always
276 generates a UUID, even if TraceConfig.trace_uuid_msb/lsb is empty.
Primiano Tucci0a357422022-08-02 16:19:23 +0100277 Trace Processor:
Lalit Maganti966175c2022-10-05 18:20:52 +0100278 *
Primiano Tucci0a357422022-08-02 16:19:23 +0100279 UI:
280 *
281 SDK:
Daniele Di Proietto55fd4db2022-11-15 13:44:14 +0000282 * Add perfetto::Tracing::ActivateTriggers() function.
Sami Kyöstilä6020a922023-01-17 16:18:33 +1100283 * Made it possible to declare track event categories in a C++ namespace
284 with PERFETTO_DEFINE_CATEGORIES_IN_NAMESPACE, allowing multiple category
285 sets to be used in one same translation unit. Correspondingly, the
286 PERFETTO_COMPONENT_EXPORT and PERFETTO_TRACK_EVENT_NAMESPACE macros have
287 been deprecated in favor of this new functionality.
288 * Deprecated the PERFETTO_COMPONENT_EXPORT macro in favor of
289 PERFETTO_DEFINE_CATEGORIES_IN_NAMESPACE_WITH_ATTRS.
Daniele Di Proietto04073f62022-12-14 13:20:10 +0000290 * Added TracingInitArgs::enable_system_consumer configuration option, that
291 allows the linker to discard the consumer IPC, if not required.
Lalit Maganti9a32c282022-09-01 14:25:34 +0100292
Lalit Maganti02076452022-10-05 18:24:06 +0100293
Lalit Maganti2ed57ec2022-11-09 21:10:38 +0000294v31.0 - 2022-11-10:
295 Tracing service and probes:
296 * Added support for collecting Android Trusty ftrace events.
297 * Fixed resetting syscall filter when recording selected syscalls.
298 Trace Processor:
299 * Improved error messages on SQL syntax errors.
300 * Improved performance of queries containing GLOB. Handling of GLOB
301 constraints now happens inside trace processor instead of SQLite.
302 * Added support for parsing Android Trusty ftrace events.
303 UI:
304 * Added support for metatracing UI code and integrate with trace processor
305 metatracing.
306 * Added support for scrolling to a time region using the postMessage API.
307 * Enabled Pivot table functionality by default.
308 * Fixed downloading of Java heap profiles.
309 SDK:
310 * Switched to require C++17 by default. A time-limited opt-out exists but
311 is planned to be removed in v34. Please contact us at
312 perfetto-dev@googlegroups.com if you have thoughts or concerns on this
313 move.
314
315
Lalit Maganti966175c2022-10-05 18:20:52 +0100316v30.0 - 2022-10-06:
317 Trace Processor:
318 * Fixed parsing of "R+" (preempted) and "I" (idle kernel thread) end states
319 of sched_switch events, collected on Linux kernels v4.14 and above.
320 Previously, preemption was not recognised, and idle was reported as
321 "x" (task dead). See commit c60a630cfe0.
322 * Add support for parsing sys_write syscalls.
323 * Remove the thread_slice table: all columns have moved to the slice table
324 and thread_slice exists as a view for backwards compatibility. This view
325 will also be removed in the future
326 * Add Base64 encode SQL function.
327 * Add support for importing function graph ftrace events.
328 * Add support for importing V4L2 ftrace events.
329 * Add support for importing virtio-video ftrace events.
330 UI:
331 * Fix downloading profiles from flamegraphs.
332 * Enable Pivot table support by default.
333 SDK:
Lalit Maganti02076452022-10-05 18:24:06 +0100334 * Add support for disallowing concurrent tracing sessions.
335
Lalit Maganti966175c2022-10-05 18:20:52 +0100336
Lalit Magantief0f60b2022-09-06 18:32:29 +0100337v29.0 - 2022-09-06:
Lalit Maganti9a32c282022-09-01 14:25:34 +0100338 Tracing service and probes:
339 * Add support for only tracing selected syscalls. By selecting only syscalls
340 of interest, usage of the trace buffer and performance impact on device
341 is reduced.
Lalit Magantief0f60b2022-09-06 18:32:29 +0100342 * Add support for parsing DSI ftrace events.
Lalit Maganti9a32c282022-09-01 14:25:34 +0100343 Trace Processor:
344 * Make calling NotifyEndOfFile more than once an error: this was deprecated
345 in v28. Flush should be used instead for all by the final call.
346 * Add parsing and ingestion for V4L2 events.
Lalit Magantief0f60b2022-09-06 18:32:29 +0100347 * Upgraded SQLite to 3.39.2.
Lalit Maganti9a32c282022-09-01 14:25:34 +0100348 UI:
349 * Add support for searching Android log events.
350 * Group kernel wakelock tracks into a single track group.
351 SDK:
Mohit Saini4c8dedf2022-08-02 18:16:28 +0100352 * Added support for startup tracing. Tracing can be started in an app
353 before it connects to the tracing service.
354 The data sources which are started for startup tracing, will
355 be automatically adopted to normal tracing session once we start
356 normal tracing session.
Lalit Maganti9a32c282022-09-01 14:25:34 +0100357 * Added the |first_packet_on_sequence| boolean which is set the first packet
358 emitted on each TraceWriter.
Primiano Tucci0a357422022-08-02 16:19:23 +0100359
360
361v28.0 - 2022-08-02:
362 Tracing service and probes:
Hector Dearman09db5b02022-07-11 13:35:23 +0100363 * Add android.statsd datasource.
Primiano Tucci4681b9e2022-07-21 15:05:37 +0100364 * Removed log spam about sys.trace.traced_started in standalone builds.
Primiano Tuccibf7d4902022-07-25 21:39:38 +0100365 * Changed kallsyms parsing in traced_probes (ftrace) to be always
366 synchronous (when starting the trace, rather than on the first batch).
367 * Added ksyms_mem_policy = KSYMS_RETAIN_FOREVER config to avoid destroying
368 and re-parsing kallsysm repeatedly in benchmark runs.
Daniele Di Proiettofe9023f2022-07-19 15:33:28 +0100369 * Improve heap profiling shutdown: now the shared memory buffer where
370 alloc/free records are stored is properly flushed when stopping the data
371 source.
Primiano Tucci0a357422022-08-02 16:19:23 +0100372 * Fixed race condition in the daemonization path of perfetto --background.
373 It would cause daemonization failures if the TTY is destroyed immediately.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100374 Trace Processor:
Anna Mayznerc7548882022-07-20 08:42:26 +0000375 * Deprecate calling NotifyEndOfFile more than once: Flush should instead be
376 used for all but the final call.
Primiano Tucci0a357422022-08-02 16:19:23 +0100377 * Added ingestion and visualization of I2C transactions.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100378 UI:
Primiano Tucci2ed5d3d2022-08-02 16:33:20 +0100379 * Changed callstack sampling selection: selecting one sample now only shows
380 one stacktrace, selecting multiple samples shows the aggregation.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100381 SDK:
Primiano Tucci94e94bb2022-07-26 20:19:30 +0100382 * Fixed a bug (b/239725760) that would cause abstract sockets using the
383 "@name" syntax in PERFETTO_CONSUMER_SOCK_NAME/PERFETTO_PRODUCER_SOCK_NAME
384 to have a trailing \0 in the socket name. This breaks interoperability
385 with adb forwarding. This is a tracing protocol breaking change. Nobody
386 seems to be relying on @abstract syntax across different versions of
387 client vs service.
Alexander Timin762b30b2022-08-01 16:40:56 +0000388 * Changed the mangling scheme for protozero enums nested in another message:
389 instead of OuterClass_Enum_VALUE, the enum values will be just named
390 VALUE with the enum itself wrapped in a perfetto_pbzero_enum_OuterClass
391 namespace to prevent naming collisions. This will allow the users
392 to alias the enum directly and use throughout their code.
393 The exact name mangling scheme is a carry-over from libprotobuf and
394 an internal implementation detail, so nobody should be relying on that.
Primiano Tucci0a357422022-08-02 16:19:23 +0100395 * Added protozero::EnumToString() to convert enum keys to string literals.
396
Primiano Tucci37a30c72022-06-13 14:37:50 +0100397
Lalit Magantibed4b812022-07-14 13:48:41 +0100398v27.1 - 2022-07-11:
399 SDK:
400 * Added an API for shutting down Perfetto.
401
402
Lalit Maganti3b522bc2022-07-01 15:16:23 +0100403v27.0 - 2022-07-01:
404 Tracing service and probes:
405 * Fix rare crash due to watchdog timeout being too short.
406 Trace Processor:
407 * Removed enable_perfetto_x64_cpu_opt by default for x64 MacOS
408 since it caused issues for CIs.
409 * Improved performance of filtering and sorting on most queries.
410 UI:
411 * Changed sorting of process groups to take slice count and presence of
412 perf profiles into account.
413 SDK:
414 *
415
416
Lalit Maganticf781522022-06-13 17:13:25 +0100417v26.1 - 2022-06-13:
418 Trace Processor:
419 * Fixed build failures on Windows.
420
421
Primiano Tucci37a30c72022-06-13 14:37:50 +0100422v26.0 - 2022-06-13:
423 Tracing service and probes:
Ryan Savitskia7dccea2022-05-10 22:21:47 +0100424 * Added wildcard (*) support when targeting processes by their command line
425 in the Android perf profiler ("linux.perf" data source) and Java heap
426 snapshots ("android.java_hprof").
427 * Added support for kernel thread sampling, and kernel-only callstacks in
428 the Android perf profiler.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100429 * Fixed rare crash when parsing zero-length ftrace __data_loc strings.
430 * Fixed rare crash on 4.19 kernel when encountering unexpected zero-padded
431 ftrace pages.
432 * Removed capturing of thread_time_in_state (per-UID, per-OOM-adj time).
433 The data was unused and subsumed by correlating sched data with power
434 rail monitors.
Primiano Tucci1c889432022-04-01 18:14:29 +0100435 Trace Processor:
Primiano Tucci37a30c72022-06-13 14:37:50 +0100436 * Added CREATE_VIEW_FUNCTION operator to define a SQL function that can
437 return a temporary table and yield multiple rows and columns.
Ryan Savitskia7dccea2022-05-10 22:21:47 +0100438 * Changed kernel threads to be represented as single-thread processes in
439 Linux system traces. The (incorrect) legacy behaviour was to treat them
440 as threads of the kthreadd process.
Hector Dearman6e4241d2022-05-07 22:37:34 +0100441 * Added ABS_TIME_STR function which converts a trace timestamp to
442 an ISO8601 string.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100443 * Added ingestion for phase='R' events, used by performance.{now,mark}().
Hector Dearmana9545e52022-05-17 12:23:25 +0100444 * Changed 'trace_to_text' to be named 'traceconv'. The source
445 location also moved from 'tools/trace_to_text' to 'src/traceconv'.
Primiano Tucci682a9982022-05-20 17:13:28 +0100446 * Changed compiler flags, added -mavx2. The previous patch in v22.0 was
447 supposed to add AVX2 support but added only AVX.
Primiano Tucci37a30c72022-06-13 14:37:50 +0100448 * Changed the handling of the last per-cpu sched slices: rather than
449 extending the last event to the end of the trace, the last scheduling
450 event has a -1 duration. UIs are supposed to deal with visual extension.
451 * Removed android_thread_time_in_state metric. It was an experiment and was
452 unused.
453 * Removed `instant` table. All instant events are now 0-duration events in
454 the `slice` table.
455 * Removed the /raw_query REST endpoint from --httpd. This will break very
456 old clients that have not switched over the new streaming-based /query
457 endoint or even newer /websocket.
Primiano Tucci1c889432022-04-01 18:14:29 +0100458 UI:
Primiano Tucci37a30c72022-06-13 14:37:50 +0100459 * Changed detail panel to separate slice args from generic slice properties.
460 * Automatically enabled sched_compact when generating trace configs for
461 Android S+ targets.
Primiano Tucci1c889432022-04-01 18:14:29 +0100462 SDK:
Primiano Tucci37a30c72022-06-13 14:37:50 +0100463 * Added option for recording thread CPU times at the beginning and end of
464 each slice.
465 * Added perfetto::DynamicString() to use non-literal strings as event names
466 in the TRACE_EVENT API.
467 * Remove the pre-SDK consumer_api_deprecated interface. It was introduced
468 for iorapd, now deleted from the Android tree.
Primiano Tucci1c889432022-04-01 18:14:29 +0100469
470
471v25.0 - 2022-04-01:
472 Tracing service and probes:
Primiano Tucci06dab692022-03-15 15:32:33 +0000473 * Added prebuilts for mac-arm64.
Lalit Maganti8d6d7c12022-02-24 20:35:23 +0000474 * Removed merged trace and config protos from Bazel. Embedder should
475 instead depend on the non-merged proto targets.
Ryan Savitski3167ea02022-03-21 20:26:36 +0000476 * Added FtraceConfig.disable_generic_events. If set, the ftrace data source
477 will not emit events for which it doesn't have a compile-time proto
478 message.
Primiano Tucci1c889432022-04-01 18:14:29 +0100479 * Added ingestion support for cros_ec (CrOS sensors) ftrace events.
480 * Added ingestion support for kvm trace events.
481 * Added reporting of atrace failures. Now they are bubbled up to the UI
482 rather than causing atrace data to be silently missing.
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000483 Trace Processor:
Primiano Tucci06dab692022-03-15 15:32:33 +0000484 * Added prebuilts for mac-arm64.
Lalit Maganti68e649c2022-03-31 00:01:31 +0100485 * Changed LIKE comparisions to be case-insenstive. This reverts the change
486 introduced in v22. GLOB should be used where case senstive searches are
487 desired; built-in metrics continue to require the use of GLOB.
Ryan Savitskie65c4052022-03-24 18:22:19 +0000488 * Added an optional dependency from trace processor onto a subset of
489 sources from llvm-project for function name demangling. Bazel embedders
490 might need to update their PERFETTO_CONFIG in perfetto_cfg.bzl to opt in
491 or out of the new dependency. See
492 perfetto/bazel/standalone/perfetto_cfg.bzl for details.
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000493 UI:
Lalit Maganti6b515622022-02-15 14:42:18 +0000494 * Added flow arrows between binder transaction pairs (request/reply
495 and async send/async recv).
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000496 SDK:
Alexander Timin94204c62022-03-14 16:57:32 +0000497 * Added support for writing typed proto messages inside DebugAnnotations.
Mohit Saini5a7403c2022-03-14 18:24:43 +0000498 * Added support for delta encoding of timestamps for TrackEvents.
499 To disable it, refer to `disable_incremental_timestamps` flag in
500 `track_event_config.proto`.
Primiano Tucci1c889432022-04-01 18:14:29 +0100501 Tools:
502 * Added support of gzip-compressed traces to traceconv.
503 * Changed `traceconv text` to use an internal proto->pbtx converter rather
504 than relying on libprotobuf. It could cause some small divergencies in the
505 output format vs past releases.
506 * Added tools/cpu_profile helper script to capture traces with callstack
507 samples.
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000508
509
Primiano Tuccid5184022022-02-10 16:41:56 +0000510v24.2 - 2022-02-10:
511 SDK:
512 * Revert of incremental timestamps, introduced in v24.0.
513 Some clients were depending on non-incremental timestamps.
514 Future releases will re-enable this but offer an opt-out.
515
516
Primiano Tuccid59e9de2022-02-09 10:42:14 +0000517v24.1 - 2022-02-09:
518 Tracing service and probes:
519 * Fixed build failures on Windows.
520 Trace Processor:
521 * Fixed build failures on Windows.
Primiano Tuccid59e9de2022-02-09 10:42:14 +0000522
523
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000524v24.0 - 2022-02-08:
525 Tracing service and probes:
526 * Added "cpufreq_period_ms" in data source "linux.sys_stats" to poll
527 /sys/devices/system/cpu/cpu*/cpufreq/scaling_cur_freq periodically.
528 * Added support for Trusty TEE workqueue events.
529 * Added support for more PMU events in traced_perf.
Primiano Tucci24df3232022-01-26 19:15:17 +0000530 * Changed output format of perfetto --query. Made the output more compact
531 and added a summary of ongoing tracing sessions for the caller UID.
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000532 * Changed timeout for traced stall detection from 2s to 4s.
533 * Changed internal buffer management to split trace filtering in smaller
534 tasks and avoid too large memory allocation when filtering.
535 * Fixed a bug that could cause producers to see Flush() requests after an
536 OnStop() and mis-behave if the tracing session is extremely short.
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000537 Trace Processor:
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000538 * Added support for passing multiple SQL statements to ExecuteQuery(). All
539 queries will be executed fully, with the returned iterator yielding rows
540 for the final statement.
541 * Added support for multi-line SQL comments; previously only single line
Lalit Maganti95465982022-01-27 22:41:15 +0000542 comments were supported.
Primiano Tucci4f997ef2022-01-11 20:22:47 +0000543 UI:
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000544 * Added support for parsing instant events from legacy systrace formats.
545 * Added ingestion and visualization for inet_sock_set_state and
546 tcp_retransmit_skb events, showing TCP connections on dedicated tracks.
Primiano Tucci2b2236f2022-01-28 10:50:43 +0000547 * Changed HTTP+RPC to use the /websocket endpoint available in newer
548 versions of trace_processor --httpd.
Primiano Tuccife6c2e32022-02-08 20:59:11 +0000549 * Changed text selection/copy: now allowed by default for DOM elements.
550 * Changed search to also lookup slices by ID when the term is a number.
551 * Changed postMessage() API, suppressed confirmation dialog when the opener
552 is in the same origin, for cases when the UI is self-hosted.
Primiano Tucci4f997ef2022-01-11 20:22:47 +0000553 SDK:
Primiano Tuccid5184022022-02-10 16:41:56 +0000554 * Changed timestamps emitted by the SDK to be incremental by default, using
555 ClockSnapshot + TracePacketDefaults.
Primiano Tucci4f997ef2022-01-11 20:22:47 +0000556
557
558v23.0 - 2022-01-11:
559 Tracing service and probes:
560 * Added workaround for a kernel ftrace bug causing some "comm" fields to be
561 not null-terminated. https://github.com/torvalds/linux/commit/f0a5157803 .
562 * Added ability to talk to the newer AIDL-based health hal in traced_probes.
563 It still falls back on the older HIDL interface for older devices.
564 Trace Processor:
Primiano Tucci1d518b42022-01-11 19:09:45 +0000565 * Changed the argument for the trace path in constructor of TraceProcessor
566 in the Python API from |file_path| to |trace|.
Lalit Maganticb8e0ff2022-01-11 15:36:37 +0000567 |file_path| is deprecated and may be removed in the future.
Primiano Tucci1d518b42022-01-11 19:09:45 +0000568 * Changed the Python API constructor. Now it takes a TraceProcessorConfig
Lalit Maganticb8e0ff2022-01-11 15:36:37 +0000569 instead of passing parameters directly. This may break existing code
570 but migration should be trivial (all current options are still
571 supported).
Primiano Tucci1d518b42022-01-11 19:09:45 +0000572 * Fixed a HTTP keepalive bug in trace_processor --httpd. The bug, introduced
573 in v22.0, caused each RPC request to close the connection, effectively
574 defeating the 'Connection: Keep-Alive', after each query made by the UI.
Primiano Tucci4f997ef2022-01-11 20:22:47 +0000575 * Added parsing of netif_receive_skb events from proto traces.
576 * Added android_netperf metric based on netif events.
577 * Fixed a bug that would cause fetch errors when loading traces > 32 MB when
578 using trace_processor --httpd.
579 * Added a workaround to tokenize properly /proc/pid/cmdline for chrome
580 processes on Linux/CrOS. Chrome rewrites its cmdline replacing \0 -> ' '.
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000581 UI:
582 *
583 SDK:
584 *
585
586
Primiano Tucci26e2acb2021-12-07 20:27:53 +0000587v22.1 - 2021-12-07:
588 Tracing service and probes:
589 * Added workaround for a Linux kernel bug causing some ftrace strings to
590 be non-null-terminated (https://github.com/torvalds/linux/commit/f0a5157).
591 Trace Processor:
592 * Fixed build failures on Windows.
593
594
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000595v22.0 - 2021-12-03:
596 Tracing service and probes:
Lalit Maganti7030e782021-11-08 13:12:42 +0000597 * Added Android SDK version to the SystemInfo trace packet.
Primiano Tucci2277f062021-11-08 22:24:05 +0000598 * Changed compiler flags. Assume recent x64 CPUs (-msse4.2 -mavx -mpopcnt).
599 This behavior affects only standalone builds and can be changed by setting
600 enable_perfetto_x64_cpu_opt=false in the GN args.
Daniele Di Proietto4d9665b2021-11-24 18:25:46 +0000601 * The java heap profiler now rescans all the processes every time for
602 continous_dump_config. The scan_pids_only_on_start can be used to restore
603 the old behavior.
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000604 * Added support for building on ARM Macs.
605 * Added support for the rss_stat_throttled event on Android via
606 FtraceConfig.throttle_rss_stat. In newer Android kernels the base rss_stat
607 event is now unthrottled. rss_stat used to be throttled by a downstream
608 kernel change, unnecessary after https://lkml.org/lkml/2021/10/25/1411 .
609 atrace.rc configures throttling from userspace at boot.
610 * Fixed a bug that caused IPCs to stall traced and hit the watchdog if in
611 the middle of a suspend/resume. Switched from SND_TIMEO to poll(POLLOUT).
612 * Added "linux.sysfs_power" data source to poll /sys/class/power_supply/
613 and report periodically battery charge and drain rate if supported.
Lalit Maganti33928bc2022-01-27 17:30:08 +0000614 * Add snapshotting for non-BOOTTIME ftrace clocks. This fixes handling of
615 ftrace events from old Linux kernel versions (i.e. 3.x) and adds
616 proper support for using the "global" clock rather than "boot".
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100617 Trace Processor:
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000618 * Speeded up proto trace ingestion by 2x (~20 MB/s -> ~40 MB/s).
Lalit Maganti1cf65eb2021-11-10 16:13:48 +0000619 * Changed LIKE comparisions to be case-senstive. This may break existing
620 queries but was a necessary from a performance perspective.
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000621 Going forward, GLOB must be used, instead of LIKE, for checked in metrics
622 to avoid unnecessary slowdowns.
Primiano Tucci2277f062021-11-08 22:24:05 +0000623 * Changed compiler flags, assume recent x64 CPUs (see above).
Hector Dearmanee80bcb2021-11-30 13:51:30 +0000624 * Changed how displayTimeUnit is handled in JSON traces to match catapult.
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000625 * Added websocket endpoint to RPC interface to reduce query latency.
626 * Added support for hot-reloading metrics (see //docs/analysis/metrics.md).
Lalit Maganti33928bc2022-01-27 17:30:08 +0000627 * Added ingestion support for non-BOOTTIME ftrace clocks.
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100628 UI:
Primiano Tuccie9e81c02021-12-03 18:02:58 +0000629 * Added ability to save/restore record config. Remember last used config.
630 * Fixed bug causing the recording page to hold onto the USB interface making
631 adb unusable after a recording session.
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100632 SDK:
Primiano Tucci360f0232021-11-04 13:41:08 +0000633 * Added UpdateDataSource() descriptor IPC endpoint to allow updates of the
634 data source capabilities (e.g., category list for track event).
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100635
636
Primiano Tucciea727872021-11-02 21:42:05 +0000637v21.0 - 2021-11-01:
638 Tracing service and probes:
639 * Added reporting of last 8 PERFETTO_LOG() entries and crash keys to
640 crash tombstones on Android.
641 * Changed kallsym parser to save 100ms for starting a tracing session with
642 enable_ksyms=true.
643 * Removed advertisement of the built-in data sources "android.heapprofd",
644 "android.java_hprof", "linux.perf" on Linux and other platforms. Built-in
645 data sources are only used to lazy-start daemons on Android OS.
646 * Changed ACL files on Android atrace.rc to support to up to 24 ftrace cpus.
647 No change on Linux which remains unlimited.
648 Trace Processor:
649 * Changed protobuf decoders to use less stack and fall back on heap sooner
650 (before: 16KB of stack per decoder, after: 1.6KB). It caused problems with
651 some embedders which use smaller per-thread stacks.
652 * Added support for SPAN OUTER JOIN on unpartitioned tables.
653 * Improved performance of as_pandas_dataframe() in the Python API by 16x.
654 UI:
655 * Added visualization of direct_reclaim ftrace events.
656 SDK:
657 * Added perfetto::{Flow,TerminatingFlow} to the track-event library.
658
659
Primiano Tuccia94219a2021-10-05 10:38:24 +0100660v20.1 - 2021-10-05:
661 Tracing service and probes:
662 * Fixed standalone Windows build. Updated the llvm-win toolchain.
663
664
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100665v20.0 - 2021-10-03:
666 Tracing service and probes:
Primiano Tucci5eabf6f2021-09-07 14:49:48 +0100667 * Removed DCHECK that would cause crashes when a debug build of the service
668 is used with a producer built with -DNDEBUG.
Daniele Di Proiettoa4c180e2021-09-15 15:42:34 +0000669 * Changed the service-side field-level filtering configuration protobuf
670 field number, because the feature had a bug. This is effectively
671 equivalent to deprecating the feature and reintroducing it under a
672 different name.
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100673 * Added support for boot tracing on Android. Early kernel tracing (prior to
674 the point when /data is mounted) is not yet supported. For instructions
675 see /docs/case-studies/android-boot-tracing.md .
Primiano Tucci5f303142021-06-02 10:28:50 +0100676 Trace Processor:
Lalit Maganti09002982021-09-10 17:04:08 +0100677 * Added reqiurement of separating queries by semi-colon (;) followed by
678 new-line when specifying a query file with -q to trace processor shell.
Zaina Al-Mashni5ed83f92021-09-09 09:08:38 +0000679 * Added "ancestor_slice_by_stack" and "descendant_slice_by_stack" table
680 functions to walk up and down the slice stacks.
Lalit Maganti09e840c2021-09-22 15:23:17 +0100681 * Overhauled windowed sorting to be based on packet ordering and
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100682 lifecycle events inside the trace instead of time-based ordering.
683 * Removed |SortingMode::kForceFlushPeriodWindowedSort| due to changes to the
684 sorting algorithm, which is now based on Flush events rather than time.
685 Embedders should switch to |SortingMode::kDefaultHeuristics|. Other
686 SortingMode enum values are no-ops and will be removed in future versions.
Primiano Tucci876be6d2021-08-02 20:58:06 +0100687 UI:
Primiano Tucci6a46cc72021-10-04 18:57:12 +0100688 * Added initial flamegraph support for traced_perf callstack samples.
689 * Added initial Pivot table for aggregation of userspace slices. The feature
690 is disabled by default for and requires manual enabling via
691 https://ui.perfetto.dev/#!/flags .
Primiano Tucci876be6d2021-08-02 20:58:06 +0100692 SDK:
Primiano Tucci1a69d012021-09-07 14:52:27 +0100693 * Changed DCHECK and DLOGs to be always disabled in SDK builds, regardless
694 of NDEBUG.
Primiano Tucci876be6d2021-08-02 20:58:06 +0100695
696
Primiano Tuccie356c102021-09-07 11:47:47 +0100697v19.0 - 2021-09-02:
698 Tracing service and probes:
699 * Added ftrace clock reporting to the trace.
700 Trace Processor:
701 * Added support for longs/doubles to RUN_METRIC.
702 * Added power profile data for sunfish, redfin, and bramble.
703 * Added experimental Python library for computing slice breakdowns.
704 * Fixed parsing of JSON escape sequences.
705 * Fixed JSON trace detection.
706 UI:
707 * Added local cacheing of traces. Traces are reloaded in case of refresh or
708 tab being discarded by the browser.
709 * Added icon to distinguish metric-derived tracks.
710 * Added release channel selector to feature flags page.
711 * Fixed crash with null slice names.
712 SDK:
713 * Added some missing NESTABLE_ASYNC legacy trace macros.
714 * Fixed reporting of producer uid in --query.
715 * Fixed version numbering scheme for minor versions. Previously versions
716 were numbered as like v19.0.42 where 42 represented the number of commits
717 since the last major version release. This was ambiguous in the presence
718 of branches. Now versions are numbered like v19.0-ab12cd34 where ab12cd34
719 is the shortened Git commit-ish.
720
721
Primiano Tucci876be6d2021-08-02 20:58:06 +0100722v18.0 - 2021-08-02:
723 Tracing service and probes:
724 * Added cross-compiler toolchains for Linux-{arm,64} based on Debian Sid.
725 These will be used for generating monthly releases' prebuilts via LUCI.
726 Trace Processor:
727 * Added 'android_gpu' metric to report residency information for each GPU
728 frequency (via `trace_processor_shell --run-metrics android_gpu`).
Primiano Tuccie2422be2021-07-20 18:19:45 +0100729 * Removed the RawQuery RPC interface.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100730 UI:
Primiano Tuccie2422be2021-07-20 18:19:45 +0100731 * Added a highlighted section to thread slices to visualize CPU time
Zaina Al-Mashni3911f612021-07-13 18:09:34 +0000732 (darker) verses wall time (lighter).
Primiano Tucci876be6d2021-08-02 20:58:06 +0100733 * Added global counter tracks for perf counters (e.g. "CPU 0 cycles", "CPU 0
734 instructions") when the 'linux.perf' data source (traced_perf) is used.
735 * Added a (feature) 'Flags' page to enable/disable individual metrics.
736 * Fixed races that could cause occasional crashes when loading a trace
737 from a permalink.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100738 SDK:
Primiano Tuccie2422be2021-07-20 18:19:45 +0100739 * Fix undefined reference on ~TracingMuxerFake when building the SDK.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100740
741
742v17.0 - 2021-07-02:
743 Tracing service and probes:
Ryan Savitski6444aad2021-07-02 16:30:57 +0100744 * Fixed a bug in ftrace parsing of absolute timestamps
745 (RINGBUF_TYPE_TIME_STAMP), encountered on Linux kernels 5.9+.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100746 * Fixed a bug in --save-for-bugreport causing 0-length traces if the
747 selected trace declared one or more triggers in the config.
748 * Fixed a bug in tracebox causing the PERFETTO_PRODUCER_SOCK_NAME env
749 var to be ignored.
750 Trace Processor:
Primiano Tucci728230d2021-06-16 15:38:35 +0100751 * Changed CORS headers of --httpd mode to allow only https://ui.perfetto.dev
752 and http://localhost:10000. This affects only CORS-aware browser clients.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100753 * Added GPU frequency metrics.
Primiano Tucci5f303142021-06-02 10:28:50 +0100754 UI:
Primiano Tuccice51d522021-06-03 14:57:45 +0100755 * Fixed ADB connection issues ("unable to reset device") on Windows and Mac.
Primiano Tucci50199ce2021-07-02 14:50:53 +0100756 * Added caching of tracing in the cache storage so that the trace is
757 re-opened if a tab is killed (Chrome tab discarding or accidental CTRL+W).
Primiano Tucci5f303142021-06-02 10:28:50 +0100758 SDK:
Sami Kyostilac687c2e2021-06-03 13:00:45 +0100759 * Added support for writing track events using custom clock timestamps.
Primiano Tucci5f303142021-06-02 10:28:50 +0100760
761
Primiano Tucci5ca51f92021-06-08 10:29:35 +0100762v16.1 - 2021-06-08:
763 Tracing service and probes:
764 * Cherry-pick of r.android.com/1716718 which missed the v16 branch cut and
765 fixed MSVC 2019 builds.
766
767
Primiano Tucci5f303142021-06-02 10:28:50 +0100768v16.0 - 2021-06-01:
769 Tracing service and probes:
Primiano Tucci235610f2021-05-24 20:22:43 +0100770 * Added support for building most targets (including traced, SDK and
771 trace_processor_shell) from Windows using either clang-cl or MSVC 2019.
772 * Added tracebox, a monolithic binary to capture traces with one command
773 on Linux and older versions of Android (tested on Android Oreo).
Primiano Tucci5f303142021-06-02 10:28:50 +0100774 * Added support for service-side field-level filtering of traces. The
775 consumer can pass a filter bytecode and ensure that non-allowed fields
776 are never emitted in output.
777 * Added reporting of service version and producer SDK version into the trace
778 and `perfetto --query`.
779 * Fixed compatibility with Android versions older than Pie (for sideloading)
780 which cause failures when trying to enable atrace categories.
Primiano Tucci96755912021-01-05 12:15:17 +0100781 Trace Processor:
Primiano Tucci5f303142021-06-02 10:28:50 +0100782 * Added new RPC interface based on a bidirectional binary pipe. This allows
783 to simplify integration with out-of-process users. The existing --httpd
784 interface now exposes a single /rpc endpoint. Older endpoints are still
785 available for legacy clients.
786 * Added support for counters and instant events in JSON traces.
787 * Fixed support of displayTimeUnit in JSON traces.
Primiano Tuccie60b7c82021-03-03 14:09:35 +0000788 UI:
Primiano Tucci41327402021-06-01 20:28:00 +0100789 * Added warning dialog when trying to use a trace_processor_shell --httpd
790 which is too old.
791 * Added warning dialog when trying to use a trace_processor_shell --httpd
792 RPC instance from more than one tab.
Primiano Tucci5f303142021-06-02 10:28:50 +0100793 * Added links to convert the trace to JSON or systrace directly from the UI.
794 * Changed track sorting logic. Tracks are now sorted in groups (e.g.,
795 scheduling tracks, summary tracks, frame timeline tracks).
796 * Fixed crashes happening flakily when pushing traces via window.open().
Primiano Tucci8220de22021-05-05 09:53:37 +0100797
798
799v15.0 - 2021-05-05:
800 Tracing service and probes:
801 * Added support for {host,target}=aarch64 standalone builds.
802 * Added --background cmdline switch to traced and traced_probes services.
803 * Changed trigger_perfetto to ignore unknown command line arguments to
804 preserve forward compatibility.
805 * Added -a / --app cmdline argument to tools/record_android_trace.
806 Trace Processor:
807 * Added sanitisation of keys in nested debug annotation dictionaries.
808 * Changed Android startup metric: count CPU time of JIT thread pool, report
809 timestamp of activities during startup.
810 * Changed android_surfaceflinger metric, added missed frame counters.
811 * Changed version of SQLite to 3.35.4.
812 * Fixed importing of JSON traces with decimal (sub-us) timestamp.
813 * Fixed prepending "debug." prefix to debug annotations with non-interned
814 names.
815 UI:
816 * Added support to visualize the lifetime of individual dmabuf allocations
817 as async slices (datasource: already existing ftrace dmabuf event).
818 * Fixed visualization of unfinished slices to extend to the end of the
819 viewport.
820 SDK:
Alexander Timin129bdcf2021-04-16 11:36:37 +0000821 * Added support for passing arbitrary number of debug annotations to
822 TRACE_EVENT and combining them with lambdas.
823 * Added support for writing typed TrackEvent arguments using TRACE_EVENT
824 inline without lambdas.
Primiano Tucci8220de22021-05-05 09:53:37 +0100825 * Changed ConvertTimestampToTraceTimeNs to be a member of
826 TraceTimestampTraits<T> struct instead of a standalone function.
827 * Changed TracedValue to use nested DebugAnnotation proto instead of
828 DebugAnnotation::NestedValue.
Primiano Tucci7454e1a2021-04-01 13:03:19 +0100829
830
831v14.0 - 2021-04-01:
832 Tracing service and probes:
833 * Added support for polling power rails on Android from the newer
834 IPowerStats AIDL interface (previously using only the HAL interface).
835 * Fixed native heap profiler crash when ABI of heapprofd and profiled
836 process mismatch.
837 * Changed encoding format of Anroid managed heap profiler to reduce heap
838 dump sizes by delta-encoding object IDs.
839 Trace Processor:
840 * Added activity create/resume, layout inflation and resource timings to
841 the Android startup metric.
842 * Added chrome metadata key/value pairs (e.g. chrome version) into the
843 `metadata` table with 'cr-' prefixed keys.
844 * Added dma-buf-based memory metrics reporting total/avg/min/max dmabuf
845 allocation per-dmabuf-heap and per-process.
846 * Removed |force_full_sort| flag from config. This has been replaced
847 by setting the sorting mode to force a full sort.
848 UI:
849 * Added tools/symbolize-ui-crash script to resolve crash reports via
850 TypeScript source maps.
851 * Fixed newlines when copying Android event log lines into the clipboard.
852 * Fixed crash when selecting "Did not finish" slices.
853 * Fixed OOM dialog to give actionable instructions when opening large traces
854 rather than suggesting to file a bug.
Sami Kyostilaedf7c862021-03-11 13:33:35 +0000855 SDK:
Primiano Tucci7454e1a2021-04-01 13:03:19 +0100856 * Added /meson.build for bundling /sdk/perfetto.{cc,h} in Meson builds.
857 * Added support for counter trace points with the TRACE_COUNTER macro.
858
Primiano Tuccie60b7c82021-03-03 14:09:35 +0000859
860v13.0 - 2021-03-01:
861 Tracing service and probes:
862 * Added ability to sample callstacks using kernel tracepoints as timebase.
863 * Added abililty to record the perf timebase counter values into the trace,
864 both combined callstack+counter or counter-only.
865 * Added abillity to trigger traces based on VM pressure on Android. Requires
866 a dedicated tracing instance in $tracefs/instances/mm_events.
867 Trace Processor:
Lalit Maganti88eb6982021-03-01 14:28:51 +0000868 * Added sorting mode to trace processor config to specify how trace
869 processor should sort events. The |force_full_sort| flag has been
870 deprecated (with replacement) and will be removed in the next version.
Primiano Tuccie60b7c82021-03-03 14:09:35 +0000871 * Added ingestion of frame timeline events into the
872 {expected,actual}_frame_timeline_slice tables.
873 * Added support for Mali's trace_marker_write ftrace event.
874 * Added memory metric based on newer android_fastrpc kernel events.
Primiano Tucci96755912021-01-05 12:15:17 +0100875 UI:
Primiano Tuccie60b7c82021-03-03 14:09:35 +0000876 * Added flow events support for instant events and async tracks.
877 * Added support for Android frame timeline events. They allow inspecting
878 end-to-end expected vs actual app-to-surfaceflinger frame times.
879 * Added ability to switch between Canary and Stable channels in the UI.
880 * Added ability to drag&drop to open trace files.
881 * Changed UI serving infrastructure, old ui versions can be now retrieved by
882 directly opening https://ui.perfetto.dev/v12.1.269/ .
883 * Removed thread state track for threads that have no activity.
Sami Kyostilae8c0ff52021-02-16 11:26:16 +0000884 SDK:
885 * Use process start time hashed with the process id as a unique process
886 identifier, allowing multiple independent users of the SDK in the same
887 process to interleave their events on shared tracks.
Sami Kyostila86b10c52021-02-16 16:50:42 +0000888 * Record process and thread names into the trace.
Sami Kyostila67cdc662021-02-26 16:42:14 +0000889 * Add ring buffer tracing support, i.e., periodic clearing of incremental
890 state.
Primiano Tuccie60b7c82021-03-03 14:09:35 +0000891 Misc:
892 * Convert python scripts to python3.
Primiano Tucci96755912021-01-05 12:15:17 +0100893
894
Primiano Tucci71a92392021-02-01 23:45:28 +0100895v12.1 - 2021-02-01:
896 Misc:
897 * Fixed CHANGELOG which was missed in the 12.0 branch cut, causing
898 mis-labeling of the version code in the v12.x branch as v11.0..N
899
900
Primiano Tucci9c294a42021-02-01 18:04:23 +0100901v12.0 - 2021-02-01:
902 Tracing service and probes:
903 * Added more helpful error messages if the client library is used without
904 having been initialized.
905 * Added //tools/record_android_trace script to facilitate recording traces
906 from Android devices, automating start + stop-via-ctrl+c + pull + open.
907 * Added auto-attachment of traces to Android bugreports if dumpstate is
908 invoked when a trace with bugreport_score > 0 is running.
909 SDK:
910 * Added ability to customize the timestamp of events via
911 ConvertTimestampToTraceTimeNs().
912 * Fixed support for category names that contain a space.
913 Trace Processor:
914 * Added ingestion and query support for Android end-to-end frame timing
915 events through the {actual, expected}_frame_timeline_slice tables.
916 * Added time-to-reportFullyDrawn (Android's API) to startup metrics.
917 * Fixed excessive memory usage when decoding traces containing callstacks
918 (https://github.com/google/perfetto/issues/83).
919 UI:
920 * Added ability to inspect the full trace config string from the
921 'Info and stats' page.
922 * Fixed 'TABLE/VIEW XXX already exists' in the Metrics page when running the
923 same metric twice.
924 * Fixed sorting of tracks using numeric sorting instead of lexicographic:
925 Thread {1, 2, 10, 11, 20} rather than Thread {1, 10, 11, 2, 20}.
926 * Fixed CSP-related bug that was preventing the UI to work on Firefox.
927 * Changed max zoom resolution to allow to zoom to sub-us events.
928
929
Primiano Tucci96755912021-01-05 12:15:17 +0100930v11.0 - 2021-01-01:
931 Tracing service and probes:
Sami Kyostilaae504d42020-12-02 12:00:25 +0000932 * Added trace packet interceptor API for rerouting trace data into
933 non-Perfetto systems.
Sami Kyostila6c151262020-12-15 18:48:51 +0000934 * Added support for printing track events to the console.
Sami Kyostila2778ac82020-12-21 16:12:27 +0000935 * Added a way to observe track event tracing sessions starting and
936 stopping.
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000937 Trace Processor:
Primiano Tucci96755912021-01-05 12:15:17 +0100938 * Added "ancestor_slice" and "experimental_ancestor_stack_profile_callsite"
939 table functions to look up ancestors of CPU stack samples in profiler
940 tables.
941 * Added power metric reporting suspend/resume time periods.
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000942 UI:
Primiano Tucci96755912021-01-05 12:15:17 +0100943 * Fixed CPU time calculation in example queries.
944 * Added tracks to debug Android SystemUI jank.
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000945
Primiano Tucci5d2be3a2020-12-01 20:42:45 +0100946
947v10.0 - 2020-12-01:
948 Tracing service and probes:
949 * Fixed crash of tracing service if a client is unresponsive on the IPC
950 channel. Clients are disconnected if they don't respond to IPCs for 10s.
951 * Added cmdline arguments for integration within ChromeOS system image
952 (--{producer,consumer}-socket-{group,mode} for chmod-ing sockets).
953 * Changed path lookup logic for traced socket. /run/perfetto/ is used if the
954 directory exists, falling back on /tmp/ otherwise.
955 * Added support for kernel frame symbolization to the traced_perf callstack
956 sampler.
957 * Added support for resolving ftrace event arguments that require
958 symbolization against printk_format.
959 Trace Processor:
960 * Added .read command to inject a SQL query file, similar to the -q cmdline.
961 * Added trace-based metrics to root cause jank in Android System UI.
962 * Added symbolization support for ELF files on Windows for heap and
963 callstack profilers.
964 * Added support for symbolizing names of workqueue ftrace events.
965 * Improved Android startup metric with activity restart time.
966 UI:
967 * Added support for navigating flows with Ctrl+[ / Ctr+].
968 * Improved query result panel, moved to the bottom group allowing
969 simultaneous query result and timeline views.
970 * Fixed data corruption when recording traces via the WebUSB-based Record
971 page in the UI.
972
973
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000974v9.0 - 2020-11-01:
975 Tracing service and probes:
Sami Kyostilaf99230f2020-10-15 10:38:32 +0000976 * Added support for recording traces from a system service through the
977 client API.
978 * The client library now reconnects producers automatically if the
979 connection to the tracing service is lost. Also fixed crashes in ongoing
980 tracing sessions when a disconnect occurs.
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000981 * Added support for dpu and g2d ftrace events.
982 * Enabled commit batching and producer side patching of chunks.
983 * Add support for symbolizing kernel symbols for ftrace events.
Primiano Tucci2ab19f62020-07-01 21:28:31 +0100984 Trace Processor:
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000985 * Fixed type affinity of string columns.
Primiano Tucci2ab19f62020-07-01 21:28:31 +0100986 UI:
Lalit Maganti09549602020-10-01 16:47:00 +0100987 * Added initial support for running metrics from the UI.
Isabelle Taylor8546cee2020-10-30 14:43:53 +0000988 * Added support for displaying all flows when a slice or area is selected.
989 * Highlight nodes that match the 'focus' string in the flamegraph.
990 * Added search within slice args.
991 * Fixed details panel height and moved query panel into details panel.
992 * Enabled re-sharing of postMessage traces by echoing back the original URL.
993 * Improved record page error messages.
Lalit Maganti09549602020-10-01 16:47:00 +0100994
995
996v8.0 - 2020-10-01:
997 Tracing service and probes:
998 * Added API for querying registered data sources and their capabilities.
999 * Added support for profiling heap allocations on Linux via LD_PRELOAD.
1000 * Fixed possible race when initializing the consumer library.
1001 * Fixed subtle bugs on systems with 16KB system pages.
1002 Trace Processor:
1003 * Added a table which lists available metrics.
1004 * Added Python bindings on PyPi in the 'perfetto' package.
1005 * Added support for running trace_processor_shell on Android.
1006 * Added per-process metrics for GPU memory usage.
1007 * Added support for exporting flow events to JSON.
1008 * Added dynamic tables for navigating between slices of flows.
1009 UI:
1010 * Changed time marking: horizontal selection doesn't gray out anymore,
1011 pressing 'm' marks the range.
1012 * Added initial support for displaying flow event arrows.
1013 * Improved ordering of all thread tracks under process grouping.
1014 * Fixed UI crashes due to metric errors
1015 * Fixed selection of thread state slices.
Primiano Tucci2ab19f62020-07-01 21:28:31 +01001016
1017
Primiano Tucci816506e2020-09-01 18:13:12 +02001018v7.0 - 2020-09-01:
1019 Tracing service and probes:
1020 * Added auto-reconnection to the SDK. Tracing::Initialize() now retries in
1021 the background, instead of failing, if the tracing service is unrechable.
1022 * Added support for recording cpuhp (CPU hotplug) ftrace events.
1023 * Fixed heap profiling unwinding on multi-ABI systems.
1024 * Fixed reporting of live objects in the native heap profiler when using
1025 --dump-at-max.
1026 * Fixed crash when writing trace events with field nesting level > 10.
1027 Trace Processor:
1028 * Added Python bindings, see
1029 https://perfetto.dev/docs/analysis/trace-processor#python-api .
1030 * Added ingestion for Chrome instant events and Chrome flow events.
1031 * Added ingestion for Android GPU memory events and sched_blocked_reason.
1032 * Added WebView power metric.
1033 * Added support for WSL1 where Async I/O is not available.
1034 * Improved detection of Android suspend/resume events.
1035 UI:
1036 * Added GPU memory recording controls and ingestion code. Requires a recent
1037 Android 12+ kernel.
1038 * Added details panel for flow events, showed when the user selects a slice
1039 involved in a flow (arrows in the UI are still being worked on).
1040 * Added instant events rendering.
1041 * Added Google Analytics.
1042 * Fixed I/O thread-states in 4.14 kernels to deal with the removal of
1043 wake-kill using sched_blocked_reason.
1044 * Fixed "Perfetto UI started debugging this browser" showing when opening
1045 the UI and the Chrome extension is installed.
1046 Misc:
1047 * Update language to comply with Android's inclusive language guidance.
1048
1049
Primiano Tucci6d7badc2020-07-31 19:03:27 +02001050v6.0 - 2020-08-01:
1051 Tracing service and probes:
1052 * Added ftrace thermal events.
1053 * Added support for custom allocators to the heap profiler. Allows
1054 developers to report memory allocations that are not done through malloc.
1055 * Added detailed timestamping of key tracing session events.
1056 * Added support for building tracing services on CrOS (system-wide tracing).
1057 * Fixed filtering out of stale ftrace data that predates the beginning of
1058 the tracing session.
1059 Trace Processor:
1060 * Improved profile symbolizer. PERFETTO_SYMBOLIZER_MODE=index discovers
1061 symbol files by build id rather than name.
1062 * Added screen-state Android metrics.
1063 UI:
1064 * Added 'Info and stats' page to debug data losses and trace stats.
1065 * Added full cmdline to process detail panel.
1066 * Improved performance of async tracks using quantized queries.
1067 * Improved performance of counter and slice tracks for long traces by
1068 pre-caching quantized track data.
1069 * Improved actionablility of crash dialog when the Wasm module OOMs.
1070
1071
Primiano Tucci2ab19f62020-07-01 21:28:31 +01001072v5.0 - 2020-07-01:
1073 Tracing service and probes:
1074 * Added gpu_mem_total ftrace event.
1075 * Added TrustZone (scm start/end) event.
1076 * Added protos for GPU memory tracking and updated render stages proto.
1077 * Added time_in_state probe for Android (CPU time broken down by frequency).
1078
Primiano Tucci5b044cc2023-08-10 18:33:14 +01001079
Primiano Tucci2ab19f62020-07-01 21:28:31 +01001080 Trace Processor:
1081 * Added ingestion of IRQ and SoftIRQ events.
1082 * Added ingestion of workqueue events. KAddr symbolization still missing.
1083 * Added ingestion of voltage regulators and board clock change events.
1084 * Added ingestion of new ION ion_buffer_create/destroy events.
1085 * Added ingestion of TrustZone (scm start/end) events.
1086 * Added SurfaceFlinger derived events (tracking of missed frames).
1087 * Changed parsing of scheduler task state on 4.14 kernels.
1088 * Changed importing of Java heap graphs: allow partial dumps.
1089 * Improved performance of the SQL query engine.
1090
Primiano Tucci5b044cc2023-08-10 18:33:14 +01001091
Primiano Tucci2ab19f62020-07-01 21:28:31 +01001092 UI:
1093 * Added dedicated query page for custom SQL queries.
1094 * Added navigation links for Binder slices.
1095 * Removed overview summary mode when zoomed out.
1096 * Fixed recording page when targeting Android P.
1097 * Improved slice pan/zoom performance by quantizing.