tp: cut allocation and string work in the executor and CREATE TABLE (#7706)

**Summary**

Removes avoidable allocation and string work in code that runs whenever
an operator retains rows, an `INTERVAL INTERSECTION` runs, or `CREATE
PERFETTO TABLE` materializes a query. Each change is small; together
they are 5-67% faster on the paths they touch.

**Changes**

**RowStore**
- Reuses the chunks it copies borrowed columns into. It used to allocate
a new chunk for every column of every batch and free them all on
`Clear()`, which dominated operators run over and over on small inputs.
A chunk is only reused once nothing else holds it.
- Copies validity a word at a time (new `BitVector::FillBits`) instead
of a bit at a time.

**IntervalIntersect**
- Groups lived in a `FlatHashMapV1`, whose minimum capacity of 1024
slots was walked and cleared on every rerun, and each group's intervals
were freed each time. Groups are now reused across runs, held by pointer
so their keys never move, and found through a `FlatHashMapV2` of
`string_view`s.

**Strings in `CREATE PERFETTO TABLE`**
- The dataframe virtual table returned strings without their length, so
SQLite ran `strlen` on every one. It now passes the length and marks
them NUL-terminated (`SQLITE_UTF8_ZT`).
- Strings read back from the string pool were hashed and interned again.
A pointer into the pool is now mapped straight back to its id, checked
against the size prefix before it and the terminator after it. This is
done under the pool's lock, which is only taken when locking is enabled.

**Benchmarks**

Functions 64-byte aligned in both builds, so code placement does not
skew results; best of 5.

| Benchmark | Before | After | Ratio |
|---|--:|--:|--:|
| `BM_RowStore` (16 batches) | 216 µs | 92 µs | 0.43x |
| `BM_RowStoreOneRow` | 201 ns | 66 ns | 0.33x |
| `BM_IntervalIntersect` (100K rows) | 5.00 ms | 4.09 ms | 0.82x |
| `BM_IntervalIntersectFourRows` | 3.27 µs | 0.50 µs | 0.15x |

Real traces, query time:

| Trace | `CREATE PERFETTO TABLE` copies of sched, thread_state, slice,
counter, thread | `INTERVAL INTERSECTION` of sched and thread_state `PER
utid`, 5 times |
|---|--:|--:|
| `wattson_syscore_suspend` | 122 → 111 ms (0.91x) | 117 → 116 ms
(0.99x) |
| `chrome_android_systrace` | 126 → 112 ms (0.89x) | 120 → 109 ms
(0.91x) |
| `example_android_trace_30s` | 77 → 74 ms (0.96x) | 230 → 222 ms
(0.97x) |
| `android_sched_and_ps` | 40 → 38 ms (0.95x) | 124 → 114 ms (0.92x) |

Results are identical to before on all four traces.

**Testing**

New unit tests for `BitVector::FillBits` and for `RowStore` reusing
chunks without overwriting ones still held. Unit and diff tests pass.
14 files changed
tree: 3263e86b12dbe32dcca0ff038a15ffacbbc4ae4c
  1. .github/
  2. ai/
  3. bazel/
  4. build_overrides/
  5. buildtools/
  6. contrib/
  7. docs/
  8. examples/
  9. gn/
  10. include/
  11. infra/
  12. protos/
  13. python/
  14. sdk/
  15. src/
  16. test/
  17. third_party/
  18. tools/
  19. ui/
  20. .bazelignore
  21. .bazelrc
  22. .bazelversion
  23. .clang-format
  24. .clang-tidy
  25. .git-blame-ignore-revs
  26. .gitallowed
  27. .gitattributes
  28. .gitignore
  29. .gn
  30. .style.yapf
  31. Android.bp
  32. Android.bp.extras
  33. BUILD
  34. BUILD.extras
  35. BUILD.gn
  36. CHANGELOG
  37. CONTRIBUTORS.txt
  38. DIR_METADATA
  39. heapprofd.rc
  40. LICENSE
  41. meson.build
  42. METADATA
  43. MODULE.bazel
  44. MODULE.bazel.lock
  45. MODULE_LICENSE_APACHE2
  46. OWNERS
  47. OWNERS.github
  48. perfetto.rc
  49. perfetto_flags.aconfig
  50. PerfettoIntegrationTests.xml
  51. persistent_cfg.pbtxt
  52. README.chromium
  53. README.md
  54. TEST_MAPPING
  55. traced_perf.rc
  56. WORKSPACE
README.md

Perfetto - System profiling, app tracing and trace analysis

Perfetto is an open-source suite of SDKs, daemons and tools which use tracing to help developers understand the behaviour of complex systems and root-cause functional and performance issues on client and embedded systems.

It is a production-grade tool that is the default tracing system for the Android operating system and the Chromium browser.

Core Components

Perfetto is not a single tool, but a collection of components that work together:

  • High-performance tracing daemons: For capturing tracing information from many processes on a single machine into a unified trace file.
  • Low-overhead tracing SDK: A C++17 library for direct userspace-to-userspace tracing of timings and state changes in your application.
  • Extensive OS-level probes: For capturing system-wide context on Android and Linux (e.g. scheduling states, CPU frequencies, memory profiling, callstack sampling).
  • Browser-based UI: A powerful, fully local UI for visualizing and exploring large, multi-GB traces on a timeline. It works in all major browsers, requires no installation, and can open traces from other tools.
  • SQL-based analysis library: A powerful engine that allows you to programmatically query traces using SQL to automate analysis and extract custom metrics.

Why Use Perfetto?

Perfetto was designed to be a versatile and powerful tracing system for a wide range of use cases.

  • For Android App & Platform Developers: Debug and root-cause functional and performance issues like slow startups, dropped frames (jank), animation glitches, low memory kills, and ANRs. Profile both Java/Kotlin and native C++ memory usage with heap dumps and profiles.
  • For C/C++ Developers (Linux, macOS, Windows): Use the Tracing SDK to instrument your application with custom trace points to understand its execution flow, find performance bottlenecks, and debug complex behavior. On Linux, you can also perform detailed CPU and native heap profiling.
  • For Linux Kernel & System Developers: Get deep insights into kernel behavior. Perfetto acts as an efficient userspace daemon for ftrace, allowing you to visualize scheduling, syscalls, interrupts, and custom kernel tracepoints on a timeline.
  • For Chromium Developers: Perfetto is the tracing backend for chrome://tracing. Use it to debug and root-cause issues in the browser, V8, and Blink.
  • For Performance Engineers & SREs: Analyze and visualize a wide range of profiling and tracing formats, not just Perfetto's. Use the powerful SQL interface to programmatically analyze traces from tools like Linux perf, macOS Instruments, Chrome JSON traces, and more.

Getting Started

We‘ve designed our documentation to guide you to the right information as quickly as possible, whether you’re a newcomer to performance analysis or an experienced developer.

  1. New to tracing? If you're unfamiliar with concepts like tracing and profiling, start here:

  2. Ready to dive in? Our “Getting Started” guide is the main entry point for all users. It will help you find the right tutorials and documentation for your specific needs:

  3. Want the full overview? For a comprehensive look at what Perfetto is, why it's useful, and who uses it, see our main documentation page:

Debian Distribution

For users interested in the Debian distribution of Perfetto, the official source of truth and packaging efforts are maintained at Debian Perfetto Salsa Repository

Community & Support

Have questions? Need help?

We follow Google's Open Source Community Guidelines.