Skip to content

1. Add --profile flag to attention_benchmark to output Highway profiler - #1010

Merged
copybara-service[bot] merged 1 commit into
devfrom
test_974965807
Sep 4, 2026
Merged

1. Add --profile flag to attention_benchmark to output Highway profiler#1010
copybara-service[bot] merged 1 commit into
devfrom
test_974965807

Conversation

@copybara-service

Copy link
Copy Markdown
  1. Add --profile flag to attention_benchmark to output Highway profiler
    zone breakdowns when compiled with -DPROFILER_ENABLED=1.
  2. Link //third_party/highway:profiler into attention_benchmark in BUILD.
  3. Instrument DSpark speculative decoding stages (Gen.MTP.Draft,
    Gen.MTP.VerifyPass, Gen.MTP.CommitDSparkKV) in deepseek_spec.cc with
    PROFILER_ZONE markers.
  4. Add GCPP_ZONE profiling instrumentation to DeepSeek V4 MLA attention
    (ComputeQKV, DotSoftmax, SumHeads) and dense FFW in deepseek.cc.
  5. Add PrintResults() call under #if PROFILER_ENABLED to run_dsv4.cc.

@copybara-service
copybara-service Bot force-pushed the test_974965807 branch 4 times, most recently from 4eb314e to 2fbbc92 Compare September 4, 2026 16:12
   zone breakdowns when compiled with -DPROFILER_ENABLED=1.
2. Link //third_party/highway:profiler into attention_benchmark in BUILD.
3. Instrument DSpark speculative decoding stages (Gen.MTP.Draft,
   Gen.MTP.VerifyPass, Gen.MTP.CommitDSparkKV) in deepseek_spec.cc with
   PROFILER_ZONE markers.
4. Add GCPP_ZONE profiling instrumentation to DeepSeek V4 MLA attention
   (ComputeQKV, DotSoftmax, SumHeads) and dense FFW in deepseek.cc.
5. Add PrintResults() call under #if PROFILER_ENABLED to run_dsv4.cc.

PiperOrigin-RevId: 976362424
@copybara-service
copybara-service Bot merged commit 61cc7d0 into dev Sep 4, 2026
11 checks passed
@copybara-service
copybara-service Bot deleted the test_974965807 branch September 4, 2026 16:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants