Runtime Stats Komparator
  
  
    Baseline Selector
    
      Compare against baseline: 
      Green a selected version performs
      better than the baseline.
    
  
  
  
  
  
  
  
  
    
    
      
        
          | Pos. | Name | Time | Percent | Count | 
      
      
    
   
  
    Instructions
    
      
        - Build chrome.
Telemetry benchmark
      
        - Run v8.browsingbenchmarks:$CHROMIUM_DIR/tools/perf/run_benchmark run v8.browsing_desktop \
            --browser=exact --browser-executable=$CHROMIUM_DIR/out/release/chrome \
            --story-filter='.*2020 ' \
            --also-run-disabled-tests
          
- Install jq.
- Convert the telemetry JSON files to callstats JSON file:
          
            $V8_DIR/tools/callstats-from-telemetry.sh $CHROMIUM_DIR/tools/perf/artifacts/run_XXXX
          
- Load the generated out.json
Merged CSV from results.html
      
        - Open a results.html page for RCS-enabled benchmarks
- Select "Export merged CSV" in the toolbar
- Load the downloading .csv file normally in callstats.html
Aggregated raw txt output
      
        - Install scipy, e.g. sudo aptitude install python-scipy
- Check out a known working version of webpagereply:
          git -C $CHROME_DIR/third_party/webpagereplay checkout 7dbd94752d1cde5536ffc623a9e10a51721eff1d 
- Run callstats.pywith a web-page-replay archive:$V8_DIR/tools/callstats.py run \
          --replay-bin=$CHROME_SRC/third_party/webpagereplay/replay.py \
          --replay-wpr=$INPUT_DIR/top25.wpr \
          --js-flags="" \
          --with-chrome=$CHROME_SRC/out/Release/chrome \
          --sites-file=$INPUT_DIR/top25.json
- Move results file to a subdirectory: mkdir $VERSION_DIR; mv *.txt $VERSION_DIR
- Repeat from step 1 with a different configuration (e.g. --js-flags="--nolazy").
- Create the final results file: ./callstats.py json $VERSION_DIR1 $VERSION_DIR2 > result.json
- Use results.jsonon this site.
 
  
  
    
    
      
        |  | 
      
        | Page: |  | 
      
        | Version: |  |  | 
      
        | Time: |  | ± |  |  | ± |  | 
      
        | Percent: |  | ± |  |  | ± |  | 
      
        | Percent per Entry: |  |  |  |  | 
      
        | Count: |  | ± |  |  | ± |  | 
      
        | Overall Impact: |  | ± |  |  | ± |  |