Skip to content

Create infrastructure for measuring Lighthouse perf metrics #1924

@wwwillchen

Description

@wwwillchen

Objective

Enable users to:

  • export lighthouse results to the cloud
  • query certain types of lighthouse results from the cloud (e.g. only sites X and Y with devtools-based throttling)
  • visualize these lighthouse results locally

This will enable the lighthouse team to analyze both the accuracy (variance between various configs - WPT-based or DevTools-based network throttling) and precision (variance between runs with the same config)

Querying

Example queries:

  • All results from 3/28 - 3/29 for sites X and Y for all types of configuration

Dimensions for querying:

  • Date range (when it was run)
  • Browser version
  • CPU Throttling type
  • Network Throttling type
  • Sites
  • Platform (real device or emulated) or an overall systems performance metric (Ops/second)

Data model (probably Cloud Datastore)

{
  lighthouseVersion: "1.6.3",
  generatedTime: "2017-03-27T23:23:11.077Z",
  browserVersion: ''Chrome Canary 57.7",
  cpuThrottling: "", // enum of "DevTools", ?
  networkThrottling: "", // enum of "DevTools", "WebPageTest"
  platformType: "", // enum of "realDevice", "emulated"
  platform: "" // TBD
  url: "https://site.com",
  performanceMetrics: {
    firstMeaningfulPaint: {
     rawValue: float,
     score: int,
   }
  // other perf metrics...
  }
}

Visualization

image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions