Skip to content

Benchmark graph is very mysterious. #16

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mzp opened this issue Jun 5, 2012 · 3 comments
Open

Benchmark graph is very mysterious. #16

mzp opened this issue Jun 5, 2012 · 3 comments
Labels

Comments

@mzp
Copy link
Contributor

mzp commented Jun 5, 2012

A benchmark graph at JSX top page http://jsx.github.com/images/benchmarks.png does not have enough information.

  • What is unit of this graph? (maybe percent?)
  • Which browser is used to measure? (iPhone's Safari?)
  • How do you measure a performance of the library? If you use some driver codes, please publish it.
@kazuho
Copy link
Member

kazuho commented Jun 5, 2012

The numbers are speed ratios with the numbers of the JavaScript versions normalized to one.

Safari running on iPhone 4 (iOS 5.0) was used for the benchmark.

The times being spent were measured by:

shooting - measuring the sum of time spent in Stage#tick for 20 seconds
Box2D - the number of frames being displayed at within first 10 seconds 10 seconds

The source codes used for the benchmarks can be found in web/example subdirectory of the repository.

@kazuho
Copy link
Member

kazuho commented Jun 5, 2012

Update: sorry the source code of Box2D.jsx is in https://github.com/tkihira/box2djsx

@monkpit
Copy link

monkpit commented Jan 21, 2016

Having this information added to the comments here is not helpful to visitors to the site - as it is, the graphs are completely meaningless. Do I want the numbers to be big or small? What do the numbers mean? Are the values ratios, or do they have a single unit of measurement?

All of this information can be communicated by simply labeling your axes, adding a title, or even by adding both. Without this information the graph might as well not be shown at all.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants