Straight to the results : https://mocquin.github.io/physipy/

A quickstart on AirSpeedVelocity¶

Install required packages :

pip install asv
pip install virtualenv

If first time using benchmarks : go to top package to setup the benchmarks:

asv quickstart

Creates json file, fill the matrix parameter with reqs packages.

The actual python code that describe the code run for benchmarking are stored in the benchmarks directory.

Once setup and benchmarks written :

asv run ALL  # to run all benchmarks on all comiits
asv run v0.1..master # to all benchmarks from master to commit tagged v0.1
asv publish  # convert results to html in the "html_dir" of the config file, ".asv/html" for now
asv preview  # display html on server

To check that no problem is found in the benchmarks, run : asv check --python=same

To profile a specific benchmark on a specific commit : asv profile benchmarks.BasicPhysipy.time_QuantityCreationByArray master --gui=snakeviz (make sure to have pip install snakeviz).

It seems this must be run outside of conda: to benchmark only a list of commits : use git log --pretty=oneline f1.py f2.py to get the list of commits that modify files then :

asv run HASHFILE:hashestobenchmark.txt
asv gh-pages --rewrite

To benchmark only a specific commit, add ^! after the commit hash :

asv run 123azert^!

See : https://www.youtube.com/watch?v=OsxJ5O6h8s0
Example : https://github.com/astropy/astropy-benchmarks

Bench of physipy¶

The list of commits that are benchmarked is available at : https://github.com/mocquin/physipy/blob/master/hashestobenchmark.txt

The config file for asv is available at : https://github.com/mocquin/physipy/blob/master/asv.conf.json

Some benchmarks have aleardy been run on my personnal laptoop and the results are tracked in the repo at : https://github.com/mocquin/physipy/tree/master/.asv

To run the benchmark on your computer, download the repo content and run (make sure you installed asv): asv run HASHFILE:hashestobenchmark.txt

To launch a server and inspect results of benchmarks :
asv publish # convert results to html
asv preview # display html on server

To push the latest results: asv gh-pages --rewrite

Results¶

The results of benchmarks are available online at : https://mocquin.github.io/physipy/