Benchmarking

A benchmarking program is available to test how fast your machine performs the type of operations that are involved in iterative hyper-heuristics for combinatorial optimisation. It is not possible to provide perfectly equitable benchmarks across many platforms and algorithms, and we know that the benchmark may be kinder to some people than others. It is pointed out that all the competitors will be run on a standard machine therefore creating a "level playing field".

The benchmark is suitable for individual single processor or dual core machines. It is not suitable for specialist parallel machines or clusters.

The benchmark executable program is available for Windows and Linux (32 bits, 64 bits)  systems. In both systems, the program should be run from a console, typing the executable name (with no parameters).

The program should be run when the machine is not being used for anything else. Please check for that:
  • There are no unnecessary windows open
  • There are no significant OS background processes going on (e.g. back-up)
  • There are no remote users on the computer
  • There are no CPU sharing processes running (e.g. SETI at home, United Devices, DREAM)
The program will report the time in your computer that corresponds to 10 minutes (600 secs)  on the computer that will be used for the competition (a modern PC under Windows XP), and hence the length of time you can run your hyper-heuristic algorithm for each instance. However, please bear in mind that the exact speed of your computer depends on a number of factors including the memory and the operating system, in addition to the clock speed. As mentioned above, all the competitors will be run on a standard machine therefore creating a "level playing field"

Last Updated:  25 May 2011, by Gabriela Ochoa