Classification of Benchmarks
Topics which could be covered.
Average Quality Benchmarks
like TPS, LIPS, FLOPS ?
Mixture of typical application problems.
Graphical User Interface
benchmarks ? assessments ?
quality, ease of use, recommendations,
desktop publishing quality.
Breadth and Scope Benchmarks
quality of implemented mathematics
E.g. probabilistic prime number tests, precomputed group sizes.
Low Level Benchmarks,
Basic (Integer) and Polynomial Arithmetic.
Medium Level Benchmarks,
Factorisation, Gröbner Bases, Resultants, etc.
High Level Benchmarks,
Integration, Systems of Equations,
Cylindrical Algebraic Decomposition,
other complex Applications.
Grand Challenges Benchmarks
scalability, special hardware;
e.g. van zur Gathens Factorisation Challenge.
Manufacturer Specific Benchmarks
e.g. REDUCE test suite.