CS 412/413
Introduction to Compilers
Spring 2002

Project Presentation Results
Main Benchmarks


(see also Benchmarks Submitted by Groups)


BENCHMARKS

Benchmark

Lines

Description

Size

Ackerman

15 Compute ackerman's function with arguments (3,n) n = 10
Loop 70 Seven nested loops with break and continue statements at each level n = 140

Matrix

155 Divide and conquer matrix multiply of two n x n matrices; the result is checked against standard matrix multiply. n = 256
Pi 88 Compute first n digits of pi n = 5000

Primes

77 Compute n-th prime number n = 300

Queens

157 Compute first n solutions to the queen problem on a 10x10 board. It is implemented as a 10 nested loop, brute force search.  n = 2
Word Count 57 Counts the number of lines, words, and characters from the standard input a 129-line file

 

RUNNING TIMES

 Group Number

A

B

C

D

E

F

G

H

Best

C++

Java

Ackerman

base
regalloc
opt
8.11
0.84
0.79
1.31
0.75
0.76
2.21
0.92
0.92
0.82
0.82
0.81
25.24
5.40
5.36
3.29
0.84
1.00
1.31
EXC
EXC
1.87
0.75
0.76
0.75 0.87 0.75
Loop base
regalloc
opt
3.37
3.17
1.54
1.54
1.23
0.90
2.70
2.31
N/A
1.89
1.78
1.50
35.98
35.92
35.28
TIME
TIME
N/A
3.78
EXC
N/A
2.61
1.71
1.43
0.90 0.65 3.78

Matrix

base
regalloc
opt
12.79
7.86
EXC
8.01
5.79
5.89
9.79
6.48
N/A
8.21
8.21
7.70
TIME
TIME
TIME
16.46
8.57
EXC
EXC
N/A
N/A
7.60
5.62
5.62
5.62 0.60 1.45
Pi base
regalloc
opt
10.76
6.87
6.01
6.79
4.82
4.96
8.10
EXC
N/A
6.85
6.82
8.00
N/A
N/A
N/A
11.00
RES
RES
9.06
EXC
N/A
7.07
3.57
4.48
3.57 3.50 7.98

Primes

base
regalloc
opt
29.43
17.18
EXC
21.70
6.90
RES
37.98
13.32
N/A
6.46
6.48
8.21
TIME
TIME
TIME
43.15
RES
RES
45.48
TIME
TIME
26.56
6.04
6.04
6.04 3.95 9.35

Queens

base
regalloc
opt
RES
RES
RES
38.15
17.37
20.92
96.56
28.73
N/A
24.90
24.89
33.06
TIME
TIME
N/A
152.46
39.59
31.39
80.57
EXC
N/A
40.15
19.43
24.34
17.37 4.14 13.26
Word Count base
regalloc
opt
RES
RES
RES
0.06
0.06
0.04
0.04
0.04
N/A
N/A
N/A
N/A
0.06
0.06
0.04
0.06
0.06
EXC
0.06
EXC
EXC
0.06
0.06
0.04
0.04 0.06 0.09
Tests Passed

5

7

7

6

3

6

6

7

Overall Performance Factor

1.74

1.07

1.72

1.42

15.78

2.70

3.69

1.10

 

COMPILE TIMES

Group Number

A

B

C

D

E

F

G

H

Best C++ Java
Ackerman base
regalloc
opt
0.82
0.90
0.96
0.70
0.70
0.73
0.78
0.82
0.87
1.12
1.14
1.21
1.09
1.06
1.12
0.87
0.82
0.89
0.67
0.75
0.86
0.84
0.79
0.85
0.70 1.09 0.82
0.73 1.09
Loop base
regalloc
opt
0.96
2.92
4.64
0.78
0.79
1.20
0.98
1.10
EXC
1.59
1.56
2.11
2.65
2.82
3.61
0.95
1.00
TIME
0.78
1.56
EXC
1.04
1.10
1.57
0.78 1.10 0.84
1.20 1.12
Matrix base
regalloc
opt
2.30
178.46
148.43
0.95
0.93
1.46
2.07
2.28
EXC
5.63
5.64
6.22
8.83
9.34
11.43
1.40
1.60
5.42
1.73
ASM
EXC
2.02
2.17
2.80
0.93 1.12 0.89
1.46 1.23
Pi base
regalloc
opt
1.01
3.14
5.59
0.81
0.82
1.03
0.95
1.07
EXC
1.92
1.90
2.76
ASM
ASM
ASM
1.03
1.11
2.53
0.78
1.46
EXC
0.98
1.04
1.37
0.78 1.09 0.84
1.03 1.10
Primes base
regalloc
opt
0.89
1.82
1.81
0.73
0.73
0.92
0.87
0.98
EXC
1.28
1.28
1.54
1.28
1.28
1.50
0.87
0.92
1.51
0.73
1.23
2.31
0.87
0.92
1.18
0.73 1.09 0.84
0.92 1.09
Queens base
regalloc
opt
1.31
8.51
117.17
 0.93
0.90
1.92
1.15
1.32
EXC
7.65
7.61
51.51
14.82
15.21
EXC
1.28
1.39
13.73
0.90
3.25
EXC
1.15
1.20
1.89
0.90 1.11 0.85
1.89 1.14
WordCount base
regalloc
opt
0.92
1.64
1.98
0.75
0.78
0.92
0.89
0.96
EXC
EXC
EXC
EXC
1.48
1.46
1.68
0.92
0.95
1.31
0.73
1.20
1.90
0.86
0.90
1.11
0.73 1.09 0.92
0.92 1.09

Average Compile Time

23.15

0.93

1.14

5.76

4.49

2.03

1.30

1.27