Scalability

Performance Graph Performance Graph (zoomed)
Figure 1 Figure 2
Above two figures show Airac's scalability behavior. X axis is the size (# of lines) of the input program to analyze. Y axis is the analysis time in seconds. Figure 2 is a microscopic graph of Figure 1's lower left corner.

Analysis Cost and Accuracy

The following table shows Airac's analysis speed and accuracy data. (For a comparison with other existing tools, click here.)
Class Software #Lines Time(sec) #Airac Alarms #Real Bugs #Buffer Accesses
#Buffers #Accesses
GNU S/W tar-1.13 20258 576.79s 24 66 1 2630
bison-1.875 25907 809.35s 28 50 0 5164
sed-4.0.8 6053 1154.32s 7 29 0 461
gzip-1.2.4a 7327 794.31s 9 17 0 799
grep-2.5.1 9297 603.58s 2 2 0 187
Linux Kernel
(version 2.6.4)
vmax302.c 246 3.02s 1 1 1 79
xfrm_user.c 1201 91.21s 2 5 4 235
usb-midi.c 2206 133.18s 2 10 4 332
atkbd.c 944 407.55s 3 5 2 332
keyboard.c 1256 38.56s 5 6 1 411
af_inet.c 1273 79s 1 1 1 48
eata_pio.c 984 47.65s 3 5 1 183
cdc-acm.c 849 347.68s 3 5 3 468
ip6_output.c 1110 89.74s 0 0 0 198
mptbase.c 6158 3299.07s 3 3 1 777
aty128fb.c 2466 12.23s 1 1 1 98
Commercial S/W sw T 109878 4525.02s 16 64 0
sw U 17885 463.60s 8 18 9
sw S 3254 5.94s 17 57 0
sw SD 29972 457.38s 10 140 112
sw DD 19263 8912.86s 7 100 3
sw DC 36731 43.65s 11 48 4
sw DS 138305 38328.88s 34 147 47
sw Es 233536 4285.13s 28 162 6
sw El 47268 2458.03s 25 273 1
Last updated: Fri Jul 29 15:36:52 2005 +0900