Airac (SNU) vs. Coverity (Stanford)

Airac homepage

This page shows how our Airac compares against Coverity.com's SIMPLE_BUFFER checker.

A diagram showing the difference between Airac and Coverity's SWAT

Airac detects all the real errors detected by Coverity's.
Airac detects some real errors that Coverity's misses.
- Airac detects more errors (e.g. cdc-acm.c, line 703 and line 625, 626) than Coversity's.
- Not all those more errors are false alarms.
Airac avoids some false alarms (e.g. ip6_output.c, line 348) generated by Coverity's.

Airac ran on a Pentium4 3.2GHz box with 4GB of main memory running GNU/Linux kernel version 2.6.8. The C files tested here are part of the Linux kernel, version 2.6.4.

Test Results

#Airac Alarms
- #Buffers: the number of buffers that may be overrun.
- #Accesses: the number of buffer-access expressions that may overrun.
#SWAT Alarms: the number of SWAT's buffer-overrun alarms
#Real Bugs: the number of buffer-access expressions that can really overrun.

Filename	#Airac Alarams		#SWAT Alarms	#Real Bugs	Airac Time	Miscellaneous
Filename	#Buffers	#Accesses	#SWAT Alarms	#Real Bugs	Airac Time	Miscellaneous
linux-2.6.4/drivers/mtd/maps/vmax301.c	1	1	1	1	0.28s	Airac output Coverity bug#2087
linux-2.6.4/net/xfrm/xfrm_user.c	2	2	1	1	45.07s	Airac output Coverity bug#2089
linux-2.6.4/drivers/usb/class/usb-midi.c	2	10	2	4	91.32s	Airac output Coverity bug#2090 Coverity bug#2119
linux-2.6.4/drivers/input/keyboard/atkbd.c	2	2	2	2	1.99s	Airac output Coverity bug#2095 Coverity bug#2133
linux-2.6.4/drivers/char/keyboard.c	2	2	1	1	3.36s	Airac output Coverity bug#2097
linux-2.6.4/net/ipv4/af_inet.c	1	1	1	1	1.17s	Airac output Coverity bug#2098
linux-2.6.4/drivers/scsi/eata_pio.c	3	3	1	1	7.50s	Airac output Coverity bug#2100
linux-2.6.4/drivers/usb/class/cdc-acm.c	1	3	1	3	3.98s	Airac output Coverity bug#2101
linux-2.6.4/net/ipv6/ip6_output.c	0	0	1	0	1.53s	Airac output Coverity bug#2103
linux-2.6.4/drivers/message/fusion/mptbase.c	1	1	1	1	0.79s	Airac output Coverity bug#2104
linux-2.6.4/drivers/video/aty/aty128fb.c	1	1	1	1	0.32s	Airac output Coverity bug#2112

Last updated: Tue Aug 31 13:55:06 2021 +0900