Evaluation Results averaged over each Category

Evaluation results averaged over each category in the Benchmark

Below are evaluation results each of the 19 object categories in the Benchmark. For every object category, each of the four bar charts shows a different evaluation metric computed for all seven algorithms and averaged across the entire data set. Added to each chart is a bar representing the human-generated segmentations evaluated with respect to one other (labeled "Human," on the left) and two bars representing trivial segmentation algorithms ("None" = all faces in one segment, and "Every"= every face in a separate segment). In all cases, lower bars represent better results.

Category 1: Human

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 2: Cup

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 3: Glasses

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 4: Airplane

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 5: Ant

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 6: Chair

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 7: Octopus

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 8: Table

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 9: Teddy

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 10: Hand

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 11: Plier

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 12: Fish

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 13: Bird

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 15: Armadillo

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 16: Bust

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 17: Mech

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 18: Bearing

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 19: Vase

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error

Category 20: FourLeg

Rand Index	Cut Discrepancy
Hamming Distance	Consistency Error