Logo image
Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices
Conference proceeding

Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices

Jingyi Xu, Tushar Vaidya, Yufei Wu, Saket Chandra, Zhangsheng Lai and Kai Fong Ernest Chong
Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online), Vol.2023-, pp.6715-6724
06/2023

Abstract

Algebra and reasoning Cognition Commutation Computer vision language Pattern recognition Problem-solving Vision Visualization
We introduce algebraic machine reasoning, a new reasoning framework that is well-suited for abstract reasoning. Effectively, algebraic machine reasoning reduces the difficult process of novel problem-solving to routine algebraic computation. The fundamental algebraic objects of interest are the ideals of some suitably initialized polynomial ring. We shall explain how solving Raven's Progressive Matrices (RPMs) can be realized as computational problems in algebra, which combine various well-known algebraic subroutines that include: Computing the Gröbner basis of an ideal, checking for ideal containment, etc. Crucially, the additional algebraic structure satisfied by ideals allows for more operations on ideals beyond set-theoretic operations. Our algebraic machine reasoning framework is not only able to select the correct answer from a given answer set, but also able to generate the correct answer with only the question matrix given. Experiments on the I-RAVEN dataset yield an overall 93.2% accuracy, which significantly out-performs the current state-of-the-art accuracy of77.0% and exceeds human performance at 84.4% accuracy.

Metrics

2 Record Views

Details

Logo image