The CPU chip, specifically its ALU component, is responsible for performing arithmetic and comparison operations on data.