New compounds containing a novel zinc binding group (salicylaldoxime system) were identified as effective inhibitors of carbonic anhydrases (CAs). This structural motif seems to bind the catalytic zinc ion of CAs, revealing itself as a new valid alternative to the sulfonamide group. Computational procedures were used to investigate the binding mode of this class of compounds, within the active site of CAII. This study suggests that the salicylaldoxime moiety binds the zinc ion through the oxime oxygen atom that also forms an H-bond with T199. The results herein obtained will allow the development of new CA-inhibitors bearing the salicylaldoxime moiety.