The N-terminal starch binding domain of Rhizopus oryzae glucoamylase (RoSBD) has a high binding affinity for raw starch. RoSBD has two ligand-binding sites, each containing a ligand-binding clamp: a polyN clamp residing near binding site I is unique in that it is expressed in only three members of carbohydrate binding module family 21 (CBM21) members, and a Y32/F58 clamp located at binding site II is conserved in several CBMs. Here we characterized different roles of these sites in the binding of insoluble and soluble starches using an amylose-iodine complex assay, atomic force microscopy, isothermal titration calorimetry, site-directed mutagenesis, and structural bioinformatics. RoSBD induced the release of iodine from the amylose helical cavity and disrupted the helical structure of amylose type III, thereby significantly diminishing the thickness and length of the amylose type III fibrils. A point mutation in the critical ligand-binding residues of sites I and II, however, reduced both the binding affinity and amylose helix disruption. This is the first molecular model for structure disruption of the amylose helix by a non-hydrolytic CBM21 member. RoSBD apparently twists the helical amylose strands apart to expose more ligand surface for further SBD binding. Repeating the process triggers the relaxation and unwinding of amylose helices to generate thinner and shorter amylose fibrils, which are more susceptible to hydrolysis by glucoamylase. This model aids in understanding the natural roles of CBMs in protein-glycan interactions and contributes to potential molecular engineering of CBMs.