Most soluble dietary fibers ferment rapidly in the proximal colon, potentially causing discomfort and poor tolerability. Alkali-extracted arabinoxylan isolates from corn, wheat, rice and sorghum brans were prepared, through hydrolysis (except sorghum) and ethanol fractionation, to have a broad range of initial fermentation rates, and their linkage patterns were determined to understand structural aspects related to slow fermentation rate. They were all highly branched polymers with degree of substitution greater than 64%. There was no relationship of molecular mass, arabinose:xylose ratio, or degree of substitution to fermentation rate patterns. Slow fermenting wheat and corn arabinoxylans had much higher amount of terminal xylose in branches than fast fermenting rice and sorghum arabinoxylans. The slowest fermenting wheat arabinoxylan additionally contained a complex trisaccharide side chain with two arabinoses linked at the O-2 and O-3 positions of an arabinose that is O-2 linked to the xylan backbone. Structural features were proposed for tolerable slowly fermentable arabinoxylan with possible beneficial fermentation function into the distal colon.