The sulfur will help to acidify the soil, which should be OK given the original poster has an alkaline soil. In its sulfate form (as found in gypsum) it may compete for uptake with other anions e.g. nitrates.
Some info here on sulfur:
http://www.spectrumanalytic.com/support/library/ff/S_Basics.htm As permacaper says, gypsum is mainly useful with sodic soils. These soils have a high amount of sodium compared to calcium. By adding calcium a better balance is established, which improves the soil texture, helping to break up clay. But calcium and sodium are salts, so adding too much can cause problems with plant growth.
http://www.soilduck.com/2010/09/soil-myths-3-clay-breaker-is-not-always.html Follow the steps in the link above to do some simple tests to see if your soil is sodic. You already know it is alkaline so that is step 1 taken care of.