Er...Uhmmm...Allen?...Buddy...
I know exactly what is meant by "light grey potters clay," or at least about 98% sure. This is a mid ranged bodied clay used for general purpose ceramics, fired up to about cone 6 (7 tops for most types.)
It is not remotely close to saying you have a "...Car Automobile..." as this is just one form of clay body and can be augmented with others for various application and effects in a ceramic piece. Typically (but not always) these are lower firing clay when described this way, yet could be (this is my 2% from above) a grey porcelain clay body. which of course is much finer and can be fired at very high temperatures.
I would suggest that Renny make sure this is actually a ceramists clay and not something else....Such as your suggested bucket of "silt."...
The adding of a "grog" would not necessarily make it a stoneware, but would render a stronger body and perhaps a cone or so of more heat tolerance.
Sorry to sound so..."Proffessory"...on this subject but saying the word "fire clay" is actually the part that is like saying "car automobile."
"Fire clay" is an exceedingly generic term when used outside of specific context. As "red terracotta clay" is also a "fire clay." All "fire clay" suggests, when just said generically in a sentence without context, is a clay that is capable of forming a clay body that can be fired to a bisque and/or other level of vitrification...Nothing more or less, generically than that.
Expansion rates, and other physical, thermal and chemical characteristics are all augmented by the "type of clay body," added ingredients like paper pulp as just one example, and other chemicals and minerals additives do not stop any from being "fire clay."
Now...back to Renny's question. (Please forgive me Allen for being so silly above...

)
Yes, with perhaps a little sand added and some experimentation, with some more research/reading on
Kiln Mortars you can use your "bucket of grey clay." I would disregard any that suggest using OPC in the blend as Allen has so wisely warned against...Cement/protland is just not required at all for the making of "kiln mortars" or building of ovens and kilns of any type.
Regards,
j