My knee
jerk reaction would be to just put a little poison down. A little boric acid has worked great for me.
On the other hand, here's some other ideas:
feed them corn meal. Just leave some near their nest. They'll take it inside and eat it. They can't digest it and it'll eventually kill them. (Wheat flour or dried rice also works)
Citrus (orange or lemon) are good deterrents. Simply spray some near their nest, puree some zest and smear it near the opening. This is only a deterrent though, so it may not fix it.
Chalk works as they don't like calcium carbonate. Again, only a deterrent (draw a line around their path or nest.
Apparently putting cayenne pepper into their nest also works. This may cause an exodus though, so stand by with a spray bottle of vinegar (slightly watered down) and have at them
Good luck!
video:
http://www.howcast.com/videos/356268-How-to-Get-Rid-of-Ants-Naturally