Hi Maha, welcome to permies! I haven't done too much research on earth bag construction, it didn't seem to fit where I live but I'm pretty sure I've seen photos of earth bag homes with what looked to be traditional window frames with lintels above them. Like this one:
Hopefully someone more knowledgeable can give you a more definitive answer.