I hope it's not the end...already? Sheesh. I mean there are a ton of things beyond that (no reason to count them, you can remember them yourself).
Also, Grimoire arc has been arround for 50 chapters also, and it's kinda normal that the longer one manga lasts the longer its' arcs become. Considering how important this one arc is I think things are going great. Also, if there was noone arround there (in the pitfall palace or however it's called) I would consider it a plothole, I mean a whole kingdom and no security? Things are leading on to the big event quite smoothly, slowly changing. We need rising action anyway if things are to be dramatic.
It's just the weekly basis that kills the mood. If it affects you that much you can put it on hold (honest advice)