In the first book I have wandered so much from my own adventures to tell of the experiences of my brother that all through the last two chapters I and the curate have been lurking in the empty house at Halliford whither we fled to escape the Black Smoke.

如何理解这里的wander是接宾语so much还是做状语修饰wander？