I think that perhaps he said that defensively, because so many people could not make head or tail of the film.
But I have not read the comic books, had not read anything explaining the story to me, and though I did have to concentrate I understood it. It is complex, but brilliant, rich, mind-blowing, radical, exhilarating.
It makes perfect sense if you watch carefully from the very start, ( the first fifteen minutes or so, which I have just read someone on imdb say is actually a perfectly good recap of the backstory in the books ).
I imagine a lot of people are shocked by the amount of attention it requires. But it is wonderful.
.