Manifestos and "A Void"

In his First and Second Manifestos, Francois Le Lionnais states that people will likely not appreciate lipograms as he feels they should. “People are a little too quick to sneer at acrobatics. Breaking a record in one of these extremely constraining structures can in itself serve to justify the work; the emotion that derives from its semantic aspect constitutes a value which should certainly not be overlooked, but which remains nonetheless secondary.” But why don’t people appreciate works like this? Maybe it can go back to why someone would read a book in the first place. They may want to just relax and enjoy the work. They may be looking to experience an emotion. “A Void” would probably not be a book someone would pick up and read to relax; it makes the reader think. While the book isn’t wrought with emotion, it does provide suspense and humor in some places (my favorite being on page 201 when Amaury is thinking and lists “’La Disparition?’ Or Adair’s translation of it?” Adair is most likely adding a plug for himself into the text). In “A Void,” the sections seem to become easier to understand and add more emotion. Why would Perec write the first section to be the most difficult for the reader to get through when that is when the reader would normally decide whether or not to put the book down?