How do you set your fence shape symbology in Print Organizer to bylevel? It only accepts integers for color, weight and linestyle.
There's no reason to ever set criteria to match a symbolic 'bylevel' value. That would match every shape in a file using the typical bylevel workflow, and thus that symbology should just be left off the search criteria. You can set the color, etc. criteria to an absolute number, and that will be matched against the effective (bylevel resolved) color of each shape in the file.