For me, this would finally be a good use case for bitcoin or similar digital transactions. Let the client provide either proof-of-work or proof-of-payment. If we can make the proof of work match the browsing speed of an average human, anything accessing more pages than that will need to provide payment instead.