Chris Williams and Ehsan Mokhtari explain the pros and cons of in-line and in-parallel processes for dealing with bots and spiders.