feature: flexible redirect handling

[roycewilliams]

Allow the user to specify how to treat redirects:

• don't follow redirects
• "dumb" redirect following (counting them towards depth)
• "smart" redirect following (not counting them towards depth)