module documentation
Set User-Agent header per spider or use a default value from settings
Class |
|
This middleware allows spiders to override the user_agent |
Set User-Agent header per spider or use a default value from settings
Class |
|
This middleware allows spiders to override the user_agent |