I'm not clear on a few settings and how they work with the Google Parser:
1) Experimental split algo and Experimental config: what is this for? is it something for internal testing? Is there a time I would want to enable it?
2) Redirect browser max pages: what is the best way to use this? Is a higher or lower setting "better" or slow things down? Sometimes when I use the Redis API I can see a log message saying to increase the number of redirect pages but usually I've found it is best to just decrease the thread count instead.
3) Single redirect browser for task: It is checked by default so I assume that is the optimal configuration but under what conditions would I uncheck it? What is it's purpose/function?
Thanks.
1) Experimental split algo and Experimental config: what is this for? is it something for internal testing? Is there a time I would want to enable it?
2) Redirect browser max pages: what is the best way to use this? Is a higher or lower setting "better" or slow things down? Sometimes when I use the Redis API I can see a log message saying to increase the number of redirect pages but usually I've found it is best to just decrease the thread count instead.
3) Single redirect browser for task: It is checked by default so I assume that is the optimal configuration but under what conditions would I uncheck it? What is it's purpose/function?
Thanks.