I have a NET:HTTP preset that queries Google and downloads the raw html.
Is it possible to save the whole page and at the same time also parse the $link and $anchor data and save to a txt file like with the Google Parser?
I assume it would require some regex to get the $anchor and $link data but I also don't know how to format the results to both download the data and parse it at the same time.
I would just use the Google Parser but for whatever reason I get much better performance using Net:HTTP with the one group of proxies I am using.
Here is my current preset:
Let me know if I should submit this as a paid task.
Thanks.
Is it possible to save the whole page and at the same time also parse the $link and $anchor data and save to a txt file like with the Google Parser?
I assume it would require some regex to get the $anchor and $link data but I also don't know how to format the results to both download the data and parse it at the same time.
I would just use the Google Parser but for whatever reason I get much better performance using Net:HTTP with the one group of proxies I am using.
Here is my current preset:
eJyNVm1vGjkQ/iuW1YbkRHeXJuFyIHRKuaZvCeQCUT8EhNzdYfHhtTe2NyRH+e8d
m82yqa7JoSjC43lmnnk1a2qZWZpLDQasoZ2bNc39d9qhA7Cdzsfx+JJ8UCoVQJs0
Z9qAdno3u2uUJzBnhbC0uab2IQcEqzvQmicOxBM8p0olfeXPd0wUqHLzNoqmm18j
CvT0hqUg7Q5DL9S/XAgWHgcR2f/KZaJWhgzGpBUFUZegoH3UJfftowNymucCvsK3
L9yGx4e/B4dtsv/l4/jivEkEXwL5APFSHZD+QqsMwpOTIAqODt8eBa2TNhmxOdO8
hNFnOOZa3T9osJqDqbFsRVH0IuwbkxKSWACTRV4DP4u0PANV1DPSflYfk+id7QBW
F/AMQMNtAcYmINjD/yXlPfQXmFDQNcxvTzC55UqaR0jstPtK2qflXdhMEG4hM7HK
oTehE+qPzgieFtbmnTA0iM5YoHQajoDpeHEFBrvPXGK3IEAwmaIyyAlF0yxJuHPN
BO2sn/i9YDZejD291mYznTYxeG/nTOmMuQm4eU0+nZG8FXA5V4Ep4hiMIb0eaXUn
cmLxImGWkRlBoiigKH0/+Av/X4/eEzS/wK8J16TnD2jF7mN29UMgi4yE5I8oOiCv
p7RyPGJ3MFboeM79uD3ywdOAZfAyI7zbOhB3wkkjlBL8TGyNESk/LzArNbcBTWwD
xzGfabYKC/OmgTE7+Iw0Qvd9i12unCBwRWx0EbeNbVeAbV6328Nik83mjIvwejR7
hWkEF3Mw9yr7B4G9d33xy3Ajz2lCXz16ruV/69b91Wp6LfmtbzGp8MahcGTPcPbd
UIF35k091v7G+b7F/FShfSeF5ujhv3LccJ1psDVXq1WQ+m0ZxCoolqHxDfrnbc+n
yeVnL1+ZXrSXil5h9jDdveOosSOOjAtP9e8txe3ANqnB1jjDdEFSXcyZMHiD86GZ
VXpYThh2uZKnQpzDHYgK7ym/K7hIcH+fzhHzqcRVhp6oDH82salSWXeEm2ClkUFl
xJ/eDS9KAaISda7Sx8QLnnGLZ9NXhbR+sTTpEiCv6jNwapnSULkpLZfe8anKQbod
shsQ3PWV6EkU/kEzqtCxM+2vUKVcSQbXtkxHueCu+rgoWZkP2nVKyjXBcuVeN67p
dLPrpZp1FMZKznk6LHdiKdSFHOPDOpR9leE75BIkCyGabiFf7ab61JTVdIddpD+D
+94FEqveWaSnhPk82saca45sjx3BDEtS91qajJkQ11fn9Ru6mwM/A8aZjXEQU4VZ
wihcxOWDX/0+WNee/c56g+X9B9eu13EhOA2UYS4M1s7t1R/kVcmc
m82yqa7JoSjC43lmnnk1a2qZWZpLDQasoZ2bNc39d9qhA7Cdzsfx+JJ8UCoVQJs0
Z9qAdno3u2uUJzBnhbC0uab2IQcEqzvQmicOxBM8p0olfeXPd0wUqHLzNoqmm18j
CvT0hqUg7Q5DL9S/XAgWHgcR2f/KZaJWhgzGpBUFUZegoH3UJfftowNymucCvsK3
L9yGx4e/B4dtsv/l4/jivEkEXwL5APFSHZD+QqsMwpOTIAqODt8eBa2TNhmxOdO8
hNFnOOZa3T9osJqDqbFsRVH0IuwbkxKSWACTRV4DP4u0PANV1DPSflYfk+id7QBW
F/AMQMNtAcYmINjD/yXlPfQXmFDQNcxvTzC55UqaR0jstPtK2qflXdhMEG4hM7HK
oTehE+qPzgieFtbmnTA0iM5YoHQajoDpeHEFBrvPXGK3IEAwmaIyyAlF0yxJuHPN
BO2sn/i9YDZejD291mYznTYxeG/nTOmMuQm4eU0+nZG8FXA5V4Ep4hiMIb0eaXUn
cmLxImGWkRlBoiigKH0/+Av/X4/eEzS/wK8J16TnD2jF7mN29UMgi4yE5I8oOiCv
p7RyPGJ3MFboeM79uD3ywdOAZfAyI7zbOhB3wkkjlBL8TGyNESk/LzArNbcBTWwD
xzGfabYKC/OmgTE7+Iw0Qvd9i12unCBwRWx0EbeNbVeAbV6328Nik83mjIvwejR7
hWkEF3Mw9yr7B4G9d33xy3Ajz2lCXz16ruV/69b91Wp6LfmtbzGp8MahcGTPcPbd
UIF35k091v7G+b7F/FShfSeF5ujhv3LccJ1psDVXq1WQ+m0ZxCoolqHxDfrnbc+n
yeVnL1+ZXrSXil5h9jDdveOosSOOjAtP9e8txe3ANqnB1jjDdEFSXcyZMHiD86GZ
VXpYThh2uZKnQpzDHYgK7ym/K7hIcH+fzhHzqcRVhp6oDH82salSWXeEm2ClkUFl
xJ/eDS9KAaISda7Sx8QLnnGLZ9NXhbR+sTTpEiCv6jNwapnSULkpLZfe8anKQbod
shsQ3PWV6EkU/kEzqtCxM+2vUKVcSQbXtkxHueCu+rgoWZkP2nVKyjXBcuVeN67p
dLPrpZp1FMZKznk6LHdiKdSFHOPDOpR9leE75BIkCyGabiFf7ab61JTVdIddpD+D
+94FEqveWaSnhPk82saca45sjx3BDEtS91qajJkQ11fn9Ru6mwM/A8aZjXEQU4VZ
wihcxOWDX/0+WNee/c56g+X9B9eu13EhOA2UYS4M1s7t1R/kVcmc
Let me know if I should submit this as a paid task.
Thanks.
