After accessing the user's main page, there will be traces of recent visits. If you use a program to crawl all user personal pages, many users' personal pages will show your footprints.
This time, we still use curl mainly because Fiddler can save the session as a curl script, so there's no need to manually construct the HTTP headers.
Based on my attempts, I calculated the speed of curl sending requests. Using just one curl process, it sent 70,000 requests in 14 hours, which is nearly 100 requests per minute under good and stable network conditions.
Chocolatey is very slow, so this time I introduced a new toy - the introduction page of Batch-CN http://www.bathome.net/thread-32322-1-1.html
Batch-CN is a first-party third-party command-line software management tool for Windows, developed and maintained by Chinese people. It can provide various third-party command-line tool downloads, installation management, and viewing of usage instructions for Windows batch processing. It is similar to apt-get in Linux and the similar software package manager Chocolatey in Windows.
After installing Batch-CN, you can complete the download and installation of curl with one line command, and the speed is very fast:
gt curl
Use Fiddler to capture the packet, visit a user's homepage, save the session as a curl script, open xxx.bat in Notepad to get the following line command:
curl -k -i --raw -o 0.dat "https://www.shiyanlou.com/user/1" -H "Host: www.shiyanlou.com" -H "Connection: keep-alive" -H "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" -H "Upgrade-Insecure-Requests: 1" -H "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36" -H "DNT: 1" -H "Referer: https://www.shiyanlou.com/courses/1" -H "Accept-Encoding: gzip, deflate, sdch" -H "Accept-Language: zh-CN,zh;q=0.8,en;q=0.6" -H "Cookie: remember_token=71302|adf71304sdfe82ce1f6c15484f53b0797c60f02e; session=c8eb7ggg-2e8f-4c9c-ab4b-9802a4ea898b.Jz0GE_43ZH_cJjK_7h--gtNw22k"
Make some modifications, use set /a n=%n%+1 to achieve the self-increment of the user ID, and then you can exhaust all user IDs:
@echo off
set n=1
:g
set /a n=%n%+1
echo %n%
curl -k -i --raw -o 0.dat "https://www.shiyanlou.com/user/%n%" -H "Host: www.shiyanlou.com" -H "Connection: keep-alive" -H "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" -H "Upgrade-Insecure-Requests: 1" -H "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36" -H "DNT: 1" -H "Referer: https://www.shiyanlou.com/courses/1" -H "Accept-Encoding: gzip, deflate, sdch" -H "Accept-Language: zh-CN,zh;q=0.8,en;q=0.6" -H "Cookie: remember_token=71302|gggg30497a982ce1f6c15484f53b0797c60f02e; session=gggg7ac5-2e8f-4c9c-ab4b-9802a4ea898b.Jz0GE_43ZH_cJjK_7h--gtNw22k"
goto g
Opening several batch processes means using multiple processes to send requests simultaneously. But eventually, it should lead to account and IP bans.
This time, we still use curl mainly because Fiddler can save the session as a curl script, so there's no need to manually construct the HTTP headers.
Based on my attempts, I calculated the speed of curl sending requests. Using just one curl process, it sent 70,000 requests in 14 hours, which is nearly 100 requests per minute under good and stable network conditions.
Chocolatey is very slow, so this time I introduced a new toy - the introduction page of Batch-CN http://www.bathome.net/thread-32322-1-1.html
Batch-CN is a first-party third-party command-line software management tool for Windows, developed and maintained by Chinese people. It can provide various third-party command-line tool downloads, installation management, and viewing of usage instructions for Windows batch processing. It is similar to apt-get in Linux and the similar software package manager Chocolatey in Windows.
After installing Batch-CN, you can complete the download and installation of curl with one line command, and the speed is very fast:
gt curl
Use Fiddler to capture the packet, visit a user's homepage, save the session as a curl script, open xxx.bat in Notepad to get the following line command:
curl -k -i --raw -o 0.dat "https://www.shiyanlou.com/user/1" -H "Host: www.shiyanlou.com" -H "Connection: keep-alive" -H "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" -H "Upgrade-Insecure-Requests: 1" -H "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36" -H "DNT: 1" -H "Referer: https://www.shiyanlou.com/courses/1" -H "Accept-Encoding: gzip, deflate, sdch" -H "Accept-Language: zh-CN,zh;q=0.8,en;q=0.6" -H "Cookie: remember_token=71302|adf71304sdfe82ce1f6c15484f53b0797c60f02e; session=c8eb7ggg-2e8f-4c9c-ab4b-9802a4ea898b.Jz0GE_43ZH_cJjK_7h--gtNw22k"
Make some modifications, use set /a n=%n%+1 to achieve the self-increment of the user ID, and then you can exhaust all user IDs:
@echo off
set n=1
:g
set /a n=%n%+1
echo %n%
curl -k -i --raw -o 0.dat "https://www.shiyanlou.com/user/%n%" -H "Host: www.shiyanlou.com" -H "Connection: keep-alive" -H "Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8" -H "Upgrade-Insecure-Requests: 1" -H "User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/45.0.2454.101 Safari/537.36" -H "DNT: 1" -H "Referer: https://www.shiyanlou.com/courses/1" -H "Accept-Encoding: gzip, deflate, sdch" -H "Accept-Language: zh-CN,zh;q=0.8,en;q=0.6" -H "Cookie: remember_token=71302|gggg30497a982ce1f6c15484f53b0797c60f02e; session=gggg7ac5-2e8f-4c9c-ab4b-9802a4ea898b.Jz0GE_43ZH_cJjK_7h--gtNw22k"
goto g
Opening several batch processes means using multiple processes to send requests simultaneously. But eventually, it should lead to account and IP bans.
有问题请发论坛或者自行搜索,再短消息问我的统统是SB