Copying webpage content - China DOS Union Forum - China DOS Union

Search the forum for wget or curl, both can handle this kind of need.
Maybe wget and curl each have some unique special uses, but judging from the examples on the forum, more of them are still applications of batch commands. To be honest, I'm especially slow-witted, and although some implementations look wonderful, trying to imitate them myself is very difficult.

For website data collection, I suggest everyone use topfisher, an online real-time data collection system based on a scripting language. It has its own function library, and some things look much easier to understand than those strange batch-processing tricks.

http://www.topfisher.com/

Floor1　dwlzz	Posted 2008-09-30 17:07
初级用户　Posts 22　Credits 61
How can I use a batch file to copy webpage content? For example, if I want to save the content of the webpage www.163.com to a.txt, please advise, thanks.

Floor2　hackate	Posted 2008-09-30 19:08
中级用户　Posts 125　Credits 228
Do you want to retrieve and save the website's HTML code?

Floor3　dwlzz	Posted 2008-09-30 20:19
初级用户　Posts 22　Credits 61
Yes, please give me some advice.

Floor4　dato	Posted 2008-09-30 22:16
高级用户　Posts 377　Credits 916
Search the forum for wget or curl, both can handle this kind of need. Maybe wget and curl each have some unique special uses, but judging from the examples on the forum, more of them are still applications of batch commands. To be honest, I'm especially slow-witted, and although some implementations look wonderful, trying to imitate them myself is very difficult. For website data collection, I suggest everyone use topfisher, an online real-time data collection system based on a scripting language. It has its own function library, and some things look much easier to understand than those strange batch-processing tricks. http://www.topfisher.com/

Floor5　zqz0012005	Posted 2008-10-01 00:35
中级用户　Posts 135　Credits 297