Skip to content

N
network-assets-reptile
Commit d3e9756c authored by liyang's avatar liyang
Browse files
Options

fix:爬取数据入库

parent c6a3aff0
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 309 deletions
app.log
View file @ d3e9756c
2023-07-05 11:27:57,417 - DEBUG - --headless
2023-07-05 11:28:40,633 - DEBUG - 循环处理
2023-07-05 11:28:40,634 - DEBUG - --headless
2023-07-05 11:35:13,975 - INFO - 循环处理
2023-07-05 11:35:13,975 - DEBUG - --headless
2023-07-05 11:35:38,912 - INFO - 循环处理
2023-07-05 11:35:38,912 - DEBUG - --headless
2023-07-05 11:36:41,407 - DEBUG - 9999999
2023-07-05 11:36:41,408 - DEBUG - --headless
2023-07-10 08:52:00,070 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688943909.A.160.html
2023-07-10 08:52:00,167 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:08,178 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944135.A.120.html
2023-07-10 08:52:08,389 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:10,660 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944364.A.C5D.html
2023-07-10 08:52:10,716 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:11,935 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944381.A.370.html
2023-07-10 08:52:11,985 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:13,214 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944935.A.046.html
2023-07-10 08:52:13,280 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:14,498 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945079.A.740.html
2023-07-10 08:52:14,553 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:15,770 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945815.A.283.html
2023-07-10 08:52:15,820 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:17,035 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945938.A.6A1.html
2023-07-10 08:52:17,080 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:18,310 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946207.A.55A.html
2023-07-10 08:52:18,356 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:19,583 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946351.A.6B4.html
2023-07-10 08:52:19,648 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:20,859 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946520.A.ADA.html
2023-07-10 08:52:20,907 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:22,121 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946964.A.FC4.html
2023-07-10 08:52:22,176 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:23,395 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688947237.A.A45.html
2023-07-10 08:52:23,451 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:24,672 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688947713.A.ED9.html
2023-07-10 08:52:24,741 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:25,951 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948382.A.C68.html
2023-07-10 08:52:26,002 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:27,222 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948483.A.96C.html
2023-07-10 08:52:27,269 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:28,481 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948765.A.78F.html
2023-07-10 08:52:28,524 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:29,746 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949303.A.C3F.html
2023-07-10 08:52:29,788 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:31,004 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949332.A.BF0.html
2023-07-10 08:52:31,050 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:32,270 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949859.A.1DA.html
2023-07-10 08:52:32,309 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:33,562 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1682302756.A.ABE.html
2023-07-10 08:52:33,701 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:35,435 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1680166918.A.D62.html
2023-07-10 08:52:36,510 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:37,797 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1686738116.A.922.html
2023-07-10 08:52:37,882 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:39,112 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688142013.A.550.html
2023-07-10 08:52:39,362 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:40,582 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688836841.A.B7E.html
2023-07-10 08:52:40,648 - DEBUG - 未找到匹配的字符串
2023-07-10 08:52:42,009 - DEBUG - 调用成功
2023-07-10 08:53:46,462 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688943909.A.160.html
2023-07-10 08:53:46,556 - DEBUG - 未找到匹配的字符串
2023-07-10 08:53:54,168 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944135.A.120.html
2023-07-10 08:53:54,392 - DEBUG - 未找到匹配的字符串
2023-07-10 08:53:56,652 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944364.A.C5D.html
2023-07-10 08:53:56,708 - DEBUG - 未找到匹配的字符串
2023-07-10 08:53:57,927 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944381.A.370.html
2023-07-10 08:53:57,978 - DEBUG - 未找到匹配的字符串
2023-07-10 08:53:59,199 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688944935.A.046.html
2023-07-10 08:53:59,263 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:00,500 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945079.A.740.html
2023-07-10 08:54:00,554 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:01,785 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945815.A.283.html
2023-07-10 08:54:01,833 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:03,045 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688945938.A.6A1.html
2023-07-10 08:54:03,088 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:04,318 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946207.A.55A.html
2023-07-10 08:54:04,365 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:05,585 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946351.A.6B4.html
2023-07-10 08:54:05,652 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:06,871 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946520.A.ADA.html
2023-07-10 08:54:06,919 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:08,141 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688946964.A.FC4.html
2023-07-10 08:54:08,198 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:09,417 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688947237.A.A45.html
2023-07-10 08:54:09,470 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:10,677 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688947713.A.ED9.html
2023-07-10 08:54:10,747 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:11,956 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948382.A.C68.html
2023-07-10 08:54:12,006 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:13,219 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948483.A.96C.html
2023-07-10 08:54:13,266 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:14,484 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688948765.A.78F.html
2023-07-10 08:54:14,525 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:15,746 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949303.A.C3F.html
2023-07-10 08:54:15,789 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:17,005 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949332.A.BF0.html
2023-07-10 08:54:17,050 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:18,271 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688949859.A.1DA.html
2023-07-10 08:54:18,310 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:19,562 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1682302756.A.ABE.html
2023-07-10 08:54:19,693 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:21,479 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1680166918.A.D62.html
2023-07-10 08:54:22,543 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:23,813 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1686738116.A.922.html
2023-07-10 08:54:23,899 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:25,140 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688142013.A.550.html
2023-07-10 08:54:25,374 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:26,595 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688836841.A.B7E.html
2023-07-10 08:54:26,660 - DEBUG - 未找到匹配的字符串
2023-07-10 08:54:27,774 - DEBUG - 数据为空
2023-07-10 09:05:24,225 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950429.A.221.html
2023-07-10 09:05:24,225 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950429.A.221.html
2023-07-10 09:05:24,290 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:24,290 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:25,511 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950594.A.524.html
2023-07-10 09:05:25,511 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950594.A.524.html
2023-07-10 09:05:25,556 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:25,556 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:26,778 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950650.A.BAF.html
2023-07-10 09:05:26,778 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950650.A.BAF.html
2023-07-10 09:05:26,822 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:26,822 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:28,040 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950717.A.3DA.html
2023-07-10 09:05:28,040 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950717.A.3DA.html
2023-07-10 09:05:28,085 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:28,085 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:29,310 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950922.A.51F.html
2023-07-10 09:05:29,310 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950922.A.51F.html
2023-07-10 09:05:29,352 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:29,352 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:30,569 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950989.A.85D.html
2023-07-10 09:05:30,569 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688950989.A.85D.html
2023-07-10 09:05:30,612 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:30,612 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:31,878 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1682302756.A.ABE.html
2023-07-10 09:05:31,878 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1682302756.A.ABE.html
2023-07-10 09:05:32,012 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:32,012 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:34,504 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1680166918.A.D62.html
2023-07-10 09:05:34,504 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1680166918.A.D62.html
2023-07-10 09:05:35,583 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:35,583 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:36,868 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1686738116.A.922.html
2023-07-10 09:05:36,868 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1686738116.A.922.html
2023-07-10 09:05:36,959 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:36,959 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:38,179 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688142013.A.550.html
2023-07-10 09:05:38,179 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688142013.A.550.html
2023-07-10 09:05:38,376 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:38,376 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:39,587 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688836841.A.B7E.html
2023-07-10 09:05:39,587 - DEBUG - 网页链接https://www.ptt.cc/bbs/C_Chat/M.1688836841.A.B7E.html
2023-07-10 09:05:39,654 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:39,654 - DEBUG - 未找到匹配的字符串
2023-07-10 09:05:40,768 - DEBUG - 数据为空
2023-07-10 09:05:40,768 - DEBUG - 数据为空
2023-07-10 09:08:23,702 - DEBUG - aaaa
2023-07-10 09:08:23,702 - DEBUG - aaaa
2023-07-10 09:08:23,702 - INFO - aaaa
2023-07-10 09:08:23,702 - INFO - aaaa
2023-07-10 09:08:23,702 - WARNING - aaaa
2023-07-10 09:08:23,702 - WARNING - aaaa
2023-07-10 09:08:23,702 - ERROR - aaaa
2023-07-10 09:08:23,702 - ERROR - aaaa
2023-07-10 18:51:20,682 DEBUG pc_ptt.py : main [line: 187] 调用成功
2023-07-10 18:51:28,446 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985401.A.746.html
2023-07-10 18:51:28,524 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 18:51:29,740 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985588.A.3E1.html
2023-07-10 18:51:29,849 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 18:51:31,061 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985742.A.9F7.html
2023-07-10 18:51:31,107 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 18:51:32,309 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985757.A.1A0.html
2023-07-10 18:51:32,344 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 18:51:33,608 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1634212242.A.283.html
2023-07-10 18:51:34,715 DEBUG pc_ptt.py : reptile [line: 157] 文件保存成功
2023-07-10 20:02:29,648 DEBUG pc_ptt.py : main [line: 191] 调用成功
2023-07-10 20:02:35,299 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985401.A.746.html
2023-07-10 20:02:35,393 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:36,651 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985588.A.3E1.html
2023-07-10 20:02:36,793 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:38,065 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985742.A.9F7.html
2023-07-10 20:02:38,409 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:41,324 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985757.A.1A0.html
2023-07-10 20:02:41,422 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:43,358 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986363.A.26C.html
2023-07-10 20:02:43,397 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:44,974 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986405.A.AE8.html
2023-07-10 20:02:45,043 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:46,310 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688987475.A.287.html
2023-07-10 20:02:46,477 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:47,731 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988086.A.71A.html
2023-07-10 20:02:47,945 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:49,181 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988399.A.239.html
2023-07-10 20:02:49,267 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:50,526 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989302.A.DC2.html
2023-07-10 20:02:50,571 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:51,801 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989333.A.D7E.html
2023-07-10 20:02:51,864 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:53,120 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989708.A.366.html
2023-07-10 20:02:53,191 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:54,424 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989758.A.6EE.html
2023-07-10 20:02:54,484 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:55,704 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990129.A.D9F.html
2023-07-10 20:02:55,752 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:56,991 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990257.A.C10.html
2023-07-10 20:02:57,027 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:02:58,298 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1634212242.A.283.html
2023-07-10 20:02:59,443 DEBUG pc_ptt.py : reptile [line: 153] /Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile
2023-07-10 20:02:59,444 DEBUG filse.py : save_json [line: 8] ------save json start--------
2023-07-10 20:02:59,444 DEBUG filse.py : save_json [line: 14] 文件保存路径:/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688990579/.json
2023-07-10 20:02:59,445 DEBUG pc_ptt.py : reptile [line: 157] -----------------------------
2023-07-10 20:02:59,446 DEBUG pc_ptt.py : reptile [line: 169] 文件保存失败
2023-07-10 20:03:50,363 DEBUG pc_ptt.py : main [line: 191] 调用成功
2023-07-10 20:03:56,814 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985401.A.746.html
2023-07-10 20:03:56,921 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:03:58,153 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985588.A.3E1.html
2023-07-10 20:03:58,296 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:03:59,914 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985742.A.9F7.html
2023-07-10 20:04:00,284 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:02,948 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985757.A.1A0.html
2023-07-10 20:04:03,064 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:04,898 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986363.A.26C.html
2023-07-10 20:04:04,935 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:06,196 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986405.A.AE8.html
2023-07-10 20:04:06,262 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:07,485 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688987475.A.287.html
2023-07-10 20:04:07,648 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:08,921 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988086.A.71A.html
2023-07-10 20:04:09,150 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:10,360 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988399.A.239.html
2023-07-10 20:04:10,447 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:11,658 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989302.A.DC2.html
2023-07-10 20:04:11,702 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:12,932 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989333.A.D7E.html
2023-07-10 20:04:12,996 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:14,206 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989708.A.366.html
2023-07-10 20:04:14,275 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:15,468 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989758.A.6EE.html
2023-07-10 20:04:15,528 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:16,746 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990129.A.D9F.html
2023-07-10 20:04:16,793 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:18,013 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990257.A.C10.html
2023-07-10 20:04:18,048 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:04:19,282 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1634212242.A.283.html
2023-07-10 20:04:20,403 DEBUG pc_ptt.py : reptile [line: 153] /Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile
2023-07-10 20:04:20,404 DEBUG filse.py : save_json [line: 8] ------save json start--------
2023-07-10 20:04:20,404 DEBUG filse.py : save_json [line: 14] 文件保存路径:/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688990660.json
2023-07-10 20:04:20,404 DEBUG pc_ptt.py : reptile [line: 157] -----------------------------
2023-07-10 20:04:20,405 DEBUG pc_ptt.py : reptile [line: 160] 文件保存成功
2023-07-10 20:04:20,405 DEBUG pc_ptt.py : reptile [line: 162] 文件绝对路径：/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688990660.json
2023-07-10 20:06:41,079 DEBUG pc_ptt.py : main [line: 191] 调用成功
2023-07-10 20:06:46,744 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985401.A.746.html
2023-07-10 20:06:46,837 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:48,093 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985588.A.3E1.html
2023-07-10 20:06:48,237 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:49,493 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985742.A.9F7.html
2023-07-10 20:06:49,828 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:52,636 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688985757.A.1A0.html
2023-07-10 20:06:54,544 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986363.A.26C.html
2023-07-10 20:06:54,577 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:55,838 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688986405.A.AE8.html
2023-07-10 20:06:55,908 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:57,143 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688987475.A.287.html
2023-07-10 20:06:57,307 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:06:58,532 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988086.A.71A.html
2023-07-10 20:06:59,975 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688988399.A.239.html
2023-07-10 20:07:01,256 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989302.A.DC2.html
2023-07-10 20:07:01,301 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:07:02,510 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989333.A.D7E.html
2023-07-10 20:07:02,566 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:07:03,780 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989708.A.366.html
2023-07-10 20:07:03,849 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:07:05,051 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688989758.A.6EE.html
2023-07-10 20:07:06,597 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990129.A.D9F.html
2023-07-10 20:07:06,646 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:07:08,410 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688990257.A.C10.html
2023-07-10 20:07:09,672 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1634212242.A.283.html
2023-07-10 20:07:10,797 DEBUG pc_ptt.py : reptile [line: 153] /Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile
2023-07-10 20:07:10,797 DEBUG filse.py : save_json [line: 8] ------save json start--------
2023-07-10 20:07:10,798 DEBUG filse.py : save_json [line: 14] 文件保存路径:/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688990830.json
2023-07-10 20:07:10,800 DEBUG pc_ptt.py : reptile [line: 157] -----------------------------
2023-07-10 20:07:10,800 DEBUG pc_ptt.py : reptile [line: 160] 文件保存成功
2023-07-10 20:07:10,801 DEBUG pc_ptt.py : reptile [line: 162] 文件绝对路径：/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688990830.json
2023-07-10 20:53:30,796 DEBUG pc_ptt.py : main [line: 191] call success
2023-07-10 20:53:37,765 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688991749.A.198.html
2023-07-10 20:53:40,542 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688991994.A.D59.html
2023-07-10 20:53:40,583 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:42,508 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688991995.A.4CE.html
2023-07-10 20:53:42,546 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:44,395 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688991995.A.797.html
2023-07-10 20:53:44,433 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:45,741 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688992089.A.50C.html
2023-07-10 20:53:47,085 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688992768.A.CC7.html
2023-07-10 20:53:48,390 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688993164.A.DB1.html
2023-07-10 20:53:48,428 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:49,690 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688993204.A.E97.html
2023-07-10 20:53:49,727 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:51,003 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688993233.A.0E7.html
2023-07-10 20:53:51,041 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:52,275 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1688993306.A.8D6.html
2023-07-10 20:53:52,314 DEBUG pc_ptt.py : reptile [line: 127] 未找到匹配的字符串
2023-07-10 20:53:53,630 DEBUG pc_ptt.py : reptile [line: 88] 网页链接https://www.ptt.cc/bbs/Baseball/M.1634212242.A.283.html
2023-07-10 20:53:54,783 DEBUG pc_ptt.py : reptile [line: 153] /Users/macosx/Desktop/项目文档/网络资产管理系统
2023-07-10 20:53:54,784 DEBUG filse.py : save_json [line: 8] ------save json start--------
2023-07-10 20:53:54,784 DEBUG filse.py : save_json [line: 14] 文件保存路径:/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688993634.json
2023-07-10 20:53:54,786 DEBUG pc_ptt.py : reptile [line: 157] -----------------------------
2023-07-10 20:53:54,786 DEBUG pc_ptt.py : reptile [line: 160] save file success
2023-07-10 20:53:54,786 DEBUG pc_ptt.py : reptile [line: 162] file_path：/Users/macosx/Desktop/项目文档/网络资产管理系统/network-assets-reptile/reptile_data/ptt/1688993634.json
pc_ptt.py
View file @ d3e9756c
......@@ -138,6 +138,8 @@ def reptile(browser=None, search_word=""):
classify_item_list = browser.find_elements('xpath', "//div[@class='board-class']")
# 发送爬取数据到java服务
# print('----------------------')
# print(data)
if len(data) > 0:
# 保存json文件到本地
log.debug(os.path.abspath("../"))
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment