Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in / Register
Toggle navigation
N
network-assets-reptile
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
liyang
network-assets-reptile
Commits
d3e9756c
Commit
d3e9756c
authored
Jul 11, 2023
by
liyang
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix:爬取数据入库
parent
c6a3aff0
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
2 additions
and
309 deletions
+2
-309
app.log
app.log
+0
-309
pc_ptt.py
pc_ptt.py
+2
-0
.gitkeep
reptile_data/.gitkeep
+0
-0
.gitkeep
reptile_data/ptt/.gitkeep
+0
-0
No files found.
app.log
View file @
d3e9756c
This diff is collapsed.
Click to expand it.
pc_ptt.py
View file @
d3e9756c
...
@@ -138,6 +138,8 @@ def reptile(browser=None, search_word=""):
...
@@ -138,6 +138,8 @@ def reptile(browser=None, search_word=""):
classify_item_list
=
browser
.
find_elements
(
'xpath'
,
"//div[@class='board-class']"
)
classify_item_list
=
browser
.
find_elements
(
'xpath'
,
"//div[@class='board-class']"
)
# 发送爬取数据到java服务
# 发送爬取数据到java服务
# print('----------------------')
# print(data)
if
len
(
data
)
>
0
:
if
len
(
data
)
>
0
:
# 保存json文件到本地
# 保存json文件到本地
log
.
debug
(
os
.
path
.
abspath
(
"../"
))
log
.
debug
(
os
.
path
.
abspath
(
"../"
))
...
...
reptile_data/.gitkeep
deleted
100644 → 0
View file @
c6a3aff0
reptile_data/ptt/.gitkeep
deleted
100644 → 0
View file @
c6a3aff0
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment