Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in / Register
Toggle navigation
N
network-assets-reptile
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
liyang
network-assets-reptile
Commits
49d4d216
Commit
49d4d216
authored
Jul 11, 2023
by
liyang
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix:爬取数据入库
parent
7dc66ff2
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
12 deletions
+13
-12
pc_ptt.py
pc_ptt.py
+13
-12
No files found.
pc_ptt.py
View file @
49d4d216
...
...
@@ -146,26 +146,27 @@ def reptile(browser=None, search_word=""):
file_dir
=
f
'{os.path.join(os.path.abspath("../"), "network-assets-reptile", "reptile_data", "ptt", str(int(time.time())) + ".json")}'
# file_dir = f'./reptile_data/ptt/{int(time.time())}.json'
state_save
=
save_json
(
file_dir
,
data
)
log
.
debug
(
"-----------------------------"
)
#
log.debug("-----------------------------")
# write_to_database(data)
if
state_save
:
log
.
debug
(
'save file success'
)
# path = os.path.abspath(file_dir).join(file_dir).join(".json")
log
.
debug
(
'file_path:'
+
file_dir
)
form_data
=
{
"path"
:
file_dir
,
"tableName"
:
table_name
}
response
=
importJsonPath
(
form_data
)
#
log.debug('file_path:' + file_dir)
#
form_data = {
#
"path": file_dir,
#
"tableName": table_name
#
}
#
response = importJsonPath(form_data)
else
:
log
.
debug
(
'save file failed'
)
else
:
# 爬取数据为空
form_data
=
{
"path"
:
""
,
"tableName"
:
table_name
}
response
=
importJsonPath
(
form_data
)
log
.
info
(
"未爬取到数据"
)
# form_data = {
# "path": "",
# "tableName": table_name
# }
# response = importJsonPath(form_data)
# 关闭浏览器驱动
# time.sleep(3)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment