Skip to content
Projects
Groups
Snippets
Help
Loading...
Sign in / Register
Toggle navigation
N
network-assets-reptile
Project
Project
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
liyang
network-assets-reptile
Commits
ea343def
Commit
ea343def
authored
Jul 14, 2023
by
liyang
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix:爬虫优化
parent
023912ec
Show whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
6 additions
and
6 deletions
+6
-6
pc_facebook.py
pc_facebook.py
+1
-1
pc_instagram.py
pc_instagram.py
+1
-1
pc_ptt.py
pc_ptt.py
+2
-2
pc_twitter.py
pc_twitter.py
+1
-1
pc_youtube.py
pc_youtube.py
+1
-1
No files found.
pc_facebook.py
View file @
ea343def
...
@@ -217,7 +217,7 @@ def main():
...
@@ -217,7 +217,7 @@ def main():
if
item
[
'name'
]
==
'ptt'
:
if
item
[
'name'
]
==
'ptt'
:
search_word
=
item
[
'keyword'
]
search_word
=
item
[
'keyword'
]
table_name
=
item
[
'tableName'
]
table_name
=
item
[
'tableName'
]
status_task
=
i
tem
[
"status"
]
status_task
=
i
nt
(
item
[
"status"
])
# 简体转繁体
# 简体转繁体
if
status_task
==
0
and
len
(
search_word
)
>
0
:
if
status_task
==
0
and
len
(
search_word
)
>
0
:
reptile
(
None
,
convert_to_traditional
(
search_word
))
reptile
(
None
,
convert_to_traditional
(
search_word
))
...
...
pc_instagram.py
View file @
ea343def
...
@@ -223,7 +223,7 @@ def main():
...
@@ -223,7 +223,7 @@ def main():
if
item
[
'name'
]
==
'ptt'
:
if
item
[
'name'
]
==
'ptt'
:
search_word
=
item
[
'keyword'
]
search_word
=
item
[
'keyword'
]
table_name
=
item
[
'tableName'
]
table_name
=
item
[
'tableName'
]
status_task
=
i
tem
[
"status"
]
status_task
=
i
nt
(
item
[
"status"
])
# 简体转繁体
# 简体转繁体
if
status_task
==
0
and
len
(
search_word
)
>
0
:
if
status_task
==
0
and
len
(
search_word
)
>
0
:
reptile
(
None
,
convert_to_traditional
(
search_word
))
reptile
(
None
,
convert_to_traditional
(
search_word
))
...
...
pc_ptt.py
View file @
ea343def
...
@@ -220,9 +220,9 @@ def main():
...
@@ -220,9 +220,9 @@ def main():
if
item
[
'name'
]
==
'ptt'
:
if
item
[
'name'
]
==
'ptt'
:
search_word
=
item
[
'keyword'
]
search_word
=
item
[
'keyword'
]
table_name
=
item
[
'tableName'
]
table_name
=
item
[
'tableName'
]
status_task
=
i
tem
[
"status"
]
status_task
=
i
nt
(
item
[
"status"
])
# 简体转繁体
# 简体转繁体
if
status_task
==
0
and
len
(
search_word
)
>
0
:
if
status_task
==
0
and
len
(
search_word
)
>
0
:
reptile
(
None
,
convert_to_traditional
(
search_word
))
reptile
(
None
,
convert_to_traditional
(
search_word
))
else
:
else
:
log
.
debug
(
"爬取任务未启用"
)
log
.
debug
(
"爬取任务未启用"
)
...
...
pc_twitter.py
View file @
ea343def
...
@@ -139,7 +139,7 @@ def main():
...
@@ -139,7 +139,7 @@ def main():
if
item
[
'name'
]
==
'ptt'
:
if
item
[
'name'
]
==
'ptt'
:
search_word
=
item
[
'keyword'
]
search_word
=
item
[
'keyword'
]
table_name
=
item
[
'tableName'
]
table_name
=
item
[
'tableName'
]
status_task
=
i
tem
[
"status"
]
status_task
=
i
nt
(
item
[
"status"
])
# 简体转繁体
# 简体转繁体
if
status_task
==
0
and
len
(
search_word
)
>
0
:
if
status_task
==
0
and
len
(
search_word
)
>
0
:
reptile
(
None
,
convert_to_traditional
(
search_word
))
reptile
(
None
,
convert_to_traditional
(
search_word
))
...
...
pc_youtube.py
View file @
ea343def
...
@@ -133,7 +133,7 @@ def main():
...
@@ -133,7 +133,7 @@ def main():
if
item
[
'name'
]
==
'ptt'
:
if
item
[
'name'
]
==
'ptt'
:
search_word
=
item
[
'keyword'
]
search_word
=
item
[
'keyword'
]
table_name
=
item
[
'tableName'
]
table_name
=
item
[
'tableName'
]
status_task
=
i
tem
[
"status"
]
status_task
=
i
nt
(
item
[
"status"
])
# 简体转繁体
# 简体转繁体
if
status_task
==
0
and
len
(
search_word
)
>
0
:
if
status_task
==
0
and
len
(
search_word
)
>
0
:
reptile
(
None
,
convert_to_traditional
(
search_word
))
reptile
(
None
,
convert_to_traditional
(
search_word
))
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment