FrederikBaerentsen/ComicRack_Scripts
1
0
Fork 0
Code Issues 1 Pull Requests Projects Releases 2 Wiki Activity

Compare commits

base: FrederikBaerentsen:5366e9992d17c82a1981ac4a3ac5c302e4d59ffe
Branches Tags
FrederikBaerentsen:master
FrederikBaerentsen:CVIssueCount.v2.1
FrederikBaerentsen:CVIssueCount.v2.0
...
compare: FrederikBaerentsen:a3ab8b1bd5a9db0d47562643652571797cac62a9
Branches Tags
FrederikBaerentsen:master
FrederikBaerentsen:CVIssueCount.v2.1
FrederikBaerentsen:CVIssueCount.v2.0

3 Commits
5366e9992d ... a3ab8b1bd5

Author SHA1 Message Date
FrederikBaerentsen
a3ab8b1bd5 Updated 20241112 2024-11-12 19:27:22 +01:00
FrederikBaerentsen
73fa811d8d Updated user agent 2024-11-12 16:50:03 +01:00
FrederikBaerentsen
f56a553861 Updated user agent 2024-11-12 16:49:10 +01:00
10 changed files with 144641 additions and 5082 deletions
Show Stats Expand all files Collapse all files

144282
Update Missing/20241112_latest.mcl Normal file
View File

File diff suppressed because one or more lines are too long

5287
Update Missing/Deleted_Comics.txt
View File

File diff suppressed because it is too large Load Diff

6
Update Missing/log/20240926.log
View File

@ -108,3 +108,9 @@ py: Finding Error in comic list: 98%
py: Finding Error in comic list: 99% py: Finding Error in comic list: 99%
sh: Moving old file to archive sh: Moving old file to archive
sh: git add sh: git add
sh: git commit
[master 5366e99] Updated 20240926
3 files changed, 117 insertions(+)
rename Update Missing/{20240925_latest.mcl => archive/20240925.mcl} (100%)
create mode 100644 Update Missing/log/20240926.log
sh: git push

3
Update Missing/log/20240927.log Normal file
View File

@ -0,0 +1,3 @@
log: 20240927
sh: Starting update.sh
sh: Error: cannot latest mcl file

3
Update Missing/log/20240928.log Normal file
View File

@ -0,0 +1,3 @@
log: 20240928
sh: Starting update.sh
sh: Error: cannot latest mcl file

3
Update Missing/log/20240929.log Normal file
View File

@ -0,0 +1,3 @@
log: 20240929
sh: Starting update.sh
sh: Error: cannot latest mcl file

3
Update Missing/log/20240930.log Normal file
View File

@ -0,0 +1,3 @@
log: 20240930
sh: Starting update.sh
sh: Error: cannot latest mcl file

3
Update Missing/log/20241001.log Normal file
View File

@ -0,0 +1,3 @@
log: 20241001
sh: Starting update.sh
sh: Error: cannot latest mcl file

124
Update Missing/log/20241112.log Normal file
View File

@ -0,0 +1,124 @@
log: 20241112
sh: Starting update.sh
py: Reading in current database
py: Querying ComicVine for new issues
py:0/10978 Since 2024-09-25
py:100/10978 Since 2024-09-25
py:200/10978 Since 2024-09-25
py:300/10978 Since 2024-09-25
py:400/10978 Since 2024-09-25
py:500/10978 Since 2024-09-25
py:600/10978 Since 2024-09-25
py:700/10978 Since 2024-09-25
py:800/10978 Since 2024-09-25
py:900/10978 Since 2024-09-25
py:1000/10978 Since 2024-09-25
py: Error. Trying Again...
py:1100/10978 Since 2024-09-25
py:1200/10978 Since 2024-09-25
py:1300/10978 Since 2024-09-25
py:1400/10978 Since 2024-09-25
py:1500/10978 Since 2024-09-25
py:1600/10978 Since 2024-09-25
py:1700/10978 Since 2024-09-25
py:1800/10978 Since 2024-09-25
py:1900/10978 Since 2024-09-25
py:2000/10978 Since 2024-09-25
py:2100/10978 Since 2024-09-25
py:2200/10978 Since 2024-09-25
py:2300/10978 Since 2024-09-25
py:2400/10978 Since 2024-09-25
py:2500/10978 Since 2024-09-25
py:2600/10978 Since 2024-09-25
py:2700/10978 Since 2024-09-25
py:2800/10978 Since 2024-09-25
py:2900/10978 Since 2024-09-25
py:3000/10978 Since 2024-09-25
py:3100/10978 Since 2024-09-25
py:3200/10978 Since 2024-09-25
py:3300/10978 Since 2024-09-25
py:3400/10978 Since 2024-09-25
py:3500/10978 Since 2024-09-25
py:3600/10978 Since 2024-09-25
py:3700/10978 Since 2024-09-25
py:3800/10978 Since 2024-09-25
py:3900/10978 Since 2024-09-25
py:4000/10978 Since 2024-09-25
py:4100/10978 Since 2024-09-25
py:4200/10978 Since 2024-09-25
py:4300/10978 Since 2024-09-25
py:4400/10978 Since 2024-09-25
py:4500/10978 Since 2024-09-25
py:4600/10978 Since 2024-09-25
py:4700/10978 Since 2024-09-25
py:4800/10978 Since 2024-09-25
py:4900/10978 Since 2024-09-25
py:5000/10978 Since 2024-09-25
py:5100/10978 Since 2024-09-25
py:5200/10978 Since 2024-09-25
py:5300/10978 Since 2024-09-25
py:5400/10978 Since 2024-09-25
py:5500/10978 Since 2024-09-25
py:5600/10978 Since 2024-09-25
py:5700/10978 Since 2024-09-25
py:5800/10978 Since 2024-09-25
py:5900/10978 Since 2024-09-25
py:6000/10978 Since 2024-09-25
py:6100/10978 Since 2024-09-25
py:6200/10978 Since 2024-09-25
py:6300/10978 Since 2024-09-25
py:6400/10978 Since 2024-09-25
py:6500/10978 Since 2024-09-25
py:6600/10978 Since 2024-09-25
py:6700/10978 Since 2024-09-25
py:6800/10978 Since 2024-09-25
py:6900/10978 Since 2024-09-25
py:7000/10978 Since 2024-09-25
py:7100/10978 Since 2024-09-25
py:7200/10978 Since 2024-09-25
py:7300/10978 Since 2024-09-25
py:7400/10978 Since 2024-09-25
py:7500/10978 Since 2024-09-25
py:7600/10978 Since 2024-09-25
py:7700/10978 Since 2024-09-25
py:7800/10978 Since 2024-09-25
py:7900/10978 Since 2024-09-25
py:8000/10978 Since 2024-09-25
py:8100/10978 Since 2024-09-25
py:8200/10978 Since 2024-09-25
py:8300/10978 Since 2024-09-25
py:8400/10978 Since 2024-09-25
py:8500/10978 Since 2024-09-25
py:8600/10978 Since 2024-09-25
py:8700/10978 Since 2024-09-25
py:8800/10978 Since 2024-09-25
py:8900/10978 Since 2024-09-25
py:9000/10978 Since 2024-09-25
py:9100/10978 Since 2024-09-25
py:9200/10978 Since 2024-09-25
py:9300/10978 Since 2024-09-25
py:9400/10978 Since 2024-09-25
py:9500/10978 Since 2024-09-25
py:9600/10978 Since 2024-09-25
py:9700/10978 Since 2024-09-25
py:9800/10978 Since 2024-09-25
py:9900/10978 Since 2024-09-25
py:10000/10978 Since 2024-09-25
py:10100/10978 Since 2024-09-25
py:10200/10978 Since 2024-09-25
py:10300/10978 Since 2024-09-25
py:10400/10978 Since 2024-09-25
py:10500/10978 Since 2024-09-25
py:10600/10978 Since 2024-09-25
py:10700/10978 Since 2024-09-25
py:10800/10978 Since 2024-09-25
py:10900/10978 Since 2024-09-25
py: Writing missings to file
py: Writing database to file
py: Done! 5869 comics added to database! (0 skipped and 5109 comics already in database)
py: 1011620 comics in databased not retrieved in this round.
py: 274 comics updated in database.
py: Ids with error in server:
py: 0
sh: Moving old file to archive
sh: git add

9
Update Missing/update_missing.py
View File

@ -43,6 +43,7 @@
import requests import requests
import sys import sys
import os import os
import io
import re import re
from datetime import date,datetime from datetime import date,datetime
@ -108,7 +109,7 @@ for line in comiclist:
comiclist.close() comiclist.close()
print("py: Querying ComicVine for new issues") print("py: Querying ComicVine for new issues")
headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_11_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/50.0.2661.102 Safari/537.36'} headers = {'User-Agent': 'Update Missing/ (https://gitea.baerentsen.space/FrederikBaerentsen/ComicRack_Scripts/src/branch/master/Update Missing)'}
new_comics_cont = 0 new_comics_cont = 0
old_comics_cont = 0 old_comics_cont = 0
updated_comics_cont = 0 updated_comics_cont = 0
@ -205,8 +206,8 @@ deleted_file.close()
print("py: Writing database to file") print("py: Writing database to file")
outfile = open(out_file,"wb") outfile = io.open(out_file,"w",encoding="utf8")
outfile.write(("Missing;" + end_date + "\n").encode()) outfile.write(("Missing;" + end_date + "\n"))
for volume_id in sorted(comics): for volume_id in sorted(comics):
issues = "" issues = ""
@ -215,7 +216,7 @@ for volume_id in sorted(comics):
issues += str(issue_id) + "," issues += str(issue_id) + ","
nums += comics[volume_id][issue_id] + "," nums += comics[volume_id][issue_id] + ","
issues = issues[:-1] issues = issues[:-1]
outfile.write((str(volume_id) + ";" + issues + ";" + nums + "\n").encode()) outfile.write((str(volume_id) + ";" + issues + ";" + nums + "\n"))
outfile.close() outfile.close()