Commit graph

69 commits

Author SHA1 Message Date
AnonymousRandomPerson
7ae945603f Fixed whiteout extension for entries only on 164 2022-05-14 11:38:31 -04:00
AnonymousRandomPerson
72829f392b Sort image keys and extend to whiteout in formatter 2022-05-13 19:06:18 -04:00
Cheng Hann Gan
d92eb66102 Revert "Revert "Removed unused contributors field from JSON""
This reverts commit 6a2b409fe5.

We need a proper discussion. Until then, this commit will stay.
2022-05-13 13:19:43 -04:00
Hans5958
6a2b409fe5 Revert "Removed unused contributors field from JSON"
This reverts commit 5deedbdea0.

ART, I'm not sure what is your intention, but it seems you are quite persistent. Please don't be distruptive.
2022-05-13 23:58:24 +07:00
Cheng Hann Gan
d90baab00a Revert "Revert "Removed unused contributors field from JSON""
This reverts commit 7f735f9abc.
2022-05-13 10:16:50 -04:00
Hans5958
7f735f9abc Revert "Removed unused contributors field from JSON"
This reverts commit 5deedbdea0.
2022-05-13 21:06:50 +07:00
Cheng Hann Gan
5deedbdea0 Removed unused contributors field from JSON 2022-05-12 12:45:56 -04:00
Cheng Hann Gan
dd97861520 Remove center recalculation from formatter 2022-05-12 12:37:18 -04:00
Cheng Hann Gan
1b2551a178 Remove old format from formatter 2022-05-12 12:37:05 -04:00
Hans5958
4916f37100 Little documentation, catch exceptions, convert discord links 2022-05-12 16:28:00 +07:00
Hans5958
8019a27a45 Fix commatization regex 2022-04-29 17:12:40 +07:00
Hans5958
710d4a7c6a Little rewrite on migrator, migrate submissions if needed, add writing log 2022-04-25 15:50:26 +07:00
Hans5958
74b8073a7b Do stricter (and proper) subreddit regex 2
I forgot that I made it so it excludes underscore, here's a proper fix
2022-04-19 16:42:20 +07:00
Hans5958
1bca3bb9c5 Do stricter (and proper) subreddit regex
3-21 instead of 1-20
2022-04-19 16:34:52 +07:00
Hans5958
37bfe79d3e Fix crawler and merger script, fix typo of formatter 2022-04-19 08:55:37 +07:00
Hans5958
bbf6703df2 Print formatter log every 200 due to slowdown 2022-04-17 14:38:53 +07:00
Hans5958
9b7baca08a
Merge pull request #1165 from fabi321/fix-line-end
Fixed platform specific behaviour in format.py
2022-04-17 14:30:28 +07:00
Hans5958
2f417e433a Optimize new center algo a little bit
incl. Don't use modules
2022-04-17 14:12:34 +07:00
Fabian Wunsch
a80f070173
Merge branch 'remaster' into fix-line-end 2022-04-17 09:12:12 +02:00
Hans5958
41e29c1abb
Merge branch 'remaster' into new-center-algorithm 2022-04-17 13:39:14 +07:00
Hans5958
03c6748d02 Fix bugs on formatter 2022-04-17 13:36:19 +07:00
Fabian Wunsch
c01610774d
Merge branch 'remaster' into new-center-algorithm 2022-04-17 08:31:51 +02:00
Hans5958
49a0c85c27 Fix pattern to compensate R/ on links object 2022-04-17 13:18:43 +07:00
Hans5958
d93c2ed5a5 Use specific pattern for new format subreddits 2022-04-17 13:12:22 +07:00
Hans5958
bb2704c2d2 Formatter support for new format 2022-04-16 22:25:11 +07:00
Fabian Wunsch
95c706f95a Small bugfix 2022-04-12 08:14:56 +02:00
Fabian Wunsch
d819cfb313 Changed the algorithm to calculate the center
this is the version from Mapbox, just to see how well it performs. It
definitely needs improvements as of now. I'm going to include the
atlas.json, but it will be excluded once the pr is ready to be merged
2022-04-12 08:14:10 +02:00
Fabian Wunsch
ed084ac936 Fixed logical indentation error 2022-04-11 19:51:15 +07:00
Fabian Wunsch
149a1e4209 Changed indentation from spaces to tabs 2022-04-11 19:51:15 +07:00
Fabian Wunsch
37d4325186 Small naming improvement for better clarity 2022-04-11 19:51:15 +07:00
Fabian Wunsch
da58a13058 Small consistency improvement 2022-04-11 19:51:15 +07:00
Fabian Wunsch
2ea0e48a1a Off by one error 2022-04-11 19:51:15 +07:00
Fabian Wunsch
9b44ba2ab8 Changed the print content
Co-authored-by: Hans5958 <hans5958@outlook.com>
2022-04-11 19:51:15 +07:00
Fabian Wunsch
c4716f5f0e Remove duplicate points using format.py
This is acutally a very widespread "problem". There are many entries
that have 2 points after each other that are identical. This happens
especially often with identical first and last points. This should not
alter the appearance in any way.
2022-04-11 19:51:15 +07:00
Fabian Wunsch
8f095a6ba0 Using LF instead of RCLF 2022-04-10 16:10:40 +02:00
Fabian Wunsch
a052531c13 Even available without import since 3.5 2022-04-09 23:32:17 +02:00
Fabian Wunsch
c91df97e25 More beautiful way of fixing this 2022-04-09 23:30:11 +02:00
Fabian Wunsch
ebcd5ff847 Fixed platform specific behaviour in format.py
Previously this would've used CRLF on Windows and LF on Linux, now it's
using CRLF on all platforms, as it's the current format
2022-04-09 23:24:33 +02:00
Fabian Wunsch
706f2b32b0 Added a cleanup step to re calulate the center
This change calculates the center of each entry and compares it to the
current center. If they are different, the center get's updated.
2022-04-09 21:08:36 +02:00
Hans5958
b5ee700b00 Forgot to also parse subreddits 2022-04-09 16:33:09 +07:00
Hans5958
cc4bd5b6da Remove entries with less than 3 points 2022-04-09 16:33:09 +07:00
Hans5958
a996899814 Add ensure_ascii=False 2022-04-09 16:33:09 +07:00
Hans5958
7ee2e5a15a Remove atlas-before-ids-migration from formatter 2022-04-09 16:33:09 +07:00
Hans5958
9053d6d106 Add docs on formatter, move path length checker to formatter 2022-04-09 16:33:09 +07:00
Hans5958
9dc9450524 Smart quotes, why? Get lost. 2022-04-09 16:33:09 +07:00
Hans5958
69ecd7351f Move subreddit-formatted websites to subreddit 2022-04-09 16:33:09 +07:00
Hans5958
d5e7e23a33 Move user links to website, small logic fix 2022-04-08 12:15:21 +07:00
Hans5958
4b26b86e18 Forgot to change that 2022-04-08 12:15:21 +07:00
Hans5958
f4de2cbf7e Make validator more represents the JS script, commatization on spaces
Fun fact: The JS script also includes those that have no r/, but I made the validator warns it so future contributors can confirm and change it into a proper format, or delete it.
2022-04-08 11:48:40 +07:00
Hans5958
1406cc5b7a Forgot to just use strip, also remove trailing comma on subs 2022-04-08 11:37:16 +07:00