Cheng Hann Gan
a75a0ab149
Updated Reddit
2022-05-26 12:28:01 -04:00
AnonymousRandomPerson
d441f34501
Run formatter in merge_out
2022-05-21 17:06:33 -04:00
AnonymousRandomPerson
9437f4cc7c
Integrate whiteout scaling with merging
2022-05-21 16:57:19 -04:00
Hans5958
6e19e29983
Only extend on crawls
2022-05-21 08:14:58 +07:00
AnonymousRandomPerson
437f71cfe3
Updated Reddit
2022-05-20 19:29:06 -04:00
Cheng Hann Gan
8b45c9871e
Updated Reddit
2022-05-18 14:00:56 -04:00
AnonymousRandomPerson
1a7df2d33b
Revert "Bring back center recalculation"
...
This reverts commit 904100fc45
2022-05-17 22:05:39 -04:00
Hans5958
57060905de
Add formatter to remove decimals on points
...
Let's call it the flooring function
2022-05-17 19:57:06 +07:00
Hans5958
904100fc45
Bring back center recalculation
...
ARP just vaporized that out of blue? Dude's not even giving a chance!
It is now commented.
2022-05-17 19:57:06 +07:00
Hans5958
a1c0e623a5
Move constant to top
2022-05-17 19:46:54 +07:00
AnonymousRandomPerson
7ae945603f
Fixed whiteout extension for entries only on 164
2022-05-14 11:38:31 -04:00
AnonymousRandomPerson
72829f392b
Sort image keys and extend to whiteout in formatter
2022-05-13 19:06:18 -04:00
Cheng Hann Gan
d92eb66102
Revert "Revert "Removed unused contributors field from JSON""
...
This reverts commit 6a2b409fe5
2022-05-13 13:19:43 -04:00
Hans5958
6a2b409fe5
Revert "Removed unused contributors field from JSON"
...
This reverts commit 5deedbdea0
2022-05-13 23:58:24 +07:00
Cheng Hann Gan
d90baab00a
Revert "Revert "Removed unused contributors field from JSON""
...
This reverts commit 7f735f9abc
2022-05-13 10:16:50 -04:00
Hans5958
7f735f9abc
Revert "Removed unused contributors field from JSON"
...
This reverts commit 5deedbdea0
2022-05-13 21:06:50 +07:00
Cheng Hann Gan
5deedbdea0
Removed unused contributors field from JSON
2022-05-12 12:45:56 -04:00
Cheng Hann Gan
dd97861520
Remove center recalculation from formatter
2022-05-12 12:37:18 -04:00
Cheng Hann Gan
1b2551a178
Remove old format from formatter
2022-05-12 12:37:05 -04:00
Hans5958
4916f37100
Little documentation, catch exceptions, convert discord links
2022-05-12 16:28:00 +07:00
Hans5958
8019a27a45
Fix commatization regex
2022-04-29 17:12:40 +07:00
Hans5958
710d4a7c6a
Little rewrite on migrator, migrate submissions if needed, add writing log
2022-04-25 15:50:26 +07:00
Hans5958
74b8073a7b
Do stricter (and proper) subreddit regex 2
...
I forgot that I made it so it excludes underscore, here's a proper fix
2022-04-19 16:42:20 +07:00
Hans5958
1bca3bb9c5
Do stricter (and proper) subreddit regex
...
3-21 instead of 1-20
2022-04-19 16:34:52 +07:00
Hans5958
37bfe79d3e
Fix crawler and merger script, fix typo of formatter
2022-04-19 08:55:37 +07:00
Hans5958
bbf6703df2
Print formatter log every 200 due to slowdown
2022-04-17 14:38:53 +07:00
Hans5958
9b7baca08a
Merge pull request #1165 from fabi321/fix-line-end
...
Fixed platform specific behaviour in format.py
2022-04-17 14:30:28 +07:00
Hans5958
2f417e433a
Optimize new center algo a little bit
...
incl. Don't use modules
2022-04-17 14:12:34 +07:00
Fabian Wunsch
a80f070173
Merge branch 'remaster' into fix-line-end
2022-04-17 09:12:12 +02:00
Hans5958
41e29c1abb
Merge branch 'remaster' into new-center-algorithm
2022-04-17 13:39:14 +07:00
Hans5958
03c6748d02
Fix bugs on formatter
2022-04-17 13:36:19 +07:00
Fabian Wunsch
c01610774d
Merge branch 'remaster' into new-center-algorithm
2022-04-17 08:31:51 +02:00
Hans5958
49a0c85c27
Fix pattern to compensate R/ on links object
2022-04-17 13:18:43 +07:00
Hans5958
d93c2ed5a5
Use specific pattern for new format subreddits
2022-04-17 13:12:22 +07:00
Hans5958
bb2704c2d2
Formatter support for new format
2022-04-16 22:25:11 +07:00
Fabian Wunsch
95c706f95a
Small bugfix
2022-04-12 08:14:56 +02:00
Fabian Wunsch
d819cfb313
Changed the algorithm to calculate the center
...
this is the version from Mapbox, just to see how well it performs. It
definitely needs improvements as of now. I'm going to include the
atlas.json, but it will be excluded once the pr is ready to be merged
2022-04-12 08:14:10 +02:00
Fabian Wunsch
ed084ac936
Fixed logical indentation error
2022-04-11 19:51:15 +07:00
Fabian Wunsch
149a1e4209
Changed indentation from spaces to tabs
2022-04-11 19:51:15 +07:00
Fabian Wunsch
37d4325186
Small naming improvement for better clarity
2022-04-11 19:51:15 +07:00
Fabian Wunsch
da58a13058
Small consistency improvement
2022-04-11 19:51:15 +07:00
Fabian Wunsch
2ea0e48a1a
Off by one error
2022-04-11 19:51:15 +07:00
Fabian Wunsch
9b44ba2ab8
Changed the print content
...
Co-authored-by: Hans5958 <hans5958@outlook.com>
2022-04-11 19:51:15 +07:00
Fabian Wunsch
c4716f5f0e
Remove duplicate points using format.py
...
This is acutally a very widespread "problem". There are many entries
that have 2 points after each other that are identical. This happens
especially often with identical first and last points. This should not
alter the appearance in any way.
2022-04-11 19:51:15 +07:00
Fabian Wunsch
8f095a6ba0
Using LF instead of RCLF
2022-04-10 16:10:40 +02:00
Fabian Wunsch
a052531c13
Even available without import since 3.5
2022-04-09 23:32:17 +02:00
Fabian Wunsch
c91df97e25
More beautiful way of fixing this
2022-04-09 23:30:11 +02:00
Fabian Wunsch
ebcd5ff847
Fixed platform specific behaviour in format.py
...
Previously this would've used CRLF on Windows and LF on Linux, now it's
using CRLF on all platforms, as it's the current format
2022-04-09 23:24:33 +02:00
Fabian Wunsch
706f2b32b0
Added a cleanup step to re calulate the center
...
This change calculates the center of each entry and compares it to the
current center. If they are different, the center get's updated.
2022-04-09 21:08:36 +02:00
Hans5958
b5ee700b00
Forgot to also parse subreddits
2022-04-09 16:33:09 +07:00
