Commit graph

76 commits

Author SHA1 Message Date
Hans5958 a996899814 Add ensure_ascii=False 2022-04-09 16:33:09 +07:00
Hans5958 7ee2e5a15a Remove atlas-before-ids-migration from formatter 2022-04-09 16:33:09 +07:00
Hans5958 9053d6d106 Add docs on formatter, move path length checker to formatter 2022-04-09 16:33:09 +07:00
Hans5958 9dc9450524 Smart quotes, why? Get lost. 2022-04-09 16:33:09 +07:00
Hans5958 69ecd7351f Move subreddit-formatted websites to subreddit 2022-04-09 16:33:09 +07:00
Hans5958 d5e7e23a33 Move user links to website, small logic fix 2022-04-08 12:15:21 +07:00
Hans5958 4b26b86e18 Forgot to change that 2022-04-08 12:15:21 +07:00
Hans5958 f4de2cbf7e Make validator more represents the JS script, commatization on spaces
Fun fact: The JS script also includes those that have no r/, but I made the validator warns it so future contributors can confirm and change it into a proper format, or delete it.
2022-04-08 11:48:40 +07:00
Hans5958 1406cc5b7a Forgot to just use strip, also remove trailing comma on subs 2022-04-08 11:37:16 +07:00
Hans5958 cc497d5178 Add forgotten parts on the port, move some parts for better git diff 2022-04-08 11:21:16 +07:00
Hans5958 e9cd995dbd Add semicolons on subreddit formatter 2022-04-08 11:14:17 +07:00
Hans5958 121d8653a5 Update auth setup docs with more clarity
Also adapted from Nick

Co-authored-by: Nicolas Abram <abramlujan@gmail.com>
2022-04-08 11:09:35 +07:00
Hans5958 ad15cefb07 Remove zero width joiner before parsing 2022-04-08 11:03:18 +07:00
Hans5958 f04102f29c Port flair edit, small log change
Logic and port made/adapted from Nick's

Co-authored-by: Nicolas Abram <abramlujan@gmail.com>
2022-04-08 11:03:18 +07:00
Hans5958 4c4fb973f3 Fix trailing comma removal 2022-04-08 11:03:18 +07:00
Hans5958 33bda5f364 Expand error info 2022-04-08 11:03:17 +07:00
Hans5958 8913e781bf Forgot to silent on formatting 2022-04-08 11:03:17 +07:00
Hans5958 cd87520c87 Handle escaping escape characters 2022-04-08 11:03:17 +07:00
Hans5958 1da79b806b Take only the first object, remove escapes, add more info on errors 2022-04-08 11:03:17 +07:00
Hans5958 713ebec844 Somehow commatization gone 2022-04-08 11:03:16 +07:00
Hans5958 796bd09a15 Support some other symbols 2022-04-08 11:03:16 +07:00
Hans5958 a2e483f156 Better URL regex
by stephenhay from https://mathiasbynens.be/demo/url-regex
2022-04-08 11:03:16 +07:00
Hans5958 ad5312e0a3 Support accidental extra slashes 2022-04-08 11:03:16 +07:00
Hans5958 69d836fe4a Add more psuedo-empty strings 2022-04-08 11:03:16 +07:00
Hans5958 ceb8cb4a03 Improve CSTW and whoops 2022-04-08 11:03:15 +07:00
Hans5958 90f9b05092 Add validation 2022-04-08 11:03:15 +07:00
Hans5958 af2b9045d8 I mean, do this instead.
This assumes that it uses Markdown
2022-04-08 11:03:15 +07:00
Hans5958 f942dea58d Nope, don't do that! 2022-04-08 11:03:15 +07:00
Hans5958 4c5711d97d Add support(?) for users 2022-04-08 11:03:14 +07:00
Hans5958 02448d0fad Happy little accidents 3 2022-04-08 11:03:14 +07:00
Hans5958 e113b29939 Add CSTW, clarity fixes 2022-04-08 11:03:14 +07:00
Hans5958 7571a92fd9 Simplify try-catch, assert that path length > 0, separator on fail file
Assertion migrated from ARP

Co-authored-by: Cheng Hann Gan <chenghanngan.us@gmail.com>
2022-04-08 11:03:14 +07:00
Hans5958 2db0dcce6c Optimize and remove redundant code, make some tamer 2022-04-08 11:03:13 +07:00
Hans5958 ede4bc8208 Move things to make it more effective 2022-04-08 11:03:13 +07:00
Hans5958 4acefe3e6d Tiny refactor, remove redundant subreddit link on website
Resolves #707
2022-04-08 11:03:13 +07:00
Hans5958 7abe5cbed6 Happy little accidents 2, convert and on subreddit 2022-04-08 11:03:13 +07:00
Hans5958 b5aa228962 Adapt ARP's url fix
Co-authored-by: Cheng Hann Gan <chenghanngan.us@gmail.com>
2022-04-08 11:03:12 +07:00
Hans5958 3a86822175 Happy little accidents 2022-04-08 11:03:12 +07:00
Hans5958 73ef9e0f27 Remove raw scripts
Maybe yes maybe no eh
2022-04-08 11:03:12 +07:00
Hans5958 5a660759bf Improve and merge scripts, use JSON instead of regex 2022-04-08 11:03:12 +07:00
unknown 93e80dc7f9 New submissions, flair editing script 2022-04-07 17:00:30 -03:00
unknown c7f4b927f5 Fix missing id in entry 2022-04-06 17:38:25 -03:00
unknown 7ad57eaef9 Make redditcrawl create a valid json for atlas_temp 2022-04-06 16:47:46 -03:00
Stefano dc9f184e86
Merge branch 'master' into bulk-format-220406 2022-04-06 01:11:31 -07:00
Hans5958 a097844861 Add and improve scripts 2022-04-06 15:08:26 +07:00
unknown f03a825c5d Fix crawler 2022-04-06 04:48:39 -03:00
Stefano decde2cf02
Merge pull request #606 from nico-abram/counter
Fix Success counter
2022-04-05 23:23:20 -07:00
unknown c726458e07 Fix validation script 2022-04-06 01:47:57 -03:00
unknown 443c210299 Fix Success counter 2022-04-05 22:33:57 -03:00
unknown 35672fdb47 Fix reddit crawl newline and quote handling 2022-04-05 19:00:31 -03:00