Commit graph

1247 commits

Author SHA1 Message Date
Tulir Asokan 4bc4e92877 Remove media backfill queue and just request immediately 2022-05-02 15:00:57 +03:00
Sumner Evans 2abbf160a7
Merge pull request #486 from mautrix/sumner/bri-3092
backfill: add notification of disappearing messages at correct timestamp
2022-04-30 01:08:36 -06:00
Sumner Evans 3096786454
backfill queue: interrupt sending to deferred channel on queue re-check
If a queue re-check is requested, interrupt sending the backfill request
to the deferred channel so that immediate backfills can happen ASAP.
2022-04-30 01:03:55 -06:00
Sumner Evans 89131bd20c
backfill: add notification of disappearing messages at correct timestamp
This makes it so that the timestamp of the chat in Matrix looks correct,
even though the message is not there to be bridged since it has
disappeared.
2022-04-29 16:59:37 -06:00
Tulir Asokan 8b39175b76 Drop support for appservice login with unstable prefix 2022-04-29 22:04:28 +03:00
Tulir Asokan 4c0d43fee7 Update whatsmeow 2022-04-29 19:40:15 +03:00
Tulir Asokan 4b22e786f5 Make signal store retry if postgres dies 2022-04-29 19:38:44 +03:00
Tulir Asokan b8e7c17d5c Merge branch 'split-forward-backfill' 2022-04-29 17:30:09 +03:00
Tulir Asokan 573eec44c8 Fix indentation in SQL query 2022-04-29 17:03:27 +03:00
Tulir Asokan 7a4de157ce Update mautrix-go and changelog 2022-04-29 16:10:03 +03:00
Tulir Asokan 331138bc6b Split forward backfilling and do it in one batch
Multiple batches is complicated, as it would require figuring out where
the batch ended when handling the next batch of new-old messages.
2022-04-29 11:07:05 +03:00
Tulir Asokan 6b69ea707b Use single SQL query for fetching backfill queue items 2022-04-29 10:44:22 +03:00
Sumner Evans 86840dec59
Merge pull request #484 from mautrix/sumner/bri-3057
backfill: fixed bug where the media backfill loop would sleep too often
2022-04-28 15:52:38 -06:00
Sumner Evans 76c6d0bf87
backfill: fixed bug where the media backfill loop would sleep too often
If the number of requested message was a multiple of the number of batch
events, then it would sleep on every single other message (even if not
an errored media message).
2022-04-28 15:48:40 -06:00
Sumner Evans d898aefff1
backfill loops: combine immediate and deferred loops 2022-04-28 15:48:38 -06:00
Sumner Evans ac7a437ad8
backfill: add more logging to the queue 2022-04-28 15:48:04 -06:00
Tulir Asokan 66f505303d Update 403 error message
Apparently it happens when switching phones, not only when banned
2022-04-28 20:09:44 +03:00
Tulir Asokan 387148849a Update mautrix-go again 2022-04-27 23:48:55 +03:00
Sumner Evans 2259b5007f
Merge pull request #483 from mautrix/sumner/bri-3038
backfill: skip chats if the user is not a participant
2022-04-27 08:32:35 -06:00
Sumner Evans caf0a363c9
backfill: delete messages for rooms the user is not in
If the chat turns out to be not bridgable due to the user not being in
the room, delete the messages, and stop trying to backfill it.
2022-04-27 08:29:20 -06:00
Tulir Asokan 0b036204ca Update dependencies and reduce memory usage when encryping files 2022-04-27 14:31:57 +03:00
Tulir Asokan 54ad27f644 Add separate config option for status broadcast room tag 2022-04-27 12:46:11 +03:00
Sumner Evans 2afdf80937
backfill: don't create room if the user is not a participant
This can happen if the user gets kicked from a chat.
2022-04-26 12:10:30 -06:00
Sumner Evans 5aee338561
Merge pull request #481 from mautrix/fix-backfill-priority-again
backfill: fix priority of backfills again
2022-04-25 08:42:43 -06:00
Tulir Asokan ea3bcec1cf Add option to maybe detect xml-not-well-formed errors 2022-04-25 17:21:43 +03:00
Tulir Asokan 30fd0d7c85 Update whatsmeow 2022-04-25 11:17:30 +03:00
Sumner Evans f32c5f2e9a
backfill: fix priority of backfills again
I think this finally has the correct logic for doing each stage for each
portal before going on to the next stage.
2022-04-23 21:50:47 -06:00
Sumner Evans 0fab7ba4bb
Merge pull request #480 from mautrix/sumner/bri-2883
backfill: fix bridging of ephemeral and view-once messages
2022-04-22 15:23:02 -06:00
Sumner Evans a1e2e673dc
backfill: fix bridging of ephemeral and view-once messages 2022-04-22 14:07:59 -06:00
Sumner Evans 7772b7e15c
Merge pull request #479 from mautrix/fix-media-fail-error
improve error when media is not present on WA servers
2022-04-22 11:52:36 -06:00
Sumner Evans 159ece3e64
improve error when media is not present on WA servers 2022-04-22 11:49:50 -06:00
Tulir Asokan 3f8d6942d2 Store disappearing timer when creating portal 2022-04-22 16:45:30 +03:00
Tulir Asokan 82472a76df Add queue for bridge state updates 2022-04-22 13:26:37 +03:00
Tulir Asokan 2f91b225e2 Update mautrix-go to prevent unnecessary displayname requests 2022-04-22 13:20:46 +03:00
Tulir Asokan 2e15edb209 Add endpoints for checking if number is on WhatsApp 2022-04-21 13:30:40 +03:00
Tulir Asokan 7983c4ddbf Rename issue templates 2022-04-20 14:02:22 +03:00
Tulir Asokan 3a5acfaa74 Remove extra newlines 2022-04-20 13:59:11 +03:00
Tulir Asokan 7e4c2512ae
Update issue templates 2022-04-20 13:55:43 +03:00
Tulir Asokan 533fb22d7e Remove yaml templates 2022-04-20 13:54:33 +03:00
Tulir Asokan a99ced14fd Send bridge state if connection fails 2022-04-20 13:50:06 +03:00
Tulir Asokan dad5c44680 Update browser name list link 2022-04-20 13:50:06 +03:00
Tulir Asokan 852a316e82 Add issue templates 2022-04-20 13:50:06 +03:00
Sumner Evans b81a6c0a3a
Merge pull request #476 from mautrix/start-loops-after-connected
history sync: only start after the user is connected
2022-04-19 12:42:36 -06:00
Sumner Evans 1035956e4c
history sync: only start after the user is connected 2022-04-19 12:02:50 -06:00
Sumner Evans 1262b40cbd
Merge pull request #477 from mautrix/sumner/bri-2974
backfill logging: fix logging of Backfill structs
2022-04-19 12:00:42 -06:00
Sumner Evans e74bb62fc1
backfill logging: fix logging of Backfill structs 2022-04-19 11:19:42 -06:00
Sumner Evans a3d56704a7
Merge pull request #474 from mautrix/sumner/bri-2926
media backfill: add ability to automatically request media not on WA server
2022-04-19 11:04:29 -06:00
Sumner Evans 91098fa005
Merge pull request #473 from mautrix/dev-update-stable-and-nightly
ci: automatically update both STABLE and NIGHTLY on dev environment
2022-04-19 08:57:12 -06:00
Sumner Evans f2e762680c
media backfill: add ability to automatically request media not on WA server
This adds a new backfill type for media that sends a request to the
phone for every media that is not available on the WA servers. WA
deletes media from their servers after about two weeks, so you have to
ask the phone to re-upload it.

In order to use this, you need to enable
bridge.history_sync.backfill_media and configure the requests that will
be made per portal using bridge.history_sync.media (which is similar to
the deferred backfill config).

If you already have backfilled portals, but want to do a one-off media
backfill for all existing portals, you can set
bridge.history_sync.enqueue_backfill_media_next_start to true.
2022-04-19 08:12:51 -06:00
Tulir Asokan c98b7f32c9 Fix handling errors from batch sending 2022-04-19 11:39:17 +03:00