21 commits

Author	SHA1	Message	Date
Neil Alexander	84d089caed	Still doesn't work	2021-01-21 13:31:03 +00:00
Neil Alexander	e254594453	Some refactoring	2021-01-21 11:18:10 +00:00
Neil Alexander	10f2e8d92f	Start his vis	2021-01-20 14:41:09 +00:00
Neil Alexander	33f8d0e278	Clean up	2021-01-20 10:36:59 +00:00
Neil Alexander	0096fc850a	Refactor removeDuplicates (might use slightly more memory but less CPU)	2021-01-20 10:29:32 +00:00
Neil Alexander	dd781907b1	Tweaks	2021-01-20 09:35:44 +00:00
Neil Alexander	9d406e1283	Merge branch 'master' into 1323-archived-rooms-sync-left-rooms	2021-01-19 18:09:00 +00:00
Neil Alexander	b70238f2d5	Basic sync filtering (#1721) ... * Add some filtering (postgres only for now) * Fix build error * Try to use request filter * Use default filter as a template when retrieving from the database * Remove unused strut * Update sytest-whitelist * Add filtering to SelectEarlyEvents * Fix Postgres selectEarlyEvents query * Attempt filtering on SQLite * Test limit, set field for limit/order in prepareWithFilters * Remove debug logging, add comments * Tweaks, debug logging * Separate SQLite stream IDs * Fix filtering in current state table * Fix lock issues * More tweaks * Current state requires room ID * Review comments	2021-01-19 18:00:42 +00:00
Neil Alexander	10b43f86ed	Include membership events	2021-01-18 16:23:37 +00:00
Eric Eastwood	6fd8459447	Try fix unit tests	2021-01-16 01:07:52 -06:00
Eric Eastwood	fe7acc63fa	Derive state events from already filtered events	2021-01-15 02:28:50 -06:00
Eric Eastwood	370b3d981e	Get Sytest working back to the Archive test	2021-01-14 02:50:11 -06:00
Eric Eastwood	76e1faeaf8	Try get Sytest working again ... Currently it's failing way earlier on "Newly left rooms appear in the leave section of incremental sync" and I've commented out all of my new functionality so need to figure out what is interfering in this branch now	2021-01-14 01:59:24 -06:00
Neil Alexander	1be95012d4	Merge branch 'master' into 1323-archived-rooms-sync-left-rooms	2021-01-13 17:37:07 +00:00
Neil Alexander	d8fba52e97	Simplify send-to-device messaging (#1702) ... * Simplify send-to-device messaging * Don't return error if there's no work to do * Remove SQLite migrations for now * Tweak Postgres migrations * Tweaks * Fixes * Cleanup separately * Fix SQLite migration	2021-01-13 17:29:46 +00:00
Neil Alexander	bb9e6a1281	Sync fixes (#1709) ... * omitempty some fields in sync * Add a few more * Don't send push rules over and over again in incremental sync * Further tweaks	2021-01-13 14:32:49 +00:00
Neil Alexander	707f347f34	Less restrictive visibility filtering	2021-01-13 10:54:19 +00:00
Neil Alexander	0231199cc8	Tweaks	2021-01-13 10:24:11 +00:00
Neil Alexander	be9ee18233	Tidy filterStreamEventsAccordingToHistoryVisibility	2021-01-13 10:09:26 +00:00
Neil Alexander	2322d8f027	Merge branch 'master' into 1323-archived-rooms-sync-left-rooms	2021-01-13 10:06:21 +00:00
Neil Alexander	b5a8935042	Sync refactor — Part 1 (#1688) ... * It's half-alive * Wakeups largely working * Other tweaks, typing works * Fix bugs, add receipt stream * Delete notifier, other tweaks * Dedupe a bit, add a template for the invite stream * Clean up, add templates for other streams * Don't leak channels * Bring forward some more PDU logic, clean up other places * Add some more wakeups * Use addRoomDeltaToResponse * Log tweaks, typing fixed? * Fix timed out syncs * Don't reset next batch position on timeout * Add account data stream/position * End of day * Fix complete sync for receipt, typing * Streams package * Clean up a bit * Complete sync send-to-device * Don't drop errors * More lightweight notifications * Fix typing positions * Don't advance position on remove again unless needed * Device list updates * Advance account data position * Use limit for incremental sync * Limit fixes, amongst other things * Remove some fmt.Println * Tweaks * Re-add notifier * Fix invite position * Fixes * Notify account data without advancing PDU position in notifier * Apply account data position * Get initial position for account data * Fix position update * Fix complete sync positions * Review comments @Kegsay * Room consumer parameters	2021-01-08 16:59:06 +00:00