Commit graph

94 commits

Author SHA1 Message Date
Neil Alexander
0571b7eb1d
Try harder to query remote keys 2021-07-30 10:18:39 +01:00
Neil Alexander
5a00ff3634
Try harder to query remote keys 2021-07-30 09:58:03 +01:00
Neil Alexander
d459ef5b16
Hopefully get keys from remote query 2021-07-30 09:55:05 +01:00
Neil Alexander
78ab127ced
Some groundwork 2021-07-29 18:22:27 +01:00
Neil Alexander
39d66ed9d6
Some refactoring 2021-07-29 15:47:30 +01:00
Neil Alexander
49e0737fbf
Fix queries 2021-07-29 15:30:23 +01:00
Neil Alexander
4802216752
Initial signature upload support maybe 2021-07-29 15:29:16 +01:00
Neil Alexander
d84883d5c4
Add insert functions for cross-signing signatures 2021-07-29 14:47:09 +01:00
Neil Alexander
f1155d26bf
Allocate the map 2021-07-29 14:39:12 +01:00
Neil Alexander
fba18e8b17
Include signatures in key query 2021-07-29 14:35:42 +01:00
Neil Alexander
870c09be03
Fix error values 2021-07-29 13:13:10 +01:00
Neil Alexander
6e56dbc566
Only the master key signature matters 2021-07-29 13:10:10 +01:00
Neil Alexander
5de569be2c
A fix 2021-07-29 12:54:03 +01:00
Neil Alexander
5654b08819
Try this 2021-07-29 12:50:37 +01:00
Neil Alexander
2fa479edca
Validate signatures 2021-07-29 12:45:29 +01:00
Neil Alexander
93bf1ffc10
Storing device keys part 1 2021-07-29 09:48:09 +01:00
Neil Alexander
dd33f2b76d
Sanity checking of uploads 2021-07-28 17:07:57 +01:00
Neil Alexander
701ffdeb36
Generate key IDs automatically 2021-07-28 16:41:53 +01:00
Neil Alexander
b638b06ec1
Allocate the maps first 2021-07-28 16:30:28 +01:00
Neil Alexander
06de424b2b
Allocate more maps 2021-07-28 16:29:08 +01:00
Neil Alexander
8c8342cc78
Assign it after all 2021-07-28 16:27:19 +01:00
Neil Alexander
3dd80d4cd2
oh wait 2021-07-28 16:26:21 +01:00
Neil Alexander
946d15f976
Try assigning the map first 2021-07-28 16:25:29 +01:00
Neil Alexander
4176595d9c
Try with new scanner interface 2021-07-28 16:23:24 +01:00
Neil Alexander
2fd9102b08
Try this 2021-07-28 16:12:07 +01:00
Neil Alexander
64647a4f87
Fix QueryKeys ordering 2021-07-28 16:09:24 +01:00
Neil Alexander
351ac51691
Logging 2021-07-28 16:07:39 +01:00
Neil Alexander
a6bb3fd0ac
Retrieve cross-signing keys sorta 2021-07-28 15:52:52 +01:00
Neil Alexander
8e55c74334
Don't recreate indexes if they already exist 2021-07-28 14:41:14 +01:00
Neil Alexander
cd59f54af7
More wiring/boilerplate 2021-07-28 14:29:02 +01:00
Neil Alexander
dcadec88d9
Create tables 2021-07-28 13:48:23 +01:00
Neil Alexander
a5bb2afbb5
Add API wiring 2021-07-28 12:31:37 +01:00
S7evinK
89a6787fdb
Try to optimize SelectOneTimeKeys (#1851)
* Try to optimize SelectOneTimeKeys

Signed-off-by: Till Faelligen <tfaelligen@gmail.com>

* Use pg.Array when using ANY...

Co-authored-by: Kegsay <kegan@matrix.org>
2021-06-07 09:17:46 +01:00
Kegsay
b769d5a25e
Optimise memory usage when calling /g_m_e (#1819)
* Optimise memory usage when calling /g_m_e

* cache more events

* refactor handling of device list update pokes

* Sigh
2021-04-08 13:50:39 +01:00
Kegsay
802f1c96f8
Add more metrics (#1802)
* Add more metrics

* Linting
2021-03-23 15:22:00 +00:00
Kegsay
a1b7e4ef3f
log less for failed key querys, add counters for incoming pdus/edus (#1801)
* log less for failed key querys, add counters for incoming pdus/edus

* use labels

* Blacklist flakey test

* Fix metrics
2021-03-23 11:33:36 +00:00
Kegsay
77fb981da5
device lists: backoff for longer if the wrong error type is returned (#1796) 2021-03-08 17:45:20 +00:00
Neil Alexander
81312b8a78
Return the current OTK count on an empty upload request (#1774)
* Always return OTK counts

* Fix parameter ordering

* Send IDs over to keyserver internal API

* Review comments

* Fix syntax error

* Fix panic, hopefully

* Require user ID to be set

* Fix user API call
2021-03-02 11:40:20 +00:00
Neil Alexander
6757b67a32
NewClient and NewFederationClient updates (#1730)
* Use matrix-org/gomatrixserverlib#252

* Add missing WithSkipVerify to test

* Functions instead

* Update gomatrixserverlib to matrix-org/gomatrixserverlib#252

* Fix disabling TLS validation
2021-01-22 16:09:05 +00:00
Loïck Bonniot
940577cd3c
Fix integer overflow in device_list_update.go (#1717)
Fix #1511
On 32-bits systems, int(hash.Sum32()) can be negative.
This makes the computation of array indices using modulo invalid, crashing dendrite.
Signed-off-by: Loïck Bonniot <git@lesterpig.com>
2021-01-18 12:43:15 +00:00
Neil Alexander
fa65c40bae
Reduce device list GetUserDevices timeout (#1704) 2021-01-12 16:13:21 +00:00
Neil Alexander
50963b724b
More sane next batch handling, typing notification tweaks, give invites their own stream position, device list fix (#1641)
* Update sync responses

* Fix positions, add ApplyUpdates

* Fix MarshalText as non-pointer, PrevBatch is optional

* Increment by number of read receipts

* Merge branch 'master' into neilalexander/devicelist

* Tweak typing

* Include keyserver position tweak

* Fix typing next position in all cases

* Tweaks

* Fix typo

* Tweaks, restore StreamingToken.MarshalText which somehow went missing?

* Rely on positions from notifier rather than manually advancing them

* Revert "Rely on positions from notifier rather than manually advancing them"

This reverts commit 53112a62cc3bfd9989acab518e69eeb27938117a.

* Give invites their own position, fix other things

* Fix test

* Fix invites maybe

* Un-whitelist tests that look to be genuinely wrong

* Use real receipt positions

* Ensure send-to-device uses real positions too
2020-12-18 11:11:21 +00:00
Neil Alexander
b5aa7ca3ab
Top-level setup package (#1605)
* Move config, setup, mscs into "setup" top-level folder

* oops, forgot the EDU server

* Add setup

* goimports
2020-12-02 17:41:00 +00:00
Neil Alexander
49abe359e6
Start Kafka connections for each component that needs them (#1527)
* Start Kafka connection for each component that needs one

* Fix roomserver unit tests

* Rename to naffkaInstance (@Kegsay review comment)

* Fix import cycle
2020-10-15 13:27:13 +01:00
Neil Alexander
fe5d1400bf
Update federation timeouts (#1504)
* Update to matrix-org/gomatrixserverlib#234

* Update gomatrixserverlib

* Update federation timeouts

* Fix dendritejs

* Increase /send context time in destination queue
2020-10-09 17:08:32 +01:00
Sam
a6700331ce
Update all usages of tx.Stmt to sqlutil.TxStmt (#1423)
* Replace all usages of txn.Stmt with sqlutil.TxStmt

Signed-off-by: Sam Day <me@samcday.com>

* Fix sign off link in PR template.

Signed-off-by: Sam Day <me@samcday.com>

Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2020-09-24 11:10:14 +01:00
Matthew Hodgson
39507bacc3
Peeking via MSC2753 (#1370)
Initial implementation of MSC2753, as tested by https://github.com/matrix-org/sytest/pull/944.
Doesn't yet handle unpeeks, peeked EDUs, or history viz changing during a peek - these will follow.
https://github.com/matrix-org/dendrite/pull/1370 has full details.
2020-09-10 14:39:18 +01:00
Neil Alexander
a0f2a4510f
Exclude deleted keys from selectBatchDeviceKeysSQL (#1412) 2020-09-08 17:47:54 +01:00
Neil Alexander
04bc09f591
Defer keyserver and federationsender wakeups to give HTTP listeners time to start (#1389) 2020-09-03 21:17:55 +01:00
Kegsay
29d6481842
Wait for 8h between device list updates for blacklisted servers (#1344) 2020-08-26 15:38:21 +01:00