aboutsummaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2021-07-09Add more optimised code path for checking if we're in a room (#1909)Neil Alexander
* Add more optimised code path for checking if we're in a room * Fix database queries * Fix federation API test * Fix logging * Review comments * Make separate API call for room membership
2021-07-09bugfix: order the state blocks so recreating state snapshots works correctly ↵kegsay
(#1908) * Logging * Revert "Logging" This reverts commit 23ce334182d8a70f8e0381786f9dea77a9b91ed8. * bugfix: order the state blocks so recreating state snapshots works correctly
2021-07-08Fix bug when rejecting invites (#1907)Neil Alexander
* Fix rejecting invites maybe * Remove comment that is no longer correct * Review comment on performFederatedRejectInvite
2021-07-08Only log filename and not entire path (#1906)kegsay
2021-07-08dendrite-upgrade-test: tweaks to get it to run under CI in docker (#1905)kegsay
* dendrite-upgrade-test: tweaks to get it to run under CI in docker * Linting
2021-07-08lintingKegan Dougal
2021-07-08Improve error handling and close files post-tarringKegan Dougal
2021-07-07Fix concurrent map reads/writes on t.hadEvents (#1902)Neil Alexander
* Fix concurrent map reads/writes on t.hadEvents * Add hadEvent function
2021-07-07db migration: handle create events with no state blocks from v0.1.0 (#1904)kegsay
2021-07-07dendrite-upgrade-test: support --from HEAD-N, cleanup on startup (#1903)kegsay
2021-07-07Add dendrite-upgrade-test (#1901)kegsay
* Add WIP binary for testing dendrite version upgrades * WIP dendrite upgrade work * Finish dendrite upgrade checks * go mod tidy * Review comments; print container logs on failure * Linting
2021-07-05Track expiry rate on pduCountTotalNeil Alexander
2021-07-05Federation API fixes (#1899)Neil Alexander
* Ensure worker has work before starting goroutine * Revert "Remove processEventWithMissingStateMutex" This reverts commit 7f02eab47d9f62132c4fee50f190088b70763e83. * Use request context when processing transactions * Keep goroutine count down by not starting work for things where the caller gave up * Remove mutex, start workers at correct time
2021-07-05Remove processEventWithMissingStateMutexNeil Alexander
2021-07-02Update to matrix-org/gomatrixserverlib#266 (+ missing file)Neil Alexander
2021-07-02Update to matrix-org/gomatrixserverlib#265 for faster power level content ↵Neil Alexander
parsing
2021-07-02Federation API workers for /send to reduce memory usage (#1897)Neil Alexander
* Try to process rooms concurrently in FS /send * Clean up * Use request context so that dead things don't linger for so long * Remove mutex * Free up pdus slice so only references remaining are in channel * Revert "Remove mutex" This reverts commit 8558075e8c9bab3c1d8b2252b4ab40c7eaf774e8. * Process EDUs in parallel * Try refactoring /send concurrency * Fix waitgroup * Release on waitgroup * Respond to transaction * Reduce CPU usage, fix unit tests * Tweaks * Move into one file
2021-07-02Roomserver input backpressure metricNeil Alexander
Squashed commit of the following: commit 56e934ac0aeedcfb2c072010959ba49734d4e0cb Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Fri Jul 2 09:39:30 2021 +0100 Fix metric commit 3911f3a0c17b164b012e881c085ceca30f5de408 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Fri Jul 2 09:36:29 2021 +0100 Register correct metric commit a9ddbfaed421538a701151801e9451198a8be4f3 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Fri Jul 2 09:33:33 2021 +0100 Try to capture RS input backpressure metric
2021-06-30Fix concurrent map read/write on haveEvents (#1893)Neil Alexander
2021-06-30Change how servers are selected for missing auth/prev events (#1892)Neil Alexander
* Change how servers are selected for missing auth/prev events * Shuffle order * Move ServersInRoomProvider into api package
2021-06-30Give up on loops when the context expires (#1891)Neil Alexander
2021-06-30Reduce memory usage in federation /send endpoint (#1890)Neil Alexander
* More aggressive event caching * Deduplicate /state results * Deduplicate more * Ensure we use the correct list of events when excluding repeated state * Fixes * Ensure we track all events we already knew about properly
2021-06-29db migration: fix #1844 and add additional assertions (#1889)kegsay
* db migration: fix #1844 and add additional assertions - Migration scripts will now check to see if there are any unconverted snapshot IDs and fail the migration if there are any. This should prevent people from getting a corrupt database in the event the root cause is still unknown. - Add an ORDER BY clause when doing batch queries in the postgres migration. LIMIT and OFFSET without ORDER BY are undefined and must not be relied upon to produce a deterministic ordering (e.g row order). See https://www.postgresql.org/docs/current/queries-limit.html * Linting Co-authored-by: Neil Alexander <neilalexander@users.noreply.github.com>
2021-06-29Put gmectx back to 5 minutesNeil Alexander
2021-06-29Restore the getServers RS query (needs optimisation)Neil Alexander
2021-06-28Protect processEventWithMissingState with per-room mutex, to prevent mass ↵Neil Alexander
CPU burn/RAM usage Squashed commit of the following: commit 7fad77c10e3c1c78feddb37351812b209d9c0f25 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 15:06:52 2021 +0100 Fix processEventWithMissingStateMutexes commit 138cddcac7b8373a8e1816a232f84a7bda6adcdf Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:59:44 2021 +0100 Use internal.MutexByRoom commit 6e6f026cfad31da391ad261cfec16d41dff1b15b Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:50:18 2021 +0100 Try to slow things down per room commit b97d406dff2e11769a9202fbf58b138a541ca449 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:41:27 2021 +0100 Try to slow things down commit 8866120ebf880b4fd8a456937f69903e233c19a2 Merge: 9f2de8a2 4a37b19a Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:40:33 2021 +0100 Merge branch 'neilalexander/rsinputfifo' into neilalexander/rsinputfifo2 commit 4a37b19a8f6fe8af02e979827253d22a0ccdedb8 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:34:54 2021 +0100 Add comments commit f9ab3f4b8157a42d657735101bc2c768c663e814 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:31:21 2021 +0100 Tweaks commit 9f2de8a29cadec4c785d9c2e4e74c1138305f759 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 13:15:59 2021 +0100 Ask origin only for missing things for now commit 8fd878c75a4066abb21597d524a4eb4670a392d4 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 11:18:11 2021 +0100 Make sure someone wakes up commit b63f699f1b74948d180885449398f999fafb18c8 Author: Neil Alexander <neilalexander@users.noreply.github.com> Date: Mon Jun 28 11:12:58 2021 +0100 Use a FIFO queue instead of a channel to reduce backpressure
2021-06-28Use a custom FIFO queue for the RS input API (#1888)Neil Alexander
* Use a FIFO queue instead of a channel to reduce backpressure * Make sure someone wakes up * Tweaks * Add comments
2021-06-25Fix bugs in P2P demosNeil Alexander
2021-06-25Update go.mod/go.sumNeil Alexander
2021-06-25dendritejs-pineconeNeil Alexander
2021-06-22dendrite-demo-pinecone: Accept any originNeil Alexander
2021-06-22✂️ Media API: Handle unlimited file size (#1881)database64128
2021-06-21Fix panic in roomserverNeil Alexander
2021-06-16Revert "Ensure user IDs match the spec (matrix-org/gomatrixserverlib#261)"Neil Alexander
This reverts commit 30e9353fdd4cc2a3c3e5bd6de139ca0e31dae7bb.
2021-06-15Ensure user IDs match the spec (matrix-org/gomatrixserverlib#261)Neil Alexander
2021-06-14Update go.mod/go.sumNeil Alexander
2021-06-14Set MaxFileSizeBytes <= 0 to "unlimited" (#1875)S7evinK
* Set MaxFileSizeBytes < 0 to "unlimited" Signed-off-by: Till Faelligen <tfaelligen@gmail.com> * int64 overflows later in mediaapi/routing/upload.go[doUpload] * Prevent int overflow when uploading
2021-06-14Remove mention of enabling naffka in install instructions, as it is the ↵Arnaud Venturi
default value (#1853) Signed-off-by: Arnaud Venturi <git@toadjaune.eu>
2021-06-14Fix Key Generation Docs - resolves #1759 (#1865)Ben Yanke
This fixes the issue found in #1759 which broke due to go changes. The new command allows you to generate keys with docker, and drop them in the current working directory.
2021-06-14Add parameters to specify password (#1868)S7evinK
* Add parameters to specify password Signed-off-by: Till Faelligen <tfaelligen@gmail.com> * Fix typo * Add testdata * Use go1.13 compatible way to read files
2021-06-14Use NotFound instead of Forbidden for missing account data (#1872)Adam Greig
Signed-off-by: Adam Greig <adam@adamgreig.com>
2021-06-14Update go.mod/go.sumNeil Alexander
2021-06-14Pinecone demo updatesNeil Alexander
2021-06-07Add CORS to nginx config (#1791)Rasmus Thomsen
Without this entry, setups where users have the homeserver on the URL matrix.myurl.com but want the servername to be myurl.com don't work by default since clients like element.io can't connect to the homeserver
2021-06-07Link to Synapse (#1863)Ben Langfeld
Not everyone is very familiar.
2021-06-07Add missing IPv6 "ssl" keyword in nginx config examples (#1854)Arnaud Venturi
Signed-off-by: Arnaud Venturi <git@toadjaune.eu>
2021-06-07Try to optimize SelectOneTimeKeys (#1851)S7evinK
* Try to optimize SelectOneTimeKeys Signed-off-by: Till Faelligen <tfaelligen@gmail.com> * Use pg.Array when using ANY... Co-authored-by: Kegsay <kegan@matrix.org>
2021-06-07Use LimitReader to prevent DoS risk (#1843)S7evinK
* Use LimitReader to prevent DoS risk Signed-off-by: Till Faelligen <tfaelligen@gmail.com> * Check if bytesWritten is equal to the maxFileSize Add tests Signed-off-by: Till Faelligen <tfaelligen@gmail.com> * Use oldschool defer to cleanup after the tests * Let LimitReader read MaxFileSizeBytes + 1 Co-authored-by: Kegsay <kegan@matrix.org>
2021-06-07Fix SIGSEGV in IsInterestedInRoomID (#1846)bodqhrohro
* Avoid crash on non-compiled room regex Roughly fixes #1845 (actual compiling still needed) Signed-off-by: Bohdan Horbeshko <bodqhrohro@gmail.com> * Compile regexes for all namespaces Deadheres the regex compiling from building larger regexes for possibly exclusive namespaces only. A complete fix for #1845, so regexes for rooms namespaces and other non-whitelisted namespaces can be used more safely. Signed-off-by: Bohdan Horbeshko <bodqhrohro@gmail.com> * Appservice config: handle regexp parsing errors Signed-off-by: diamondburned <datutbrus@gmail.com> Signed-off-by: Bohdan Horbeshko <bodqhrohro@gmail.com> Co-authored-by: Kegsay <kegan@matrix.org>
2021-06-07Split the select+update query for txn_id counter (#1855)bodqhrohro
The update part wasn't executed actually for SQLite, so it is moved to a separate statement. Fixes #1852. Signed-off-by: Bohdan Horbeshko <bodqhrohro@gmail.com>