mastodon

Commit Graph

Author	SHA1	Message	Date
Emelia Smith	215081240f	Add logging of websocket send errors (#25280 )	2 years ago
Emelia Smith	c81f59583c	Fix logging of messages that are binary before closing their connection (#25361 )	2 years ago
Emelia Smith	16dd3f08c1	Fix performance of streaming by parsing message JSON once (#25278 )	2 years ago
Renaud Chaput	d27216dc46	Enforce import order with ESLint (#25096 )	2 years ago
Nick Schonning	f22b4e556c	Add eslint-plugin-jsdoc (#24719 )	2 years ago
Emelia Smith	301e03eb8c	Remove clustering from streaming API (#24655 )	2 years ago
Claire	174352716a	Disable anonymous access to the streaming API (#23989 )	2 years ago
Eugen Rochko	be1792e1d4	Fix streaming API not being usable without `DATABASE_URL` (#23960 )	2 years ago
Ramūns Usovs	0872f3e3d7	Allow streaming to connect to postgress with self-signed certs (#21431 )	2 years ago
emilweth	7c45145430	fix metrics format (#23520 )	2 years ago
emilweth	c1b823368c	dot is not allowed (#23519 )	2 years ago
Eugen Rochko	c5a4d8c82d	Add information about database pool to metrics endpoint in streaming API (#23469 )	2 years ago
Eugen Rochko	4cb7647516	Add database pool configuration over `DB_POOL` to streaming API (#23470 ) Add connection timeout of 15s	2 years ago
Eugen Rochko	01584f03e8	Add metrics endpoint to streaming API (#23388 )	2 years ago
Nick Schonning	06b68490d1	Enable eslint:recommended ruleset (#22433 ) * Enable ESLint recommended ruleset * Disable failing ESLint recommended rules * Remove rules shadowed by eslint:recommended	2 years ago
Claire	8c3c6dcae9	Fix filters from other users being used in the streaming service (#20719 )	2 years ago
Claire	cd5e98dbdb	Fix public/local timeline posts not being properly filtered (#20567 ) * Fix streaming server using wrong property name for matching filters Late in the PR, the `filter_results` property has been renamed to `filtered`, but the change has not been reflected in the streaming server code. * Fix filter_action attribute being an integer instead of a string	2 years ago
Eugen Rochko	e7aa2be828	Change how hashtags are normalized (#18795 ) * Change how hashtags are normalized * Fix tests	3 years ago
Claire	02851848e9	Revamp post filtering system (#18058 ) * Add model for custom filter keywords * Use CustomFilterKeyword internally Does not change the API * Fix /filters/edit and /filters/new * Add migration tests * Remove whole_word column from custom_filters (covered by custom_filter_keywords) * Redesign /filters Instead of a list, present a card that displays more information and handles multiple keywords per filter. * Redesign /filters/new and /filters/edit to add and remove keywords This adds a new gem dependency: cocoon, as well as a npm dependency: cocoon-js-vanilla. Those are used to easily populate and remove form fields from the user interface when manipulating multiple keyword filters at once. * Add /api/v2/filters to edit filter with multiple keywords Entities: - `Filter`: `id`, `title`, `filter_action` (either `hide` or `warn`), `context` `keywords` - `FilterKeyword`: `id`, `keyword`, `whole_word` API endpoits: - `GET /api/v2/filters` to list filters (including keywords) - `POST /api/v2/filters` to create a new filter `keywords_attributes` can also be passed to create keywords in one request - `GET /api/v2/filters/:id` to read a particular filter - `PUT /api/v2/filters/:id` to update a new filter `keywords_attributes` can also be passed to edit, delete or add keywords in one request - `DELETE /api/v2/filters/:id` to delete a particular filter - `GET /api/v2/filters/:id/keywords` to list keywords for a filter - `POST /api/v2/filters/:filter_id/keywords/:id` to add a new keyword to a filter - `GET /api/v2/filter_keywords/:id` to read a particular keyword - `PUT /api/v2/filter_keywords/:id` to edit a particular keyword - `DELETE /api/v2/filter_keywords/:id` to delete a particular keyword * Change from `irreversible` boolean to `action` enum * Remove irrelevent `irreversible_must_be_within_context` check * Fix /filters/new and /filters/edit with update for filter_action * Fix Rubocop/Codeclimate complaining about task names * Refactor FeedManager#phrase_filtered? This moves regexp building and filter caching to the `CustomFilter` class. This does not change the functional behavior yet, but this changes how the cache is built, doing per-custom_filter regexps so that filters can be matched independently, while still offering caching. * Perform server-side filtering and output result in REST API * Fix numerous filters_changed events being sent when editing multiple keywords at once * Add some tests * Use the new API in the WebUI - use client-side logic for filters we have fetched rules for. This is so that filter changes can be retroactively applied without reloading the UI. - use server-side logic for filters we haven't fetched rules for yet (e.g. network error, or initial timeline loading) * Minor optimizations and refactoring * Perform server-side filtering on the streaming server * Change the wording of filter action labels * Fix issues pointed out by linter * Change design of “Show anyway” link in accordence to review comments * Drop “irreversible” filtering behavior * Move /api/v2/filter_keywords to /api/v1/filters/keywords * Rename `filter_results` attribute to `filtered` * Rename REST::LegacyFilterSerializer to REST::V1::FilterSerializer * Fix systemChannelId value in streaming server * Simplify code by removing client-side filtering code The simplifcation comes at a cost though: filters aren't retroactively applied anymore.	3 years ago
Yamagishi Kazutoshi	5781d1db84	Fix parsing `TRUSTED_PROXY_IP` (#18051 )	3 years ago
Claire	f29458da1d	Fix streaming server sometimes silently dropping subscriptions (#17841 )	3 years ago
Claire	6ea80ba2a2	Change streaming server error messages when failing to parse client input (#17559 ) Fixes #17541 - prefix JSON parsing error message by “Error parsing message from …” - output user id if a user is logged in, IP address otherwise - reduce log level from error to warning when a user is logged in, and to silly otherwise	3 years ago
Claire	bc066d8936	Fix timeline streaming stopping for multiple sessions instead of one (#17259 ) * Fix timeline streaming stopping for multiple sessions instead of one Fixes #17256. In updating the code for a newer version of node-redis, #17183 also broke redis subscription management when multiple streaming clients subscribe to the same channel. This commit restores the redis subscription management code. * Let node-redis actually handle the subscriptions	3 years ago
Lerk	4d1eaf3e6e	Finish update of node-redis (#17183 ) * fix streaming redis client * use console.error instead of console.log * follow node-redis migration guide https://github.com/redis/node-redis/blob/master/docs/v3-to-v4.md * fix config options for node-redis * keep indentation * Update streaming/index.js Co-authored-by: Yamagishi Kazutoshi <ykzts@desire.sh> Co-authored-by: Yamagishi Kazutoshi <ykzts@desire.sh>	3 years ago
Sasha Sorokin	6c88ebfd4b	fix(streaming): req.scopes can be nullable (#16823 ) When checking for required OAuth scopes, an unexpected error could happen due to missing (null-y) req.scopes. This commit fixes that by checking if req.scopes are present before checking if any required scopes are present, otherwise it skips that straight to rejection.	3 years ago
Eugen Rochko	a0d4129893	Refactor notifications to go through a separate stream in streaming API (#16765 ) Eliminate need to have custom notifications filtering logic in the streaming API code by publishing notifications into a separate stream and then simply using the multi-stream capability to subscribe to that stream when necessary	3 years ago
Eugen Rochko	c5c46dd6ee	Fix "cb is not a function" error in streaming API server (#16134 ) Third argument of `ping` is the callback Regression from #15932	4 years ago
Eugen Rochko	aafe65a142	Change log level of worker start/end to warn in streaming API (#16110 )	4 years ago
Claire	49814d5799	Switch from deprecated ClusterWS/cws to ws package (#15932 ) * Switch from deprecated ClusterWS/cws to ws package Fixes #15184 Co-authored-by: Edho Arief <me@nanaya.pro> * Make bufferutil and utf-8-validate optional dependencies Co-authored-by: Edho Arief <me@nanaya.pro>	4 years ago
abcang	a2da02626e	Fixed ESLint error (#15214 ) * eslint --fix * fix consistent-return * fix promise/catch-or-return * ignore import rule	4 years ago
Eugen Rochko	aa10200e58	Fix streaming API allowing connections to persist after access token invalidation (#15111 ) Fix #14816	4 years ago
fuyu	e39d97f700	Fix crash streaming process when receive invalid json (#14859 )	4 years ago
Eugen Rochko	01647b8acb	Fix destructuring error when unsubscribing without subscribing (#14566 )	5 years ago
Eugen Rochko	ef057584fd	Add support for managing multiple stream subscriptions in a single connection (#14524 )	5 years ago
ThibG	ddcdddd6fc	Change streaming server to treat blank redis password as password-less auth (#14135 ) Fixes #14131 Our `mastodon:setup` task defaults to a blank password rather than the absence of password, but some versions of Redis reject blank password authentication when authentication is possible without a password. The Ruby code only uses the Redis password when it's not blank, so do the same for the node.js part.	5 years ago
Eugen Rochko	5d8398c8b8	Add E2EE API (#13820 )	5 years ago
Takeshi Umeda	26b08a3c54	Add remote only to public timeline (#13504 ) * Add remote only to public timeline * Fix code style	5 years ago
Ben Lubar	0dfba0884e	minor server-sent events fixes (#12945 ) * Send output on the server-sent events stream immediately so the client sees that it was successfully opened even if it doesn't have any messages. Fix transparent SSE streaming for the public:local and hashtag:local stream types. * Tell caches to never store server-sent events.	5 years ago
Eugen Rochko	24552b5160	Add whitelist mode (#11291 )	6 years ago
Eugen Rochko	e7353c47db	Change default interface of web and streaming from 0.0.0.0 to 127.0.0.1 (#11302 )	6 years ago
ThibG	d63c3c0cef	Improve streaming server security (#10818 ) * Check OAuth token scopes in the streaming API * Use Sec-WebSocket-Protocol instead of query string to pass WebSocket token Inspired by https://github.com/kubevirt/kubevirt/issues/1242	6 years ago
abcang	ca6c93a2f5	Migrate from uws to cws (#10805 )	6 years ago
Eugen Rochko	13a7f05030	Fix streaming API always attempting to use SSL with Postgres (#10231 ) Fix #10223	6 years ago
Eugen Rochko	dbeab5a036	Fix SSL configuration regression in streaming API (#10225 ) * Fix SSL configuration regression in streaming API Fix #10223 * Fix code style issues and integrate #10219 * Fix dumb thing	6 years ago
Sascha	42e733681a	config: add DB_SSLMODE for managed/remote PG (#10210 ) * config: add DB_SSLMODE for managed/remote PG * streaming: set PG sslmode, defaults to prefer	6 years ago
Gomasy	8d70d3de38	Fix crash when using UNIX socket (#9036 )	6 years ago
Eugen Rochko	369cc5f555	Check if port/socket is available before forking in Streaming API (#9023 ) Previously, the server would attempt taking port/socket in worker process, and if it was taken, fail, which made the master process create a new worker. This led to really high CPU usage if the streaming API was started when the port or socket were not available. Now, before clustering (forking) into worker processes, a test server is created and then removed to check if it can be done.	6 years ago
Eugen Rochko	18e7ef6eda	Add check for missing tag param in streaming API (#8955 ) * Add check for missing tag param in streaming API Fixes error: ``` TypeError: Cannot read property 'toLowerCase' of undefined at app.get (.../streaming/index.js:493:50) ``` * Fix code style issues	6 years ago
Eugen Rochko	774ac47373	Add conversations API (#8832 ) * Add conversations API * Add web UI for conversations * Add test for conversations API * Add tests for ConversationAccount * Improve web UI * Rename ConversationAccount to AccountConversation * Remove conversations on block and mute * Change last_status_id to be a denormalization of status_ids * Add optimistic locking	6 years ago
Eugen Rochko	f37fafe30b	Add health endpoint to streaming API (#8441 ) GET /api/v1/streaming/health Answers with OK. Fix #8337	7 years ago

1 2 3

117 Commits (a75138d07336c2f10a8cbdba86f72f08c81cf9d7)