141 Commits (df3a7e724dc72146a09fd72efd95d7e206b4b881)

Author	SHA1	Message	Date
Eugen Rochko	7d7844a47f	Default follows for new users (#4871) ... When a new user confirms their e-mail, bootstrap their home timeline by automatically following a set of accounts. By default, all local admin accounts (that are unlocked). Can be customized by new admin setting (comma-separated usernames, local and unlocked only)	8 years ago
Eugen Rochko	90712d4293	Fix errors preventing UnsubscribeService from working (#4866)	8 years ago
Eugen Rochko	a4caa7eb62	Fetch statuses/following/followers numbers from ActivityPub collections (#4840)	8 years ago
Eugen Rochko	e7adbf572a	Switch to static URIs, new URI format in both protocols for new statuses (#4815) ... * Decouple Status#local? from uri being nil * Replace on-the-fly URI generation with stored URIs - Generate URI in after_save hook for local statuses - Use static value in TagManager when available, fallback to tag format - Make TagManager use ActivityPub::TagManager to understand new format - Adjust tests * Use other heuristic for locality of old statuses, do not perform long query * Exclude tombstone stream entries from Atom feed * Prevent nil statuses from landing in Pubsubhubbub::DistributionWorker * Fix URI not being saved (#4818) * Add more specs for Status * Save generated uri immediately and also fix method order to minimize diff. * Fix alternate HTML URL in Atom * Fix tests * Remove not-null constraint from statuses migration to speed it up	8 years ago
Eugen Rochko	7dc5035031	Make PreviewCard records reuseable between statuses (#4642) ... * Make PreviewCard records reuseable between statuses **Warning!** Migration truncates preview_cards tablec * Allow a wider thumbnail for link preview, display it in horizontal layout (#4648) * Delete preview cards files before truncating * Rename old table instead of truncating it * Add mastodon:maintenance:remove_deprecated_preview_cards * Ignore deprecated_preview_cards in schema definition * Fix null behaviour	8 years ago
unarist	f7937d903c	Don't process ActivityPub payload if signature is invalid (#4752) ... * Don't process ActivityPub payload if signature is invalid * Fix style issue	8 years ago
Eugen Rochko	4c76402ba1	Serialize ActivityPub alternate link into OStatus deletes, handle it (#4730) ... Requires moving Atom rendering from DistributionWorker (where `stream_entry.status` is already nil) to inline (where `stream_entry.status.destroyed?` is true) and distributing that. Unfortunately, such XML renderings can no longer be easily chained together into one payload of n items.	8 years ago
unarist	7876aed134	Fix deletion of status which has been reblogged (#4728)	8 years ago
Eugen Rochko	00840f4f2e	Add handling of Linked Data Signatures in payloads (#4687) ... * Add handling of Linked Data Signatures in payloads * Add a way to sign JSON, fix canonicalization of signature options * Fix signatureValue encoding, send out signed JSON when distributing * Add missing security context	8 years ago
unarist	b01a19fe39	Fetch reblogs as Announce activity instead of Note object (#4672) ... * Process Create / Announce activity in FetchRemoteStatusService * Use activity URL in ActivityPub for reblogs * Redirect to the original status on StatusesController#show	8 years ago
unarist	d63de55ef8	Fix bugs which OStatus accounts may detected as ActivityPub ready (#4662) ... * Fallback to OStatus in FetchAtomService * Skip activity+json link if that activity is Person without inbox * If unsupported activity was detected and all other URLs failed, retry with ActivityPub-less Accept header * Allow mention to OStatus account in ActivityPub * Don't update profile with inbox-less Person object	8 years ago
Yamagishi Kazutoshi	5f22c0189d	Add support for searching AP users (#4599) ... * Add support for searching AP users * use JsonLdHelper	8 years ago
Eugen Rochko	4e75f0d889	Hook up URL-based resource look-up to ActivityPub (#4589)	8 years ago
Eugen Rochko	b7370ac8ba	ActivityPub delivery (#4566) ... * Deliver ActivityPub Like * Deliver ActivityPub Undo-Like * Deliver ActivityPub Create/Announce activities * Deliver ActivityPub creates from mentions * Deliver ActivityPub Block/Undo-Block * Deliver ActivityPub Accept/Reject-Follow * Deliver ActivityPub Undo-Follow * Deliver ActivityPub Follow * Deliver ActivityPub Delete activities Incidentally fix #889 * Adjust BatchedRemoveStatusService for ActivityPub * Add tests for ActivityPub workers * Add tests for FollowService * Add tests for FavouriteService, UnfollowService and PostStatusService * Add tests for ReblogService, BlockService, UnblockService, ProcessMentionsService * Add tests for AuthorizeFollowService, RejectFollowService, RemoveStatusService * Add tests for BatchedRemoveStatusService * Deliver updates to a local account to ActivityPub followers * Minor adjustments	8 years ago
Eugen Rochko	dd7ef0dc41	Add ActivityPub inbox (#4216) ... * Add ActivityPub inbox * Handle ActivityPub deletes * Handle ActivityPub creates * Handle ActivityPub announces * Stubs for handling all activities that need to be handled * Add ActivityPub actor resolving * Handle conversation URI passing in ActivityPub * Handle content language in ActivityPub * Send accept header when fetching actor, handle JSON parse errors * Test for ActivityPub::FetchRemoteAccountService * Handle public key and icon/image when embedded/as array/as resolvable URI * Implement ActivityPub::FetchRemoteStatusService * Add stubs for more interactions * Undo activities implemented * Handle out of order activities * Hook up ActivityPub to ResolveRemoteAccountService, handle Update Account activities * Add fragment IDs to all transient activity serializers * Add tests and fixes * Add stubs for missing tests * Add more tests * Add more tests	8 years ago
Eugen Rochko	dbaa6a0e13	Fix intermittent test failures due to accidentally reused class instance between threads (#4287)	8 years ago
Eugen Rochko	1fcdaafa6f	Fix webfinger retries (#4275) ... * Do not raise unretryable exceptions in ResolveRemoteAccountService * Removed fatal exceptions from ResolveRemoteAccountService Exceptions that cannot be retried should not be raised. New exception class for those that can be retried (Mastodon::UnexpectedResponseError)	8 years ago
Eugen Rochko	8400bee3b1	Refactor ResolveRemoteAccountService (#4258) ... * Refactor ResolveRemoteAccountService * Remove trailing whitespace * Use redis locks around critical ResolveRemoteAccountService code * Add test for race condition of lock	8 years ago
Akihiko Odaki	89b988cab5	Introduce Ostatus name space (#4164) ... * Wrap methods of ProcessFeedService::ProcessEntry in classes This is a change same with 425acecfdb, except that it has the following changes: * Revert irrelevant change in find_or_create_conversation * Fix error handling for RemoteActivity * Introduce Ostatus name space	8 years ago
Akihiko Odaki (@fn_aki@pawoo.net)	7bacdd718a	Fix PrecomputeFeedService for filtered statuses (#4148)	9 years ago
nullkal	007ab330e6	Use charlock_holmes instead of nkf at FetchLinkCardService (#4080) ... * Specs for language detection * Use CharlockHolmes instead of NKF * Correct mistakes * Correct style * Set hint_enc instead of falling back and strip_tags * Improve specs * Add dependencies	9 years ago
abcang	5e6acf9601	Fix Nokogiri::HTML at FetchLinkCardService (#4072)	9 years ago
Akihiko Odaki (@fn_aki@pawoo.net)	7362469d89	Do not raise an error if PrecomputeFeed could not find any status (#4015)	9 years ago
Akihiko Odaki (@fn_aki@pawoo.net)	7d8e3721ae	Overwrite old statuses with reblogs in PrecomputeFeedService (#3984)	9 years ago
Eugen Rochko	f3be605286	Rename FollowRemoteAccountService to ResolveRemoteAccountService (#3847) ... Rename Activitypub to ActivityPub	9 years ago
Eugen Rochko	e17c2e5da5	Batched remove status service (#3735) ... * Make Pubsubhubbub::DistributionWorker handle both single stream entry arguments, as well as arrays of stream entries * Add BatchedRemoveStatusService, make SuspendAccountService use it * Improve method names * Add test * Add more tests * Use PuSH payloads of 100 to have a clear mapping of 1000 input statuses -> 10 PuSH payloads It was nice while it lasted	9 years ago
Eugen Rochko	ce812466c7	Fix removal of status sending the original status to mentioned users instead of delete Salmon (#3672) ... * Fix removal of status sending the original status to mentioned users instead of delete Salmon, add test * Create remove_status_service_spec.rb	9 years ago
unarist	e34c5a3503	Fix 500 errors on searching invalid URLs (#3613)	9 years ago
René Klačan	037f96c5ae	Don't follow account if it's already followed (#3575) ... Closes https://github.com/tootsuite/mastodon/issues/3102	9 years ago
Jack Jennings	33f669a5f8	Add status destroy authorization to policy (#3453) ... * Add status destroy authorization to policy * Create explicit unreblog status authorization	9 years ago
happycoloredbanana	9642601126	Avoid comparing domains when looking for an exact match of a local account (#3336)	9 years ago
Eugen Rochko	f1ab70649b	Add buttons to block and unblock domain (#3127) ... * Add buttons to block and unblock domain * Relationship API now returns "domain_blocking" status for accounts, rename "block entire domain" to "hide entire domain", fix unblocking domain, do not block notifications from domain-blocked-but-followed people, do not send Salmons to domain blocked users * Add test * Personal domain blocks shouldn't affect Salmon after all, since in this direction of communication the control is very thin when it comes to public stuff. Best stay consistent and not affect federation in this way * Ignore followers and follow request from domain blocked folks, ensure account domain blocks are not created for empty domain, and avoid duplicates in validation * Purge followers when blocking domain (without soft-blocks, since they are useless here) * Add tests, fix local timeline being empty when having any domain blocks	9 years ago
Matt Jankowski	db4119f971	Specs for precompute feed service (#3142) ... * Add spec for precompute feed service * Refactor PrecomputeFeedService * spec wip	9 years ago
Eugen Rochko	620d0d8029	Account domain blocks (#2381) ... * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation * Adding account domain blocks that filter notifications and public timelines * Add tests for domain blocks in notifications, public timelines Filter reblogs of blocked domains from home * Add API for listing and creating account domain blocks * API for creating/deleting domain blocks, tests for Status#ancestors and Status#descendants, filter domain blocks from them * Filter domains in streaming API * Update account_domain_block_spec.rb	9 years ago
Eugen Rochko	1efda1c453	Fix #2572 - Resolve preview cards for remote statuses as well as local ones (#3088)	9 years ago
Eugen Rochko	af706583bd	Fix change of status callbacks not setting in_reply_to_account_id and (#3072) ... possibly others when expected. Add some tests for it	9 years ago
Eugen Rochko	d0dd9eb5b5	Feature conversations muting (#3017) ... * Add <ostatus:conversation /> tag to Atom input/output Only uses ref attribute (not href) because href would be the alternate link that's always included also. Creates new conversation for every non-reply status. Carries over conversation for every reply. Keeps remote URIs verbatim, generates local URIs on the fly like the rest of them. * Conversation muting - prevents notifications that reference a conversation (including replies, favourites, reblogs) from being created. API endpoints /api/v1/statuses/:id/mute and /api/v1/statuses/:id/unmute Currently no way to tell when a status/conversation is muted, so the web UI only has a "disable notifications" button, doesn't work as a toggle * Display "Dismiss notifications" on all statuses in notifications column, not just own * Add "muted" as a boolean attribute on statuses JSON For now always false on contained reblogs, since it's only relevant for statuses returned from the notifications endpoint, which are not nested Remove "Disable notifications" from detailed status view, since it's only relevant in the notifications column * Up max class length * Remove pending test for conversation mute * Add tests, clean up * Rename to "mute conversation" and "unmute conversation" * Raise validation error when trying to mute/unmute status without conversation	9 years ago
Eugen Rochko	a231f915a0	Fix #2955 - Send HEAD request ahead of GET when fetching URL previews (#2972)	9 years ago
Matt Jankowski	682507bc3c	Specs for pubsub subscribe service (#2951) ... * Add spec for pubsubhubbub/subscribe * Refactor pubsubhubbub/subscribe service	9 years ago
Matt Jankowski	441d6dc734	Spec and refactor for pubsubhubbub/unsubscribe service (#2946) ... * Add coverage for pubsub unsubscribe service * Refactor pubsub unsubscribe service	9 years ago
Matt Jankowski	5bea42412e	Services specs for subscribe and unsubscribe (#2928) ... * Add specs for unsubscribe service * Fix non existent methods in unsubscribe service * Clean up status handling in subscribe service	9 years ago
Matt Jankowski	b8ba719f73	Unblock domain service specs/refactor (#2867) ... * Add spec for unblock domain service * Refactor UnblockDomainService	9 years ago
alpaca-tc	74036a2c9d	Hotfix convert string from symbol (#2856) ... * Convert key to string from symbol * Prefer :public_send instead of	9 years ago
alpaca-tc	59804abc3d	Optimize MuteService and AfterBlockService (#2836)	9 years ago
Matt Jankowski	484c9709b6	Misc spec coverage improvements (#2821) ... * Dont use raise_error by itself (avoids warning) * Add coverage for AccountFilter * Improve coverage and refactor for Subscription#lease_seconds * Improve coverage and refactor for NotificationMailer * Simplify assignment of min/max threshold on subscription	9 years ago
Matt Jankowski	20c37ed0f9	Add specs (and refactor) of FetchRemoteResourceService and SearchService (#2812) ... * Coverage for fetch remote resource service * Refactor fetch remote resource service * Coverage for search service * Refactor search service	9 years ago
Eugen Rochko	81584779cb	More robust PuSH subscription refreshes (#2799) ... * Fix #2473 - Use sidekiq scheduler to refresh PuSH subscriptions instead of cron Fix an issue where / in domain would raise exception in TagManager#normalize_domain PuSH subscriptions refresh done in a round-robin way to avoid hammering a single server's hub in sequence. Correct handling of failures/retries through Sidekiq (see also #2613). Optimize Account#with_followers scope. Also, since subscriptions are now delegated to Sidekiq jobs, an uncaught exception will not stop the entire refreshing operation halfway through Fix #2702 - Correct user agent header on outgoing http requests * Add test for SubscribeService * Extract #expiring_accounts into method * Make mastodon:push:refresh no-op * Queues are now defined in sidekiq.yml * Queues are now in sidekiq.yml	9 years ago
alpaca-tc	74c8ca699c	Delete records in smaller transaction (#2802)	9 years ago
Eugen Rochko	13c16b4e95	Likely fix #2458, fix #2031 - handle out-of-order deletes for statuses (#2734) ... * Likely fix #2458, fix #2031 - handle out-of-order deletes for statuses If a delete arrives before the original status, cache that information for 6h, and if the original status arrives in that window, ignore it * Add test case	9 years ago
ThibG	8d4e7504b1	Additional specs for URI handling (#2759)	9 years ago
ThibG	bea97ea766	Add rspec to further specify FollowRemoteAccountService (#2414)	9 years ago
Patrick Figel	8ac7fca5d0	Set correct attachment type for rejected media (#2599) ... In #2110, a new attachment type "unknown" was introduced for attachments that were rejected due to a domain being blocked using reject_media. However, the "type" field was never set to "unknown" because a default value of "0" (image) is set for that column, causing the `type.blank?` expression to always equal false. This version uses type_changed? instead, causing the type to be set to "unknown" unless a type has been explicitly set. This introduces a small change in behaviour causing the type to be set to unknown before paperclip calls `before_post_process`. Presumably this behaviour is more appropriate than the current one because the attachment type has not been determined by that point. Included are new tests for `ProcessFeedService` and `UpdateRemoteProfileService` which now check that remote media is downloaded for non-blocked domains and is rejected for others.	9 years ago
Eugen Rochko	2af4f3c4e2	Improve shared status verification (#2525) ... * Instead of parsing shared status contents verbatim, make roundtrip to purported original URL. Confirm that the "original" URL is from the same domain as the author it claims to be from. * Fix obvious typo, add comment * Use URI look-up first * Add test, update Goldfinger dependency to make less useless HTTP requests per Webfinger lookup	9 years ago
Eugen Rochko	88725d6ce8	OEmbed support for PreviewCard (#2337) ... * OEmbed support for PreviewCard * Improve ProviderDiscovery code failure treatment * Do not crawl links if there is a content warning, since those don't display a link card anyway * Reset db schema * Fresh migrate * Fix rubocop style issues Fix #1681 - return existing access token when applicable instead of creating new * Fix test * Extract http client to helper * Improve oembed controller	9 years ago
Matt Jankowski	8857cabca4	Domain block service cleanup (#2490) ... * Add coverage for domain block service with silence * Get rid of warning about find_each and order * Move domain_block to attr_reader * Move optional clear_media into silence_accounts method * Use blocked_domain method to reduce passed vars * Extract blocked_domain_accounts method to find accounts on the domain * Extract media_from_blocked_domain method to find relevant attachments * Separate destruction of account images and account attachments	9 years ago
Eugen Rochko	8b5179d006	Fix #2402 - Add Idempotency-Key header to PostStatusService that prevents (#2419) ... duplicates. Web UI regenerates UUID for that header every time the compose form is changed or successfully submitted Also, fix Farsi i18n overwriting the English one	9 years ago
178inaba	d2159deaf2	Optimize account search (#2421)	9 years ago
Eugen	17c591ffba	Punycode URI normalization (#2370) ... * Fix #2119 - Whenever about to send a HTTP request, normalize the URI * Add test for IDN request in FetchLinkCardService * Perform IDN normalization on domains before they are stored in the DB	9 years ago
Eugen	1d47910d3b	Fix possibility of unrightful webfinger redirect (#2147) ... * Fix possibility of unrightful webfinger redirect * Add more tests for FollowRemoteAccountService	9 years ago
Matt Jankowski	297c11dba2	Language detection refactor (#2099) ... * Extract detect_language to separate class * Use default locale, not just en * Add spec to confirm that whatlanguage cant identify empty string * Allow account locale to override default in language detector * PostStatusService supplies an account to detect language	9 years ago
Tomohiro Suwa	3399dd7a66	Fix nil query_username (#2013)	9 years ago
Matt Jankowski	40fd1de488	Account search service refactor (#1791) ... * Begin coverage for account search service * Coverage for hashtag query * Coverage for calling local vs remote find based on domain presence * Spec to check that exact matches are not duped * Coverage of resolve option * Coverage for account being provided * Start to refactor account search service * Isolate query username and domain methods * Isolate exact_match method * Extract methods for local and remote results * Simplify local vs remote and account isoliation * Extract methods for local and remote results * Simplify de-dupe of exact match * Simplify logic to check for non exact remotes * Cache some methods * Remove nil from exact_match from results array * Return exact matches first * Use find_remote even with no domain Account.find_local is just an alias for Account.find_remote(user, nil) - so we can not bother with the conditional here, and call find_remote directly.	9 years ago
Eugen	982fef811e	Fix #1141, fix #1126 - Avatar/profile info fetching (#1215) ... * Fix #1141, fix #1126 - Work through UpdateRemoteProfileService for both <feed> and <entry> top-level tags * Improve code quality, remove line unrelated to fix	9 years ago
Chad Pytel	ad5ddd5e95	Use I18n for media attachment validation errors ... These are currently user facing errors, but are not localized. This adds the ability for these messages to be localized.	9 years ago
Chad Pytel	13c0077003	Add specs for PostStatusService ... This implements all pending specs, and adds additional coverage for the following functionality: * Normal status creation * Creating a reply status * Creating a sensitive status * Creating a status with spoiler text * A status with no spoiler text gets an empty string for spoiler text * Creating a status with custom visibility * Creating a status for an application * Processing mentions * Processing Hashtags * Pinging PuSH hubs * Crawling links * Attaching media	9 years ago
Chad Pytel	38bec79811	Add specs for media attachment validations ... There are currently not specs for the two media validations that are performed by `PostStatusService`. This adds specs for the validations that ensure that you cannot attach more than four files, and that a status cannot have both image and video attachments.	9 years ago
Eugen Rochko	5442083b3c	Split SalmonWorker into smaller parts, move profile updating into another job	9 years ago
Kurtis Rainbolt-Greene	9ae9ecdebe	Quick attempt to get pull requests passing	9 years ago
Eugen Rochko	68f829e11c	Add basic logging of who resolved report	9 years ago
Kit Redgrave	442fdbfc53	Mute button progress so far. WIP, doesn't entirely work correctly.	9 years ago
Eugen Rochko	720ff55262	Adding more unit tests. Fixing Salmon slaps XML	9 years ago
Eugen Rochko	0518492158	Stop trying to shoehorn all Salmon updates into the poor database-connected ... StreamEntry model. Simply render Salmon slaps as they are needed	9 years ago
Eugen Rochko	d9ca46b464	Cleaning up format of broadcast real-time messages, removing ... redis-backed "mentions" timeline as redundant (given notifications)	9 years ago
Eugen Rochko	6d98a73180	Domain blocks now have varying severity - auto-suspend vs auto-silence	9 years ago
Eugen Rochko	6de079a5af	Removing external hub completely, fix #333 fixing digit-only hashtags, ... removing web app capability from non-webapp pages	9 years ago
Eugen Rochko	2cb3dc5e5a	Update hub URL and re-subscribe if hub URL changes	9 years ago
Eugen Rochko	7b7bf834e9	Fix OAuth authorization page and add a spec for it	9 years ago
Eugen Rochko	cd765f26a9	Upgrade ruby to 2.3.1	9 years ago
Eugen Rochko	93212bc2c4	Add test for FanOutOnWriteService	9 years ago
Eugen Rochko	81065bc06c	Adding test for ProcessFeedService	9 years ago
Eugen Rochko	22a8801dbc	Adding domain blocks	9 years ago
Eugen Rochko	7b9a4af311	API for blocking and unblocking	9 years ago
Eugen Rochko	c6b0311b86	Fix #54 - Fetch remote accounts by URL from mentions ... Fetching atom extracted from FetchRemoteAccountService and FetchRemoteStatusService into FetchAtomService. Mentions of the constant "http://activityschema.org/collection/public" skipped as it's not a real URL/user.	9 years ago
Eugen Rochko	adffc7a495	Fix #43	9 years ago
Eugen Rochko	02e4fb2e06	Only re-download avatar if URL changed (fix #19)	10 years ago
Eugen Rochko	d4892ace62	Adding more test stubs	10 years ago
Eugen Rochko	7837afbb5f	Removing autogenerated test stubs that were not needed	10 years ago
Eugen Rochko	3b4e04dc32	Fixing some bugs, adding pending test examples	10 years ago
Eugen Rochko	23d08c6749	Changing the use of config constants to the Rails configuration object	10 years ago
Eugen Rochko	11ff92c9d7	Adding a test for ReblogService, fixing mentions for remote statuses	10 years ago
Eugen Rochko	71fe24096c	Adding a Mention model, test stubs	10 years ago