83 Commits (f3f06dafe34de5cb8562bc203f3c4557821217e5)

Author	SHA1	Message	Date
Eugen Rochko	e0c27a5047	Add ability to manage which websites can credit you in link previews (#31819)	5 months ago
Mike Dalessio	a0ea2fa3b0	Change fetch link card service to parse as HTML5 (#31814)	5 months ago
Christian Schmidt	4853a2bada	Add Accept-Language header when fetching preview card (#31232)	6 months ago
David Roetzel	967505ee9b	Add size limit for all PreviewCard URLs (#30973)	7 months ago
David Roetzel	016c1e4e78	Improve handling of encoding problems when creating link previews (#30929)	7 months ago
David Roetzel	ff08d99d4d	Catch encoding errors when creating link previews. (#30853)	7 months ago
David Roetzel	42adb6eaee	Add size limit for link preview URLs (#30854)	7 months ago
Eugen Rochko	128987eded	Add support for `fediverse:creator` OpenGraph tag (#30398)	8 months ago
Joshua Byrd	6282b6da77	Fix og:image requests when html in a web page is over 1.megabyte (#30362)	9 months ago
Eugen Rochko	0d14fcebae	Change link previews to keep original URL from the status (#27312)	1 year ago
Claire	6b896b20cc	Add primary key to preview_cards_statuses join table (includes deduplication migration) (#25243)	2 years ago
Christian Schmidt	f96e4b3047	Use original URL in preview if it redirects to 4xx page (#26200)	2 years ago
Nick Schonning	c66250abf1	Autofix Rubocop Regex Style rules (#23690) ... Co-authored-by: Claire <claire.github-309c@sitedethib.com>	2 years ago
Matt Jankowski	f1c1dd0118	Rename `with_lock` to `with_redis_lock` to avoid confusion with ActiveRecord's method (#24741)	2 years ago
Nick Schonning	0cfdd1a401	Enable Rubocop Style/StringConcatenation defaults (#23792)	2 years ago
Nick Schonning	2177daeae9	Autofix Rubocop Style/RedundantBegin (#23703)	2 years ago
Nick Schonning	ed570050c6	Autofix Rails/EagerEvaluationLogMessage (#23429) ... * Autofix Rails/EagerEvaluationLogMessage * Update spec for debug block syntax	2 years ago
Eugen Rochko	6cf57c6765	Refactor how Redis locks are created (#18400) ... * Refactor how Redis locks are created * Fix autorelease duration on account deletion lock	3 years ago
Eugen Rochko	3917353645	Fix single Redis connection being used across all threads (#18135) ... * Fix single Redis connection being used across all Sidekiq threads * Fix tests	3 years ago
Eugen Rochko	cefa526c6d	Refactor formatter (#17828) ... * Refactor formatter * Move custom emoji pre-rendering logic to view helpers * Move more methods out of Formatter * Fix code style issues * Remove Formatter * Add inline poll options to RSS feeds * Remove unused helper method * Fix code style issues * Various fixes and improvements * Fix test	3 years ago
luzpaz	73f5e4a1d9	Fix various typos (#17621) ... Found via `codespell -q 3 -S ./CHANGELOG.md,./AUTHORS.md,./config/locales,./app/javascript/mastodon/locales -L ba,keypair,medias,ro`	3 years ago
Eugen Rochko	6e50134a42	Add trending links (#16917) ... * Add trending links * Add overriding specific links trendability * Add link type to preview cards and only trend articles Change trends review notifications from being sent every 5 minutes to being sent every 2 hours Change threshold from 5 unique accounts to 15 unique accounts * Fix tests	3 years ago
Eugen Rochko	39cdf61ab7	Add support for structured data and more OpenGraph tags to link cards (#16938) ... Save preview cards under their canonical URL Increase max redirects to follow from 2 to 3	3 years ago
Claire	9a19227f17	Fix some RedisLocks auto-releasing too fast (#16276) ... * Fix Delete and Create-related locks expiring too fast Fixes #16238 By default, RedisLock expires after 10 seconds, which may not be enough to process statuses, especially when those have attached media files. This commit extends those 10 seconds to 15 minutes, which should be plenty enough to handle any status, while being short enough to not waste many sidekiq job retries in the exceedingly rare case in which a sidekiq process would crash when processing a `Create` or `Delete`. * Fix other RedisLock autorelease durations Fixes #15645 - things that only perform a few simple database queries (e.g. finding and saving a record) have been left unchanged, so they'll still use the default 10s duration - things that perform significantly more complex database queries have been changed to a 5 minutes timeout - things that perform multiple HTTP queries have been changed to a 15 minutes timeout	4 years ago
Claire	5614e6724e	Fix URL scanning in note length validator and preview card fetching (#15827) ... * Add tests * Fix URL scanning in note length validator and preview card fetching	4 years ago
Claire	65db262550	Update twitter-text from 1.14 to 3.1.0 and fix toot character counting (#15382) ... * Update twitter-text from 1.14 to 3.1.0 * Disable emoji parsing * Properly depend on twitter-text for url detection * Fix some URLs being wrongly detected client-side * Add test for server-side validation of non-autolinkable URLs * Fix server-side status length counting	4 years ago
Takeshi Umeda	7f1c56954b	Fix first return value of FetchLinkCardService.html method (#15630)	4 years ago
luigi	087ed84367	Optimize map { ... }.compact calls (#15513) ... * Optimize map { ... }.compact using Enumerable#filter_map, supported since Ruby 2.7 * Add poyfill for Enumerable#filter_map	4 years ago
dependabot[bot]	8972e5f7f6	Bump rubocop from 0.86.0 to 0.88.0 (#14412) ... * Bump rubocop from 0.86.0 to 0.88.0 Bumps [rubocop](https://github.com/rubocop-hq/rubocop) from 0.86.0 to 0.88.0. - [Release notes](https://github.com/rubocop-hq/rubocop/releases) - [Changelog](https://github.com/rubocop-hq/rubocop/blob/master/CHANGELOG.md) - [Commits](https://github.com/rubocop-hq/rubocop/compare/v0.86.0...v0.88.0) Signed-off-by: dependabot[bot] <support@github.com> * Fix for latest RuboCop Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Yamagishi Kazutoshi <ykzts@desire.sh>	4 years ago
Eugen Rochko	ed04697510	Change User-Agent of link preview fetching service to include "Bot" (#14248) ... This forces Twitter to render OpenGraph tags in the response	5 years ago
ThibG	b364175e1b	Fix link crawler not specifying accepted content-type (#12646) ... The link crawler expects HTML documents, so set the `Accept` header accordingly. Fixes #12618	5 years ago
ThibG	c656cc2191	Fix FetchLinkCardServices crashing on a tags without a target (#12159) ... * Add test for links without targets * Fix FetchLinkCardServices crashing on a tags without a target	5 years ago
Eugen Rochko	d14e74eff5	Add cache for OEmbed endpoints to avoid extra HTTP requests (#12403) ... * add youtube oembed endpoint * add check for oembed endpoint * change unless for a more readable if * clear blank lines * endpoint via https * Fix string literal in condition * use cache for endpoints * use cache for endpoints * clean up and adding check * clean up and remove redundant return * add html check * add false to return * use double quotes * use double quotes * Clean up	5 years ago
nightpool	9762fe382c	microformat mentions can have an implicit property (#12189) ... See the first example here: http://microformats.org/wiki/microformats2#hyperlinked_person	5 years ago
Eugen Rochko	9ba40a6bfd	Remove HEAD request from fetching link previews (#12028) ... It is not really necessary and we need to reduce requests	5 years ago
Eugen Rochko	3ec80c7aec	Fix preview card image not being re-fetched even if link is re-posted (#11981) ... Fix #11956	5 years ago
Eugen Rochko	5d3feed191	Refactor fetching of remote resources (#11251)	6 years ago
Eugen Rochko	b851456139	Remove Atom feeds and old URLs in the form of `GET /:username/updates/:id` (#11247)	6 years ago
Daniel Aleksandersen	10bdd912d6	Treat meta[property] as a space-separated list (#10604) ... The @property attribute in HTML is a space-separated list of values. This change normalizes whitespace and finds the desired value in the list instead of requiring an exact single-value match. More details: https://www.ctrl.blog/entry/rdfa-socialmedia-metadata.html	6 years ago
ThibG	e709b8da0d	Ignore low-confidence CharlockHolmes guesses when parsing link cards (#9510) ... * Add failing test for windows-1251 link cards * Ignore low-confidence CharlockHolmes guesses Fixes #9466 * Fix no method error when charlock holmes cannot detect charset	6 years ago
ThibG	9b89c62d43	Check that twitter:player is valid before using it (#9254) ... Fixes #9251	6 years ago
ThibG	a03d506626	Fix Pleroma mentions being fetched as preview cards (#9158)	6 years ago
Eugen Rochko	795f0107d2	Include preview cards in status entity in REST API (#9120) ... * Include preview cards in status entity in REST API * Display preview card in-stream * Improve in-stream display of preview cards	6 years ago
ThibG	7fee968e9f	Do not fetch preview card for mentioned users (#6934)	6 years ago
Eugen Rochko	f4d549d300	Redesign forms, verify link ownership with rel="me" (#8703) ... * Verify link ownership with rel="me" * Add explanation about verification to UI * Perform link verifications * Add click-to-copy widget for verification HTML * Redesign edit profile page * Redesign forms * Improve responsive design of settings pages * Restore landing page sign-up form * Fix typo * Support <link> tags, add spec * Fix links not being verified on first discovery and passive updates	6 years ago
ThibG	bd9e47e9be	Handle relative URLs when fetching OEmbed/OpenGraph cards (#8669)	7 years ago
Yamagishi Kazutoshi	e3fb528d12	Skip processing when HEAD method returns 501 (#7730)	7 years ago
Akihiko Odaki	55fd55714a	Raise Mastodon::RaceConditionError if Redis lock failed (#7511) ... An explicit error allows user agents to know the error and Sidekiq to retry.	7 years ago
Yamagishi Kazutoshi	d2ee48977c	Rescue Mastodon::LengthValidationError in FetchLinkCardService (#7424)	7 years ago
Eugen Rochko	cb5b5cb5f7	Slightly reduce RAM usage (#7301) ... * No need to re-require sidekiq plugins, they are required via Gemfile * Add derailed_benchmarks tool, no need to require TTY gems in Gemfile * Replace ruby-oembed with FetchOEmbedService Reduce startup by 45382 allocated objects * Remove preloaded JSON-LD in favour of caching HTTP responses Reduce boot RAM by about 6 MiB * Fix tests * Fix test suite by stubbing out JSON-LD contexts	7 years ago