summaryrefslogtreecommitdiff
path: root/packages/backend/src/queue (follow)
Commit message (Collapse)AuthorAgeFilesLines
...
| * Merge commit from forkJulia2024-11-211-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * enhance: Add a few validation fixes from Sharkey See the original MR on the GitLab instance: https://activitypub.software/TransFem-org/Sharkey/-/merge_requests/484 Co-Authored-By: Dakkar <dakkar@thenautilus.net> * fix: primitive 2: acceptance of cross-origin alternate Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 3: validation of non-final url * fix: primitive 4: missing same-origin identifier validation of collection-wrapped activities * fix: primitives 5 & 8: reject activities with non string identifiers Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 6: reject anonymous objects that were fetched by their id * fix: primitives 9, 10 & 11: http signature validation doesn't enforce required headers or specify auth header name Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 14: improper validation of outbox, followers, following & shared inbox collections * fix: code style for primitive 14 * fix: primitive 15: improper same-origin validation for note uri and url Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 16: improper same-origin validation for user uri and url * fix: primitive 17: note same-origin identifier validation can be bypassed by wrapping the id in an array * fix: code style for primitive 17 * fix: check attribution against actor in notes While this isn't strictly required to fix the exploits at hand, this mirrors the fix in `ApQuestionService` for GHSA-5h8r-gq97-xv69, as a preemptive countermeasure. * fix: primitive 18: `ap/get` bypasses access checks One might argue that we could make this one actually preform access checks against the returned activity object, but I feel like that's a lot more work than just restricting it to administrators, since, to me at least, it seems more like a debugging tool than anything else. * fix: primitive 19 & 20: respect blocks and hide more Ideally, the user property should also be hidden (as leaving it in leaks information slightly), but given the schema of the note endpoint, I don't think that would be possible without introducing some kind of "ghost" user, who is attributed for posts by users who have you blocked. * fix: primitives 21, 22, and 23: reuse resolver This also increases the default `recursionLimit` for `Resolver`, as it theoretically will go higher that it previously would and could possibly fail on non-malicious collection activities. * fix: primitives 25-33: proper local instance checks * revert: fix: primitive 19 & 20 This reverts commit 465a9fe6591de90f78bd3d084e3c01e65dc3cf3c. --------- Co-authored-by: Dakkar <dakkar@thenautilus.net> Co-authored-by: Laura Hausmann <laura@hausmann.dev> Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com>
* | use `import` configuration for media downloads in notes importerdakkar2025-01-231-2/+2
| |
* | use `import` configuration for downloads in emoji importerdakkar2025-01-231-1/+5
| |
* | fix scheduled replies becoming quote-boostsdakkar2025-01-011-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | thanks to @CenTdemeern1 for triggering this bug! see https://kitsunes.club/notes/a2h1y2rq9n also compare with https://s.thenautilus.net/notes/a2h1y2rqx9 my instance errored out with: > WARN 1 [remote ap] Failed to resolve quote > https://mastodon.social/users/DrALJONES/statuses/110586222749407429 > for note https://kitsunes.club/notes/a2h1y2rq9n: StatusError: 404 Not > Found What happened? * Charlotte scheduled a reply * the processor called `findOneBy` with an undefined `note.renote`, which probably caused a `select` without any `where` * a random note was attached as a quote * that note has been deleted on the original instance but not on kitsuclub's database * the rest of fedi didn't notice the quote
* | re-implement "reduce inbox log spam when fetching blocked / unavailable notes"Hazelnoot2024-12-221-1/+1
| |
* | rethrow everything but non-retryable HTTP errorsdakkar2024-12-221-11/+2
| | | | | | | | | | every job that ends without an exception will be considered "completed" and not retried
* | sync charts one-at-a-time to reduce database contention and timeoutsHazelnoot2024-12-173-33/+27
| |
* | Merge branch 'develop' into feature/2024.10dakkar2024-12-125-0/+165
|\ \
| * | Apply suggestionsMarie2024-12-091-29/+36
| | |
| * | Apply suggestionsMarie2024-12-091-0/+7
| | |
| * | upd: add notification for when scheduled note gets postedMarie2024-12-091-1/+4
| | |
| * | upd: add notification for failures, add reasons for failure, apply suggestionsMarie2024-12-091-13/+46
| | |
| * | feat: 노트 게시를 예약할 수 있음 (yojo-art/cherrypick#483, ↵NoriDev2024-12-095-0/+115
| | | | | | | | | | | | [Type4ny-Project/Type4ny@271c872c](https://github.com/Type4ny-Project/Type4ny/commit/271c872c97f215ef5d8e0be62251dd422a52e5b1))
* | | Merge branch 'develop' into feature/2024.10dakkar2024-11-291-1/+5
|\| |
| * | merge: Clear jobs from blocked domains (resolves #773) (!720)Hazelnoot2024-11-291-1/+5
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | View MR for information: https://activitypub.software/TransFem-org/Sharkey/-/merge_requests/720 Closes #773 Approved-by: dakkar <dakkar@thenautilus.net> Approved-by: Marie <github@yuugi.dev>
| | * | clarify logging when an inbox job is skipped or failsHazelnoot2024-11-261-1/+5
| | | |
* | | | Merge branch 'develop' into feature/2024.10dakkar2024-11-281-1/+2
|\| | |
| * | | allow anonymous activities (resolves #819)Hazelnoot2024-11-261-1/+2
| |/ /
* | | Merge branch 'develop' into feature/2024.10dakkar2024-11-232-4/+22
|\| |
| * | reduce inbox log spam when fetching blocked / unavailable notesHazelnoot2024-11-222-4/+22
| | |
* | | better wording for moderator inactivity messagesdakkar2024-11-221-22/+6
| | |
* | | Merge branch 'develop' into feature/2024.10dakkar2024-11-221-0/+2
|\| |
| * | Fix style errorJulia Johannesen2024-11-201-2/+1
| | |
| * | fix: primitives 5 & 8: reject activities with non-string identifiersLaura Hausmann2024-11-201-0/+3
| | |
* | | Merge tag '2024.10.1' into feature/2024.10dakkar2024-11-085-20/+333
|\ \ \ | |/ / |/| / | |/
| * feat: ↵おさむのひと2024-10-131-13/+178
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 運営のアクティビティが一定期間ない場合は通知+招待制に移行した際に通知 (#14757) * feat: 運営のアクティビティが一定期間ない場合は通知+招待制に移行した際に通知 * fix misskey-js.api.md * Revert "feat: 運営のアクティビティが一定期間ない場合は通知+招待制に移行した際に通知" This reverts commit 3ab953bdf87f28411a1a10bce787a23d238cda80. * 通知をやめてユーザ単位でのお知らせ機能に変更 * テスト用実装を戻す * Update packages/backend/src/queue/processors/CheckModeratorsActivityProcessorService.ts Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com> * fix remove empty then --------- Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com>
| * feat: ↵syuilo2024-10-132-18/+33
| | | | | | | | | | | | | | | | | | | | | | | | | | リモートサーバーのサーバー情報を収集しないオプション (#14634) * wip * wip * Update FetchInstanceMetadataService.ts * Update FetchInstanceMetadataService.ts * Update types.ts
| * fix(backend): キューのエラーログを簡略化するように (#14748)かっこかり2024-10-111-38/+48
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * reduce federation log spam * Don't record stack trace for unrecoverable errors. * Avoid logging duplicate stace traces. (cherry picked from commit ed0570110bf8cb8e8959591dccfa3c35999106ce) * improve error summaries (cherry picked from commit 20dd66f735d9778df0371001e303549dce619260) * fix lint errors (cherry picked from commit 83869e1c470b12b3bf4b23d885514d926620662a) * condense job info (cherry picked from commit 786702e076ad1af14538849512ad31c0ced7afe6) * fix maxAttempts calculation (cherry picked from commit b4d10aa8f821e594ec9c907eb2a5bdb3c73c67d5) * condense error info (cherry picked from commit f62cd8941ced74a4865aa5eae4f4a1c7aa1d30f1) * normalize ID logging (cherry picked from commit d8e1e4890d28347239162e26235eb68b1ff96654) * further condense error details (cherry picked from commit d867c2089b3b24680df0713a2aa0914789e45670) * collapse AbortErrors (cherry picked from commit 5171ba7113ebc7242527768afb9ab4cec534e3b3) * don't log job name unless it has one (cherry picked from commit a5316c06ed770b60f7b4c7ff5aa8c71cc0558db7) * Update Changelog * Record origin --------- Co-authored-by: Hazel K <acomputerdog@gmail.com>
| * feat(backend): ↵おさむのひと2024-10-113-0/+133
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | 7日間運営のアクティビティがないサーバを自動的に招待制にする (#14746) * feat(backend): 7日間運営のアクティビティがないサーバを自動的に招待制にする * fix RoleService. * fix * fix * fix * add test and fix * fix * fix CHANGELOG.md * fix test
| * fix(backend/test): #14558 ↵かっこかり2024-10-051-1/+1
| | | | | | | | | | | | | | | | | | | | | | 以降e2eテストがたまに失敗する問題を修正 (#14709) * fix(backend/test): MisskeyIO#727 以降e2eテストがたまに失敗する問題を修正 (MisskeyIO#735) * :v: --------- Co-authored-by: まっちゃとーにゅ <17376330+u1-liquid@users.noreply.github.com>
* | normalize re-fetch logic between InboxProcessorService and ↵Hazelnoot2024-10-261-0/+1
| | | | | | | | ActivityPubServerService
* | fix public key re-fetch logicHazelnoot2024-10-261-11/+7
| |
* | Merge branch 'develop' into feature/2024.9.0dakkar2024-10-111-37/+47
|\ \
| * | don't log job name unless it has oneHazel K2024-10-081-1/+1
| | |
| * | collapse AbortErrorsHazel K2024-10-081-1/+1
| | |
| * | further condense error detailsHazel K2024-10-081-4/+1
| | |
| * | normalize ID loggingHazel K2024-10-081-4/+4
| | |
| * | condense error infoHazel K2024-10-081-14/+11
| | |
| * | fix maxAttempts calculationHazel K2024-10-081-1/+1
| | |
| * | condense job infoHazel K2024-10-081-5/+15
| | |
| * | fix lint errorsHazel K2024-10-081-1/+1
| | |
| * | improve error summariesHazel K2024-10-081-24/+24
| | |
| * | reduce federation log spamHazel K2024-10-081-15/+21
| | | | | | | | | | | | | | | * Don't record stack trace for unrecoverable errors. * Avoid logging duplicate stace traces.
* | | Merge remote-tracking branch 'misskey/master' into feature/2024.9.0dakkar2024-10-0915-39/+195
|\ \ \ | |/ / |/| / | |/
| * wip (#14643)syuilo2024-09-282-6/+3
| |
| * feat: エクスポート完了時に通知を発行するように (#14484)かっこかり2024-09-269-0/+64
| | | | | | | | | | | | | | | | | | | | | | | | | | * feat: エクスポート完了時に通知を発行するように * Update Changelog * entitity -> entity * fix: ペイロードを含むように * fix icon * exportableEntities -> userExportableEntities
| * perf(backend): Defer instance metadata update (#14558)KOBA7892024-09-261-8/+47
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * Defer instance metadata update * Fix last new line * Fix typo * Add license notice * Fix syntax * Perform deferred jobs on shutdown * Fix missing async/await * Fix typo :) * Update collapsed-queue.ts --------- Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com>
| * Fix: Continue importing from file if single emoji import fails (#14461)Aleteoryx2024-09-241-17/+24
| | | | | | | | | | | | | | | | | | | | * Fix: Continue importing from file if single emoji import fails * Fix indentation --------- Co-authored-by: かっこかり <67428053+kakkokari-gtyih@users.noreply.github.com> Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com>
| * refactor/perf(backend): provide metadata statically (#14601)syuilo2024-09-223-18/+22
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * wip * Update ReactionService.ts * Update ApiCallService.ts * Update timeline.ts * Update GlobalModule.ts * Update GlobalModule.ts * Update NoteEntityService.ts * wip * wip * wip * Update ApPersonService.ts * wip * Update GlobalModule.ts * Update mock-resolver.ts * Update RoleService.ts * Update activitypub.ts * Update activitypub.ts * Update activitypub.ts * Update activitypub.ts * Update activitypub.ts * clean up * Update utils.ts * Update UtilityService.ts * Revert "Update utils.ts" This reverts commit a27d4be764b78c1b5a9eac685e261fee49331d89. * Revert "Update UtilityService.ts" This reverts commit e5fd9e004c482cf099252201c0c1aa888e001430. * vuwa- * Revert "vuwa-" This reverts commit 0c3bd12472b4b9938cdff2d6f131e6800bc3724c. * Update entry.ts * Update entry.ts * Update entry.ts * Update entry.ts * Update jest.setup.ts
| * Misskey® Reactions Buffering Technology™ (#14579)syuilo2024-09-203-0/+45
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * wip * wip * Update ReactionsBufferingService.ts * Update ReactionsBufferingService.ts * wip * wip * wip * Update ReactionsBufferingService.ts * wip * wip * wip * Update NoteEntityService.ts * wip * wip * wip * wip * Update CHANGELOG.md