summaryrefslogtreecommitdiff
path: root/packages/backend/src/queue (follow)
Commit message (Collapse)AuthorAgeFilesLines
* allow user to be deleted if profile is missingHazelnoot2025-05-121-2/+2
|
* delete user registry itemsHazelnoot2025-05-121-1/+8
|
* don't sent account deletion notice until after it actually completesHazelnoot2025-05-121-11/+29
|
* add more manual steps to process account deletion in smaller chunksHazelnoot2025-05-121-7/+169
|
* delete user reactions before notesHazelnoot2025-05-121-31/+31
|
* baseQueueOptions > baseWorkerOptionsMarie2025-04-241-1/+1
|
* merge upstream againHazelnoot2025-04-242-10/+20
|\
| * feat: Job queue inspector (#15856)syuilo2025-04-192-10/+20
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * wip * wip * Update job-queue.vue * wip * wip * Update job-queue.vue * wip * Update job-queue.vue * wip * Update QueueService.ts * Update QueueService.ts * Update QueueService.ts * Update job-queue.vue * wip * wip * wip * Update job-queue.vue * wip * Update MkTl.vue * wip * Update index.vue * wip * wip * Update MkTl.vue * 🎨 * jobs search * wip * Update job-queue.vue * wip * wip * Update job-queue.vue * Update job-queue.vue * Update job-queue.vue * Update job-queue.vue * wip * Update job-queue.job.vue * wip * wip * wip * Update MkCode.vue * wip * Update job-queue.job.vue * wip * Update job-queue.job.vue * Update misskey-js.api.md * Update CHANGELOG.md * Update job-queue.job.vue
* | fix backend lint errorsHazelnoot2025-04-022-2/+2
| |
* | lint and type fixesHazelnoot2025-04-012-3/+5
| |
* | merge upstreamHazelnoot2025-03-254-8/+10
|\|
| * Fix: Don't delete remote emoji when import zip (#15674)Yuri Lee2025-03-191-0/+2
| | | | | | | | | | | | | | | | | | | | | | * Fix: Don't delete remote emoji when import zip * Update packages/backend/src/queue/processors/ImportCustomEmojisProcessorService.ts Co-authored-by: zyoshoka <107108195+zyoshoka@users.noreply.github.com> --------- Co-authored-by: zyoshoka <107108195+zyoshoka@users.noreply.github.com>
| * tweak error logsyuilo2025-02-171-2/+2
| |
| * update deps (#15311)syuilo2025-02-152-6/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * wip * bump misskey-dev/eslint-plugin * lint fixes (backend) * lint fixes (frontend) * lint fixes (frontend-embed) * rollback nsfwjs to 4.2.0 ref: infinitered/nsfwjs#904 * rollback openapi-typescript to v6 v7でOpenAPIのバリデーションが入るようになった関係でスコープ外での変更が避けられないため一時的に戻した * lint fixes (misskey-js) * temporarily disable errored lint rule (frontend-shared) * fix lint * temporarily ignore errored file for lint (frontend-shared) * rollback simplewebauthn/server to 12.0.0 v13 contains breaking changes that require some decision making * lint fixes (frontend-shared) * build misskey-js with types * fix(backend): migrate simplewebauthn/server to v12 * fix(misskey-js/autogen): ignore indent rules to generate consistent output * attempt to fix test changes due to capricorn86/happy-dom#1617 (XMLSerializer now produces valid XML) * attempt to fix test changes due to capricorn86/happy-dom#1617 (XMLSerializer now produces valid XML) * fix test * fix test * fix test * Apply suggestions from code review Co-authored-by: anatawa12 <anatawa12@icloud.com> * bump summaly to v5.2.0 * update tabler-icons to v3.30.0-based --------- Co-authored-by: かっこかり <67428053+kakkokari-gtyih@users.noreply.github.com> Co-authored-by: anatawa12 <anatawa12@icloud.com>
* | fix startup crash caused by circular reference (SWC is not compatible with ↵Hazelnoot2025-03-211-10/+8
| | | | | | | | forwardRef)
* | support Announce(Activity) activitiesHazelnoot2025-03-211-2/+4
| |
* | fix typo in activity signature mismatch errorHazelnoot2025-03-211-1/+1
| |
* | delete scheduled notes when deleting account - fixes #936dakkar2025-02-241-1/+22
| |
* | delete fetch logs when a note or user is deletedHazelnoot2025-02-161-0/+16
| |
* | don't log slow activities, as this is known to happen under regular ↵Hazelnoot2025-02-161-8/+1
| | | | | | | | circumstances
* | implement AP fetch logsHazelnoot2025-02-161-72/+10
| |
* | rename activity_log and activity_context to ap_inbox_log and ap_contextHazelnoot2025-02-161-15/+15
| |
* | fix activity duration calculationHazelnoot2025-02-161-10/+17
| | | | | | | | | | * Ensure that timing is recorded even if an exception is thrown. * Round to the correct decimal place.
* | print warning when activity processing exceeds 10 seondsHazelnoot2025-02-161-0/+3
| |
* | log inbound activity durationHazelnoot2025-02-161-2/+8
| |
* | add inbound activity logger for debuggingHazelnoot2025-02-161-0/+102
| |
* | fix import order in DeleteAccountProcessorService.tsHazelnoot2025-02-041-1/+1
| |
* | add IdentifiableError.isRetryable to ensure that Identifiable Errors can ↵Hazelnoot2025-02-031-0/+8
| | | | | | | | still terminate a batch process
* | merge upstream 2025-02-03Hazelnoot2025-02-036-27/+26
|\|
| * feat: 新カスタム絵文字管理画面(β)の追加 (#13473)おさむのひと2025-01-201-1/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * wip * wip * wip * wip * wip * wip * wip * wip * fix * fix * fix * fix size * fix register logs * fix img autosize * fix row selection * support delete * fix border rendering * fix display:none * tweak comments * support choose pc file and drive file * support directory drag-drop * fix * fix comment * support context menu on data area * fix autogen * wip イベント整理 * イベントの整理 * refactor grid * fix cell re-render bugs * fix row remove * fix comment * fix validation * fix utils * list maximum * add mimetype check * fix * fix number cell focus * fix over 100 file drop * remove log * fix patchData * fix performance * fix * support update and delete * support remote import * fix layout * heightやめる * fix performance * add list v2 endpoint * support pagination * fix api call * fix no clickable input text * fix limit * fix paging * fix * fix * support search * tweak logs * tweak cell selection * fix range select * block delete * add comment * fix * support import log * fix dialog * refactor * add confirm dialog * fix name * fix autogen * wip * support image change and highlight row * add columns * wip * support sort * add role name * add index to emoji * refine context menu setting * support role select * remove unused buttons * fix url * fix MkRoleSelectDialog.vue * add route * refine remote page * enter key search * fix paste bugs * fix copy/paste * fix keyEvent * fix copy/paste and delete * fix comment * fix MkRoleSelectDialog.vue and storybook scenario * fix MkRoleSelectDialog.vue and storybook scenario * add MkGrid.stories.impl.ts * fix * [wip] add custom-emojis-manager2.stories.impl.ts * [wip] add custom-emojis-manager2.stories.impl.ts * wip * 課題はまだ残っているが、ひとまず完了 * fix validation and register roles * fix upload * optimize import * patch from dev * i18n * revert excess fixes * separate sort order component * add SPDX * revert excess fixes * fix pre test * fix bugs * add type column * fix types * fix CHANGELOG.md * fix lit * lint * tweak style * refactor * fix ci * autogen * Update types.ts * CSS Module化 * fix log * 縦スクロールを無効化 * MkStickyContainer化 * regenerate locales index.d.ts * fix * fix * テスト * ランダム値によるUI変更の抑制 * テスト * tableタグやめる * fix last-child css * fix overflow css * fix endpoint.ts * tweak css * 最新への追従とレイアウト微調整 * ソートキーの指定方法を他と合わせた * fix focus * fix layout * v2エンドポイントのルールに対応 * 表示条件などを微調整 * fix MkDataCell.vue * fix error code * fix error * add comment to MkModal.vue * Update index.d.ts * fix CHANGELOG.md * fix color theme * fix CHANGELOG.md * fix CHANGELOG.md * fix center * fix: テーブルにフォーカスがあり、通常状態であるときはキーイベントの伝搬を止める * fix: ロール選択用のダイアログにてコンディショナルロールを×ボタンで除外できなかったのを修正 * fix remote list folder * sticky footers * chore: fix ci error(just single line-break diff) * fix loading * fix like * comma to space * fix ci * fix ci * removed align-center --------- Co-authored-by: osamu <46447427+sam-osamu@users.noreply.github.com> Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com> Co-authored-by: Sayamame-beans <61457993+Sayamame-beans@users.noreply.github.com>
| * refactor: ↵Take-John2025-01-191-7/+10
| | | | | | | | | | | | | | WebhookDeliverJobDataのcontentフィールドの型を具体的に (#15310) * WebhookDeliverJobDataのcontentフィールドの型を具体的に * typeフィールドの型も変更
| * refactor: ↵おさむのひと2025-01-141-18/+8
| | | | | | | | | | | | | | | | | | SystemWebhook/UserWebhookの配信処理呼び出し部分の改善 (#15035) * UserWebhook側の対処 * SystemWebhook側の対処 * fix test
| * enhance(backend): ↵かっこかり2025-01-113-33/+30
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | チャートの処理を一つずつ行うことでDBの同時接続とタイムアウトを削減 (#15239) * sync charts one-at-a-time to reduce database contention and timeouts * fix merge resolve failure * Update Changelog * update changelog * add comments --------- Co-authored-by: Hazelnoot <acomputerdog@gmail.com>
| * Merge commit from forkJulia2024-11-211-0/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * enhance: Add a few validation fixes from Sharkey See the original MR on the GitLab instance: https://activitypub.software/TransFem-org/Sharkey/-/merge_requests/484 Co-Authored-By: Dakkar <dakkar@thenautilus.net> * fix: primitive 2: acceptance of cross-origin alternate Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 3: validation of non-final url * fix: primitive 4: missing same-origin identifier validation of collection-wrapped activities * fix: primitives 5 & 8: reject activities with non string identifiers Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 6: reject anonymous objects that were fetched by their id * fix: primitives 9, 10 & 11: http signature validation doesn't enforce required headers or specify auth header name Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 14: improper validation of outbox, followers, following & shared inbox collections * fix: code style for primitive 14 * fix: primitive 15: improper same-origin validation for note uri and url Co-Authored-By: Laura Hausmann <laura@hausmann.dev> * fix: primitive 16: improper same-origin validation for user uri and url * fix: primitive 17: note same-origin identifier validation can be bypassed by wrapping the id in an array * fix: code style for primitive 17 * fix: check attribution against actor in notes While this isn't strictly required to fix the exploits at hand, this mirrors the fix in `ApQuestionService` for GHSA-5h8r-gq97-xv69, as a preemptive countermeasure. * fix: primitive 18: `ap/get` bypasses access checks One might argue that we could make this one actually preform access checks against the returned activity object, but I feel like that's a lot more work than just restricting it to administrators, since, to me at least, it seems more like a debugging tool than anything else. * fix: primitive 19 & 20: respect blocks and hide more Ideally, the user property should also be hidden (as leaving it in leaks information slightly), but given the schema of the note endpoint, I don't think that would be possible without introducing some kind of "ghost" user, who is attributed for posts by users who have you blocked. * fix: primitives 21, 22, and 23: reuse resolver This also increases the default `recursionLimit` for `Resolver`, as it theoretically will go higher that it previously would and could possibly fail on non-malicious collection activities. * fix: primitives 25-33: proper local instance checks * revert: fix: primitive 19 & 20 This reverts commit 465a9fe6591de90f78bd3d084e3c01e65dc3cf3c. --------- Co-authored-by: Dakkar <dakkar@thenautilus.net> Co-authored-by: Laura Hausmann <laura@hausmann.dev> Co-authored-by: syuilo <4439005+syuilo@users.noreply.github.com>
* | use `import` configuration for media downloads in notes importerdakkar2025-01-231-2/+2
| |
* | use `import` configuration for downloads in emoji importerdakkar2025-01-231-1/+5
| |
* | fix scheduled replies becoming quote-boostsdakkar2025-01-011-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | thanks to @CenTdemeern1 for triggering this bug! see https://kitsunes.club/notes/a2h1y2rq9n also compare with https://s.thenautilus.net/notes/a2h1y2rqx9 my instance errored out with: > WARN 1 [remote ap] Failed to resolve quote > https://mastodon.social/users/DrALJONES/statuses/110586222749407429 > for note https://kitsunes.club/notes/a2h1y2rq9n: StatusError: 404 Not > Found What happened? * Charlotte scheduled a reply * the processor called `findOneBy` with an undefined `note.renote`, which probably caused a `select` without any `where` * a random note was attached as a quote * that note has been deleted on the original instance but not on kitsuclub's database * the rest of fedi didn't notice the quote
* | re-implement "reduce inbox log spam when fetching blocked / unavailable notes"Hazelnoot2024-12-221-1/+1
| |
* | rethrow everything but non-retryable HTTP errorsdakkar2024-12-221-11/+2
| | | | | | | | | | every job that ends without an exception will be considered "completed" and not retried
* | sync charts one-at-a-time to reduce database contention and timeoutsHazelnoot2024-12-173-33/+27
| |
* | Merge branch 'develop' into feature/2024.10dakkar2024-12-125-0/+165
|\ \
| * | Apply suggestionsMarie2024-12-091-29/+36
| | |
| * | Apply suggestionsMarie2024-12-091-0/+7
| | |
| * | upd: add notification for when scheduled note gets postedMarie2024-12-091-1/+4
| | |
| * | upd: add notification for failures, add reasons for failure, apply suggestionsMarie2024-12-091-13/+46
| | |
| * | feat: 노트 게시를 예약할 수 있음 (yojo-art/cherrypick#483, ↵NoriDev2024-12-095-0/+115
| | | | | | | | | | | | [Type4ny-Project/Type4ny@271c872c](https://github.com/Type4ny-Project/Type4ny/commit/271c872c97f215ef5d8e0be62251dd422a52e5b1))
* | | Merge branch 'develop' into feature/2024.10dakkar2024-11-291-1/+5
|\| |
| * | merge: Clear jobs from blocked domains (resolves #773) (!720)Hazelnoot2024-11-291-1/+5
| |\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | | View MR for information: https://activitypub.software/TransFem-org/Sharkey/-/merge_requests/720 Closes #773 Approved-by: dakkar <dakkar@thenautilus.net> Approved-by: Marie <github@yuugi.dev>
| | * | clarify logging when an inbox job is skipped or failsHazelnoot2024-11-261-1/+5
| | | |
* | | | Merge branch 'develop' into feature/2024.10dakkar2024-11-281-1/+2
|\| | |