mirror of
https://github.com/transloadit/uppy.git
synced 2026-07-18 00:55:35 +00:00
6b1abaa541
Closes #4173, kind off ## Problem Current situation with `RateLimitedQueue` - Track concurrency: keep a running count, only dispatch up to limit, accept Infinity. - Priority enqueue: queued handlers sorted by priority; dequeued in that order. - Lifecycle bookkeeping: each job gets abort()/done() hooks; abort for running vs queued differs; decrement active count and advance queue via microtasks. - Requeue placeholders: supports a shouldBeRequeued marker so callers can hold/retry slots without running immediately. - Function wrappers: wrap sync or async fns to enforce the queue and return abortable handles. - Cancellation plumbing: provides abortOn(signal) to bind queued/running work to an AbortSignal; abortable promises carry abort(). - Pausing: pause(duration?) freezes dispatch (optional auto-resume); resume() restarts up to the current limit. - Rate limiting/backoff: rateLimit(duration) pauses, drops concurrency, then ramps it back toward the previous upper bound over time. Case in point: it's some sort of made up, monstrosity data structure trying to be too many things. It also has rate limiting and exponential backoff but that's already in [`fetcher`](https://github.com/transloadit/uppy/blob/main/packages/%40uppy/utils/src/fetcher.ts) too. Would be better if we had separation of concerns and proven data structures. ## Solution A "dumb" promise-based priority queue that doesn't care at all about what a promise does or if it needs to be retried. The promise inside determines if it has retrying and exponential backoff, such as a `fetcher` promise. To not make this a breaking change and a huge diff, we still implement this per uploader, starting with xhr-upload, and keep backwards compatibility in the interface so we can still pass it to `companion-client`, which needs to share the same queue. ## Ideal future When you think about it, it's odd that we implement a queue per uploader if a queue is so central to uppy working correctly. It's even more odd that we also have to inject that queue into `companion-client` per uploader for queue sharing. Ideally, `core` is responsible for having the queue. All uploaders would do is push a promise to `core` and `core` doesn't care if that promise is a tus, xhr, or S3 upload. --------- Co-authored-by: Prakash <qxprakash@gmail.com> |
||
|---|---|---|
| .. | ||
| getDroppedFiles | ||
| AbortController.test.ts | ||
| AbortController.ts | ||
| canvasToBlob.ts | ||
| CompanionClientProvider.ts | ||
| CompanionFile.ts | ||
| dataURItoBlob.test.ts | ||
| dataURItoBlob.ts | ||
| dataURItoFile.test.ts | ||
| dataURItoFile.ts | ||
| delay.test.ts | ||
| delay.ts | ||
| emaFilter.test.ts | ||
| emaFilter.ts | ||
| ErrorWithCause.test.ts | ||
| ErrorWithCause.ts | ||
| fetcher.ts | ||
| fetchWithNetworkError.ts | ||
| fileFilters.ts | ||
| FileProgress.ts | ||
| findAllDOMElements.ts | ||
| findDOMElement.ts | ||
| FOCUSABLE_ELEMENTS.ts | ||
| generateFileID.test.ts | ||
| generateFileID.ts | ||
| getAllowedMetaFields.ts | ||
| getBytesRemaining.test.ts | ||
| getBytesRemaining.ts | ||
| getETA.test.ts | ||
| getETA.ts | ||
| getFileNameAndExtension.test.ts | ||
| getFileNameAndExtension.ts | ||
| getFileType.test.ts | ||
| getFileType.ts | ||
| getFileTypeExtension.test.ts | ||
| getFileTypeExtension.ts | ||
| getSocketHost.test.ts | ||
| getSocketHost.ts | ||
| getSpeed.test.ts | ||
| getSpeed.ts | ||
| getTextDirection.ts | ||
| getTimeStamp.ts | ||
| hasProperty.ts | ||
| index.ts | ||
| isDOMElement.ts | ||
| isDragDropSupported.ts | ||
| isMobileDevice.test.ts | ||
| isMobileDevice.ts | ||
| isNetworkError.test.ts | ||
| isNetworkError.ts | ||
| isObjectURL.test.ts | ||
| isObjectURL.ts | ||
| isPreviewSupported.test.ts | ||
| isPreviewSupported.ts | ||
| isTouchDevice.test.ts | ||
| isTouchDevice.ts | ||
| microtip.scss | ||
| mimeTypes.ts | ||
| NetworkError.ts | ||
| prettyETA.test.ts | ||
| prettyETA.ts | ||
| ProgressTimeout.ts | ||
| RateLimitedQueue.test.ts | ||
| RateLimitedQueue.ts | ||
| remoteFileObjToLocal.ts | ||
| sampleImageDataURI.ts | ||
| secondsToTime.test.ts | ||
| secondsToTime.ts | ||
| TaskQueue.test.ts | ||
| TaskQueue.ts | ||
| toArray.test.ts | ||
| toArray.ts | ||
| Translator.test.ts | ||
| Translator.ts | ||
| truncateString.test.ts | ||
| truncateString.ts | ||
| UppyFile.ts | ||
| UserFacingApiError.ts | ||
| VirtualList.tsx | ||