Loporrit
1782a16ea4
Avoid race conditon between uploads and cleanup
2024-09-06 08:54:48 +00:00
Loporrit
2090c65bf1
Allow file shards to signal main server directly
2024-09-06 08:54:45 +00:00
Loporrit
524e412c28
Add DistributionFileServerForceHTTP2
2024-09-06 08:54:45 +00:00
Loporrit
584f5356d7
Allow shards to use cold storage, revise cleanup service
2024-09-06 08:54:38 +00:00
Loporrit
649f3018b1
Rename MainFileCleanupService.cs for better git tracking in the next commit
2024-09-01 15:49:59 +00:00
Loporrit
fb0905ef84
check cold storage outside of download task instead
2024-08-30 08:32:55 +00:00
Stanley Dimant
56a257261b
allow more time for download tasks in cachedfileprovider
2024-08-27 15:07:19 +00:00
Stanley Dimant
aa78432db3
more queue fixes
2024-08-27 15:07:19 +00:00
Stanley Dimant
a116545c9e
requeue requests where files are still downloading
2024-08-27 15:07:19 +00:00
Stanley Dimant
9269a403b5
refactor cleanup stuff
2024-08-27 15:07:19 +00:00
Stanley Dimant
f97aa46f74
cold storage retention should be days
...
limit is double though jksdfjklsdfkl
2024-08-27 15:07:19 +00:00
Stanley Dimant
09662b477e
clean up some code and optinmize cleanup
...
speed up cleanup service
fixes for fixes
2024-08-27 15:07:19 +00:00
Stanley Dimant
fb22a267ac
add central cold storage options for file servers
...
add access times I guess
access, not write
overwrite times after copying
2024-08-27 15:07:19 +00:00
Stanley Dimant
1e353229ac
some fixes maybe
...
kms
2024-08-27 15:07:18 +00:00
Stanley Dimant
128a5a0aa2
fix send ready message service probably
2024-08-27 15:07:18 +00:00
rootdarkarchon
c06edeebdd
fix AnyFilesDownloading
2024-08-27 15:07:18 +00:00
rootdarkarchon
012ae04dce
add some more metrics for files downloading from caches
2024-08-27 15:07:18 +00:00
rootdarkarchon
9b9f6cd2f9
some fixes maybe
2024-08-27 15:07:18 +00:00
rootdarkarchon
a42f553648
make cleanup check time configurable, add distribution file server address
...
handle download errors on shards better
flush filestream
oml
2024-08-27 14:46:36 +00:00
rootdarkarchon
7c6dbafce9
set user agent correctly
...
add statistics
fix bug
2024-08-27 14:46:34 +00:00
rootdarkarchon
d54d793575
refactor file server
2024-08-27 14:31:41 +00:00
rootdarkarchon
d40730bca3
some file server fixes I guess
...
break, not return
fix queue processing
fix queue processing, again
fix queue processing, the third
do not use async for queue processing
something
2024-08-27 14:22:10 +00:00
rootdarkarchon
e74f511cc0
add alias to jwt, remove caching from auth, remove db usage from files
2024-08-27 14:11:33 +00:00
rootdarkarchon
566634776b
clean up downloads on shards
2024-08-27 13:41:08 +00:00
rootdarkarchon
9eec562fdd
use maredbcontext from controller
2024-08-27 13:28:18 +00:00
rootdarkarchon
b2e4b99b10
use maredbcontext from controller
2024-03-14 18:39:08 +00:00
Loporrit
3cfe6fbdee
Disable high priority queue
2024-03-14 18:37:52 +00:00
rootdarkarchon
701a5763b5
add high priority queue
2024-03-14 18:36:37 +00:00
rootdarkarchon
3b77a179c5
expire requests regardless of queue presence of entries
2024-03-14 18:35:53 +00:00
rootdarkarchon
dd74903eff
fix handling for finishrequest
2023-08-02 11:48:07 +02:00
rootdarkarchon
ba37a25869
adjust queue processing
2023-08-02 11:37:34 +02:00
rootdarkarchon
255798c0c6
add gauges for queue free/active/inactive
2023-08-02 10:14:27 +02:00
rootdarkarchon
4024754b47
fix counters
2023-08-01 22:15:15 +02:00
rootdarkarchon
32e9cf7795
add request size counters
2023-08-01 22:09:45 +02:00
rootdarkarchon and rootdarkarchon
fd0327b2c4
Single file transfer ( #26 )
...
* move to single file transfer for server
* fix cache get
---------
Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com >
2023-08-01 16:48:08 +02:00
rootdarkarchon
3444834fca
potentially fix discrepancy between db and uploaded file status
2023-05-11 01:36:36 +02:00
rootdarkarchon
abda79a15a
potentially fix staticfileserver crashes
2023-04-08 13:59:20 +02:00
rootdarkarchon and rootdarkarchon
48323d68b0
[Draft] Update 0.8 ( #25 )
...
* get rid of file handling through grpc and signalr
* fix upload on controller
* adapt usersetpairpermissions
* send user perms
* server-side fixes
* rework file upload
* adjust log level to debug in docker standalone json
* update dependencies
---------
Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com >
2023-03-14 19:46:59 +01:00
rootdarkarchon
aa03d400d4
- reload configs on change
...
- remove grpc config service replace with http
- add messaging to channel
2023-02-25 12:20:59 +01:00
rootdarkarchon and rootdarkarchon
ca16b08a2f
Server rework for API change and paradigm shift ( #23 )
...
* start with group permissions implementation
* some minor refactoring
* adjust hub for api changes
* fixes and database migration
* fixes sending online/offline message to clients stuff
* remove admin stuff from server
* fixes get server permissions
* send group pair info to client on joining a group
* send online only on sending connection dto
---------
Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com >
2023-01-29 15:15:02 +01:00
rootdarkarchon
0c3bb89456
remove time from linq query
2023-01-27 02:53:00 +01:00
rootdarkarchon
6560b1d70d
try catch on cleanup task
2023-01-27 02:46:13 +01:00
rootdarkarchon
d7e664477f
Merge branch 'main' of https://github.com/Penumbra-Sync/server
2023-01-18 19:46:36 +01:00
rootdarkarchon
fe80faab6b
potentially fix stuck uploads
2023-01-18 19:46:03 +01:00
rootdarkarchon
9b4e298b66
refactor server auth on files server, add checking request queue
2023-01-18 10:20:24 +01:00
rootdarkarchon
20d8970a15
return in RemoveFromQueue always when not in queue
2023-01-15 18:32:48 +01:00
rootdarkarchon and rootdarkarchon
4bd71a5889
Download rework ( #22 )
...
* rework server to send download ready back via signalr
* adjust queue handling for removal
* adjust api to main
Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com >
2023-01-15 16:00:38 +01:00
rootdarkarchon
5e0e21ef68
parallel for the queue processing, up request semaphore, remove queue position (unused), bump api version
2023-01-15 01:44:10 +01:00
rootdarkarchon
e968adb7be
actually start the queue processing timer
2023-01-15 01:12:46 +01:00
rootdarkarchon
60f6bb5829
ignore queue semaphore when processing queue
2023-01-15 01:10:35 +01:00
Loporrit