64 Commits
Author SHA1 Message Date
Stanley Dimant 73fc5bea2c fix build 2025-06-28 14:37:25 +00:00
Charlotte f38b85ce39 fix static file server statistics resetting (#33)
Currently, the static file server will try to reset the statistics about
files served rapidly starting from midnight for about a second.

This removes log spam and a load spike at midnight.
2025-06-28 14:37:25 +00:00
Stanley Dimant 7639066249 Split AuthService/Server
some refactoring
fix some stuff
add http context accessor
configure metrics as well
commit 713d054ccb965f7adb8eafa6e3fb52853a1e6dd2 (partial, Docker only)
2024-10-08 08:59:50 +00:00
Loporrit c400d9746f Pre-fetch cache files upon pre-request 2024-09-29 14:13:59 +00:00
Loporrit 21c615cdb7 Optimize dist file get, add nginx x-accel support 2024-09-13 15:16:00 +00:00
Loporrit 1f57510bb7 oops, touch requests are concurrent... 2024-09-09 07:03:08 +00:00
Loporrit b4ac5f6917 Remote touch service for fileserver shards 2024-09-08 11:22:38 +00:00
Loporrit 16f8f23545 silence, client ready 2024-09-08 11:03:05 +00:00
Loporrit 0b6af10a44 Prioritize larger files during size cleanup 2024-09-08 11:03:05 +00:00
Loporrit 1782a16ea4 Avoid race conditon between uploads and cleanup 2024-09-06 08:54:48 +00:00
Loporrit 2090c65bf1 Allow file shards to signal main server directly 2024-09-06 08:54:45 +00:00
Loporrit 524e412c28 Add DistributionFileServerForceHTTP2 2024-09-06 08:54:45 +00:00
Loporrit 584f5356d7 Allow shards to use cold storage, revise cleanup service 2024-09-06 08:54:38 +00:00
Loporrit 649f3018b1 Rename MainFileCleanupService.cs for better git tracking in the next commit 2024-09-01 15:49:59 +00:00
Loporrit fb0905ef84 check cold storage outside of download task instead 2024-08-30 08:32:55 +00:00
Stanley Dimant 56a257261b allow more time for download tasks in cachedfileprovider 2024-08-27 15:07:19 +00:00
Stanley Dimant aa78432db3 more queue fixes 2024-08-27 15:07:19 +00:00
Stanley Dimant a116545c9e requeue requests where files are still downloading 2024-08-27 15:07:19 +00:00
Stanley Dimant 9269a403b5 refactor cleanup stuff 2024-08-27 15:07:19 +00:00
Stanley Dimant f97aa46f74 cold storage retention should be days
limit is double though jksdfjklsdfkl
2024-08-27 15:07:19 +00:00
Stanley Dimant 09662b477e clean up some code and optinmize cleanup
speed up cleanup service

fixes for fixes
2024-08-27 15:07:19 +00:00
Stanley Dimant fb22a267ac add central cold storage options for file servers
add access times I guess

access, not write

overwrite times after copying
2024-08-27 15:07:19 +00:00
Stanley Dimant 1e353229ac some fixes maybe
kms
2024-08-27 15:07:18 +00:00
Stanley Dimant 128a5a0aa2 fix send ready message service probably 2024-08-27 15:07:18 +00:00
rootdarkarchon c06edeebdd fix AnyFilesDownloading 2024-08-27 15:07:18 +00:00
rootdarkarchon 012ae04dce add some more metrics for files downloading from caches 2024-08-27 15:07:18 +00:00
rootdarkarchon 9b9f6cd2f9 some fixes maybe 2024-08-27 15:07:18 +00:00
rootdarkarchon a42f553648 make cleanup check time configurable, add distribution file server address
handle download errors on shards better

flush filestream

oml
2024-08-27 14:46:36 +00:00
rootdarkarchon 7c6dbafce9 set user agent correctly
add statistics

fix bug
2024-08-27 14:46:34 +00:00
rootdarkarchon d54d793575 refactor file server 2024-08-27 14:31:41 +00:00
rootdarkarchon d40730bca3 some file server fixes I guess
break, not return

fix queue processing

fix queue processing, again

fix queue processing, the third

do not use async for queue processing

something
2024-08-27 14:22:10 +00:00
rootdarkarchon e74f511cc0 add alias to jwt, remove caching from auth, remove db usage from files 2024-08-27 14:11:33 +00:00
rootdarkarchon 566634776b clean up downloads on shards 2024-08-27 13:41:08 +00:00
rootdarkarchon 9eec562fdd use maredbcontext from controller 2024-08-27 13:28:18 +00:00
rootdarkarchon b2e4b99b10 use maredbcontext from controller 2024-03-14 18:39:08 +00:00
Loporrit 3cfe6fbdee Disable high priority queue 2024-03-14 18:37:52 +00:00
rootdarkarchon 701a5763b5 add high priority queue 2024-03-14 18:36:37 +00:00
rootdarkarchon 3b77a179c5 expire requests regardless of queue presence of entries 2024-03-14 18:35:53 +00:00
rootdarkarchon dd74903eff fix handling for finishrequest 2023-08-02 11:48:07 +02:00
rootdarkarchon ba37a25869 adjust queue processing 2023-08-02 11:37:34 +02:00
rootdarkarchon 255798c0c6 add gauges for queue free/active/inactive 2023-08-02 10:14:27 +02:00
rootdarkarchon 4024754b47 fix counters 2023-08-01 22:15:15 +02:00
rootdarkarchon 32e9cf7795 add request size counters 2023-08-01 22:09:45 +02:00
rootdarkarchonandrootdarkarchon fd0327b2c4 Single file transfer (#26)
* move to single file transfer for server

* fix cache get

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-08-01 16:48:08 +02:00
rootdarkarchon 3444834fca potentially fix discrepancy between db and uploaded file status 2023-05-11 01:36:36 +02:00
rootdarkarchon abda79a15a potentially fix staticfileserver crashes 2023-04-08 13:59:20 +02:00
rootdarkarchonandrootdarkarchon 48323d68b0 [Draft] Update 0.8 (#25)
* get rid of file handling through grpc and signalr

* fix upload on controller

* adapt usersetpairpermissions

* send user perms

* server-side fixes

* rework file upload

* adjust log level to debug in docker standalone json

* update dependencies

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-03-14 19:46:59 +01:00
rootdarkarchon aa03d400d4 - reload configs on change
- remove grpc config service replace with http
- add messaging to channel
2023-02-25 12:20:59 +01:00
rootdarkarchonandrootdarkarchon ca16b08a2f Server rework for API change and paradigm shift (#23)
* start with group permissions implementation

* some minor refactoring

* adjust hub for api changes

* fixes and database migration

* fixes sending online/offline message to clients stuff

* remove admin stuff from server

* fixes get server permissions

* send group pair info to client on joining a group

* send online only on sending connection dto

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-29 15:15:02 +01:00
rootdarkarchon 0c3bb89456 remove time from linq query 2023-01-27 02:53:00 +01:00