Commit Graph
502 Commits
Author SHA1 Message Date
Loporrit 983be6ff3d Update MareAPI 2025-02-12 11:33:47 +00:00
Loporrit 6ade388b89 Basic group chat impl 2024-11-25 02:50:57 +00:00
Loporrit dfa32b46de Don't publish appsettings.json in AuthService 2024-10-08 09:00:40 +00:00
Stanley Dimant 7639066249 Split AuthService/Server
some refactoring
fix some stuff
add http context accessor
configure metrics as well
commit 713d054ccb965f7adb8eafa6e3fb52853a1e6dd2 (partial, Docker only)
2024-10-08 08:59:50 +00:00
Loporrit c400d9746f Pre-fetch cache files upon pre-request 2024-09-29 14:13:59 +00:00
Loporrit 61821c0775 Add nginx ssi support for client file transfers as well why not 2024-09-13 16:59:38 +00:00
Loporrit 49695b4403 Use sendfile for client file get as well 2024-09-13 16:17:13 +00:00
Loporrit 21c615cdb7 Optimize dist file get, add nginx x-accel support 2024-09-13 15:16:00 +00:00
Loporrit fa6be0231f Actually enable sendReady on main server 2024-09-11 11:35:41 +00:00
Loporrit b51cd61e4b Propagate touch requests via intermediate servers 2024-09-11 06:47:41 +00:00
Loporrit 1f57510bb7 oops, touch requests are concurrent... 2024-09-09 07:03:08 +00:00
Loporrit 908c34f57b Merge branch 'cold-and-shards' 2024-09-08 12:36:18 +00:00
Loporrit b4ac5f6917 Remote touch service for fileserver shards 2024-09-08 11:22:38 +00:00
Loporrit 16f8f23545 silence, client ready 2024-09-08 11:03:05 +00:00
Loporrit 0b6af10a44 Prioritize larger files during size cleanup 2024-09-08 11:03:05 +00:00
Loporrit 1782a16ea4 Avoid race conditon between uploads and cleanup 2024-09-06 08:54:48 +00:00
Loporrit 2090c65bf1 Allow file shards to signal main server directly 2024-09-06 08:54:45 +00:00
Loporrit 524e412c28 Add DistributionFileServerForceHTTP2 2024-09-06 08:54:45 +00:00
Loporrit c42d0b38cf Keep main server out of file business, and disable user file deletion 2024-09-06 08:54:45 +00:00
Loporrit 584f5356d7 Allow shards to use cold storage, revise cleanup service 2024-09-06 08:54:38 +00:00
Loporrit 649f3018b1 Rename MainFileCleanupService.cs for better git tracking in the next commit 2024-09-01 15:49:59 +00:00
Loporrit fb0905ef84 check cold storage outside of download task instead 2024-08-30 08:32:55 +00:00
Loporrit 05c880d4e8 no IDbContextFactory 2024-08-30 08:24:49 +00:00
Stanley Dimant b7e12f3e42 handle unknown continent 2024-08-27 15:07:19 +00:00
Stanley Dimant 56a257261b allow more time for download tasks in cachedfileprovider 2024-08-27 15:07:19 +00:00
Stanley Dimant aa78432db3 more queue fixes 2024-08-27 15:07:19 +00:00
Stanley Dimant a116545c9e requeue requests where files are still downloading 2024-08-27 15:07:19 +00:00
Stanley Dimant 9269a403b5 refactor cleanup stuff 2024-08-27 15:07:19 +00:00
Stanley Dimant f97aa46f74 cold storage retention should be days
limit is double though jksdfjklsdfkl
2024-08-27 15:07:19 +00:00
Stanley Dimant 09662b477e clean up some code and optinmize cleanup
speed up cleanup service

fixes for fixes
2024-08-27 15:07:19 +00:00
Stanley Dimant fb22a267ac add central cold storage options for file servers
add access times I guess

access, not write

overwrite times after copying
2024-08-27 15:07:19 +00:00
Stanley Dimant 180d7d504d add special handling for NA-W/NA-E
remove unused usings
2024-08-27 15:07:19 +00:00
Stanley Dimant b189812dc0 help? 2024-08-27 15:07:19 +00:00
Stanley Dimant 1e353229ac some fixes maybe
kms
2024-08-27 15:07:18 +00:00
Stanley Dimant 128a5a0aa2 fix send ready message service probably 2024-08-27 15:07:18 +00:00
rootdarkarchon c06edeebdd fix AnyFilesDownloading 2024-08-27 15:07:18 +00:00
rootdarkarchon 012ae04dce add some more metrics for files downloading from caches 2024-08-27 15:07:18 +00:00
rootdarkarchon 9b9f6cd2f9 some fixes maybe 2024-08-27 15:07:18 +00:00
rootdarkarchon 9d9573a510 try locking metrics 2024-08-27 15:07:18 +00:00
rootdarkarchon a42f553648 make cleanup check time configurable, add distribution file server address
handle download errors on shards better

flush filestream

oml
2024-08-27 14:46:36 +00:00
rootdarkarchon 7c6dbafce9 set user agent correctly
add statistics

fix bug
2024-08-27 14:46:34 +00:00
rootdarkarchon d54d793575 refactor file server 2024-08-27 14:31:41 +00:00
rootdarkarchon d40730bca3 some file server fixes I guess
break, not return

fix queue processing

fix queue processing, again

fix queue processing, the third

do not use async for queue processing

something
2024-08-27 14:22:10 +00:00
Loporrit d1fcc87f37 Disable priority queue again 2024-08-27 14:21:04 +00:00
rootdarkarchon e74f511cc0 add alias to jwt, remove caching from auth, remove db usage from files 2024-08-27 14:11:33 +00:00
rootdarkarchon 989046da13 add geoip service for file shard matching
fix bug

more logging

fix logging wtf is going on even

handle lists in config log output

do not set "*" as default continent

do not rely on "*" being present in configuration when picking file shard
2024-08-27 14:11:23 +00:00
rootdarkarchon 7667b74734 bugfix 2024-08-27 13:42:03 +00:00
rootdarkarchon 566634776b clean up downloads on shards 2024-08-27 13:41:08 +00:00
rootdarkarchon 9eec562fdd use maredbcontext from controller 2024-08-27 13:28:18 +00:00
Loporrit 7c95497e33 Add .pbd 2024-08-24 05:47:45 +00:00