Commit Graph

327 Commits

Author SHA1 Message Date
rootdarkarchon
8c39f9ce81 fix null in AuthorizeAsync 2023-01-11 23:05:00 +01:00
rootdarkarchon
a0cea2432f fixes for activate/finishrequest 2023-01-11 17:22:04 +01:00
rootdarkarchon
c1f329c233 fixes for server auth 2023-01-11 14:31:33 +01:00
rootdarkarchon
617bc6afc8 fix token generation 2023-01-11 13:29:49 +01:00
rootdarkarchon
42b15cb6b7 Add Server-Side Download Queue (#21)
* test add queueing to file service

* further adjustments to download queueing

* add check for whether the request is still in the queue to CheckQueue

* forcefully release slot if download didn't finish in 15s

* actually cancel the delay task

* add metrics and refactor some of the request queue service

* refactor pathing

* reuse httpclient

* add queue request dto to requestfile, enqueue users immediately if a slot is available

* change startup to include all controllers

* update server pathing

* update pathing, again

* several adjustments to auth, banning, jwt server tokens, renaming, authorization

* update api I guess

* adjust automated banning of charaident and reg

* generate jwt on servers for internal authentication

* remove mvcextensions

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-11 12:22:22 +01:00
rootdarkarchon
db2d0451ca adjust grabbing all keys from redis on the shards 2023-01-08 21:04:11 +01:00
rootdarkarchon
f37fee3235 attempt redis connection pooling 2023-01-08 19:27:39 +01:00
rootdarkarchon
8c41f41597 add gauge for authorized connections 2023-01-08 15:04:20 +01:00
rootdarkarchon
a182f36485 attempt to switch ident service to redis 2023-01-08 14:51:56 +01:00
rootdarkarchon
61111d387a get kestrel server options from config 2023-01-07 23:44:35 +01:00
rootdarkarchon
d7eee2af8f remove configurekestrel 2023-01-07 23:37:32 +01:00
rootdarkarchon
dfdc620816 change log level to debug 2023-01-07 17:54:12 +01:00
rootdarkarchon
f760f8ad65 Revert "add FileDbService to handle file requests"
This reverts commit f6af114d44.
2023-01-07 17:53:20 +01:00
rootdarkarchon
f6af114d44 add FileDbService to handle file requests 2023-01-07 11:36:20 +01:00
rootdarkarchon
2943e0964e limit connections to 1000 2023-01-07 02:11:14 +01:00
rootdarkarchon
d328056b9b fix claims and logging in files controller 2023-01-07 01:57:16 +01:00
rootdarkarchon
74b7fcdf89 Refactoring using Claims more, add Server Side Messaging (#20)
* add some refactoring based on claims, handle chara ident inside claim, fix discord userid in log

* improve authentication responses, add server side messaging

* update server to mainline api

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-04 15:49:18 +01:00
rootdarkarchon
5f0c12ecfa Switch to JWT authentication (#19)
* switch to jwt authentication

* fix delete files

* adjust saving of deletion of all files

* update api to main/jwt

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-02 17:07:34 +01:00
rootdarkarchon
bdd8830c8e add healthchecks to docker 2023-01-02 02:50:33 +01:00
rootdarkarchon
7f49ca8627 increase timer again 2023-01-02 01:38:53 +01:00
rootdarkarchon
738c913be9 move some stuff around, pray 2023-01-01 23:36:34 +01:00
rootdarkarchon
8878295f93 adjust random order of files 2023-01-01 20:12:57 +01:00
rootdarkarchon
f8c9d1e64f shuffle cdn shard configs to allow for multiple file shards to handle one file, randomly distributing 2023-01-01 17:32:22 +01:00
rootdarkarchon
9a9beb9a65 fix error message on user push data 2022-12-31 18:15:32 +01:00
rootdarkarchon
b6404a9c1d add horizontal file sharding based on filename matches 2022-12-31 14:28:24 +01:00
rootdarkarchon
2a5e505130 readd auth header 2022-12-31 12:56:18 +01:00
rootdarkarchon
cf082496e9 actually save file with commit 2022-12-30 22:39:36 +01:00
rootdarkarchon
da738bafd9 replace non-digits and letters from string for FilesSend 2022-12-30 22:39:15 +01:00
rootdarkarchon
cbe361208c some changes to auth 2022-12-29 20:14:47 +01:00
rootdarkarchon
3634cccd1e remove check for file existence because of download task might still be around 2022-12-29 14:14:02 +01:00
rootdarkarchon
6a34f88a24 optimize for readability 2022-12-29 14:10:02 +01:00
rootdarkarchon
a9337eda11 wait for all incoming calls in CachedFileProvider 2022-12-29 13:24:49 +01:00
rootdarkarchon
4196ab4062 bump shared to 7.0 2022-12-28 14:41:11 +01:00
rootdarkarchon
8cd9c20385 add asnotracking 2022-12-28 14:35:29 +01:00
rootdarkarchon
4af69c2a27 add some logging 2022-12-28 04:54:36 +01:00
rootdarkarchon
31550b0aeb move GetFileSize to database 2022-12-28 04:50:37 +01:00
rootdarkarchon
de2defe692 rework MareConfigurationServiceClient 2022-12-28 04:24:53 +01:00
rootdarkarchon
18a9a76dcd remove semaphore 2022-12-27 23:51:41 +01:00
rootdarkarchon
097d7d16e9 remove grpc from common calls to reduce locking 2022-12-27 23:49:25 +01:00
rootdarkarchon
761f208828 make semaphore readonly 2022-12-27 21:59:59 +01:00
rootdarkarchon
3ba37515ab some fixes for server, perhaps 2022-12-27 21:59:41 +01:00
rootdarkarchon
b8c10c4298 adjustments for grpc service client 2022-12-27 20:08:18 +01:00
rootdarkarchon
4d1ef1f871 something something metrics 2022-12-27 15:43:58 +01:00
rootdarkarchon
d83e4e060f fix default metrics port for server 2022-12-27 14:02:49 +01:00
rootdarkarchon
9eb5967935 rework server responsibilities (#18)
* rework server responsibilities
add remote configuration

* start metrics only when compiled as not debug

* add some more logging to discord bot

* fixes of some casts

* make metrics port configurable, minor fixes

* add docker bullshit

* md formatting

* adjustments to docker stuff

* fix docker json files, fix some stuff in discord bot, add /useradd for Discord bot

* adjust docker configs and fix sharded.bat

* fixes for logs, cache file provider repeat trying to open filestream

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2022-12-27 13:48:05 +01:00
rootdarkarchon
7ee7fdaf48 switch around all iconfiguration usage to ioptions 2022-12-23 01:53:21 +01:00
rootdarkarchon
b8d61b38bd more fixes 2022-12-22 23:48:04 +01:00
rootdarkarchon
8f35a55bd8 limit parallel uploads to 20 per server 2022-12-22 23:19:46 +01:00
rootdarkarchon
3756fef498 fix _isMainServer verification 2022-12-22 22:28:03 +01:00
rootdarkarchon
02353d5ebe add forceful deletion of files 2022-12-20 19:29:25 +01:00