Commit Graph

100 Commits

Author SHA1 Message Date
rootdarkarchon
d40730bca3 some file server fixes I guess
break, not return

fix queue processing

fix queue processing, again

fix queue processing, the third

do not use async for queue processing

something
2024-08-27 14:22:10 +00:00
Loporrit
d1fcc87f37 Disable priority queue again 2024-08-27 14:21:04 +00:00
rootdarkarchon
e74f511cc0 add alias to jwt, remove caching from auth, remove db usage from files 2024-08-27 14:11:33 +00:00
rootdarkarchon
989046da13 add geoip service for file shard matching
fix bug

more logging

fix logging wtf is going on even

handle lists in config log output

do not set "*" as default continent

do not rely on "*" being present in configuration when picking file shard
2024-08-27 14:11:23 +00:00
rootdarkarchon
7667b74734 bugfix 2024-08-27 13:42:03 +00:00
rootdarkarchon
566634776b clean up downloads on shards 2024-08-27 13:41:08 +00:00
rootdarkarchon
9eec562fdd use maredbcontext from controller 2024-08-27 13:28:18 +00:00
Stanley Dimant
72df676c9d update server to net 8
up conn semaphore

add http logging to files

update prometheus?

downgrade again to net7?

temp downgrade to net7 again?

net8 for static file server attempt #2

loporrit: MareAPI .NET8 update
2024-06-11 07:31:20 +00:00
rootdarkarchon
8121b8c1f6 fix upload getting stuck
fix disposed semaphores
2024-03-14 19:06:58 +00:00
rootdarkarchon
b2e4b99b10 use maredbcontext from controller 2024-03-14 18:39:08 +00:00
Loporrit
3cfe6fbdee Disable high priority queue 2024-03-14 18:37:52 +00:00
rootdarkarchon
701a5763b5 add high priority queue 2024-03-14 18:36:37 +00:00
rootdarkarchon
3b77a179c5 expire requests regardless of queue presence of entries 2024-03-14 18:35:53 +00:00
Loporrit
8cf4f50091 Use streamable compression (needs file cache clear) 2023-12-18 12:51:36 +00:00
Loporrit
676c5316f6 Avoid buffering file download bundles in to memory 2023-08-24 18:31:11 +00:00
Loporrit
09a6dbfca0 Fix launching under systemd 2023-08-24 18:29:44 +00:00
rootdarkarchon
dd74903eff fix handling for finishrequest 2023-08-02 11:48:07 +02:00
rootdarkarchon
ba37a25869 adjust queue processing 2023-08-02 11:37:34 +02:00
rootdarkarchon
255798c0c6 add gauges for queue free/active/inactive 2023-08-02 10:14:27 +02:00
rootdarkarchon
4024754b47 fix counters 2023-08-01 22:15:15 +02:00
rootdarkarchon
32e9cf7795 add request size counters 2023-08-01 22:09:45 +02:00
rootdarkarchon
fd0327b2c4 Single file transfer (#26)
* move to single file transfer for server

* fix cache get

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-08-01 16:48:08 +02:00
rootdarkarchon
3444834fca potentially fix discrepancy between db and uploaded file status 2023-05-11 01:36:36 +02:00
rootdarkarchon
1c0c213c93 update dependencies 2023-05-09 13:04:21 +02:00
rootdarkarchon
abda79a15a potentially fix staticfileserver crashes 2023-04-08 13:59:20 +02:00
rootdarkarchon
89a384005e fix uploading state for forbidden files, add raw upload 2023-04-05 00:24:28 +02:00
rootdarkarchon
51dc445af0 adjust locking for uploadfile 2023-03-29 23:49:00 +02:00
rootdarkarchon
7b0ac34623 add mare profiles 2023-03-19 18:57:55 +01:00
rootdarkarchon
2cfd005fed remove explicit prom aspnetcore 2023-03-15 11:36:22 +01:00
rootdarkarchon
48323d68b0 [Draft] Update 0.8 (#25)
* get rid of file handling through grpc and signalr

* fix upload on controller

* adapt usersetpairpermissions

* send user perms

* server-side fixes

* rework file upload

* adjust log level to debug in docker standalone json

* update dependencies

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-03-14 19:46:59 +01:00
rootdarkarchon
aa03d400d4 - reload configs on change
- remove grpc config service replace with http
- add messaging to channel
2023-02-25 12:20:59 +01:00
rootdarkarchon
6f9bacab5b Messagepack (#24)
* add messagepack to signalr

* add resolvers to messagepack

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-02-10 12:30:03 +01:00
rootdarkarchon
674387a26a updates to dependencies 2023-02-05 12:49:05 +01:00
rootdarkarchon
ca16b08a2f Server rework for API change and paradigm shift (#23)
* start with group permissions implementation

* some minor refactoring

* adjust hub for api changes

* fixes and database migration

* fixes sending online/offline message to clients stuff

* remove admin stuff from server

* fixes get server permissions

* send group pair info to client on joining a group

* send online only on sending connection dto

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-29 15:15:02 +01:00
rootdarkarchon
0c3bb89456 remove time from linq query 2023-01-27 02:53:00 +01:00
rootdarkarchon
6560b1d70d try catch on cleanup task 2023-01-27 02:46:13 +01:00
rootdarkarchon
91b98d060a do not use request semaphore for check queue requests 2023-01-22 00:11:21 +01:00
rootdarkarchon
d7e664477f Merge branch 'main' of https://github.com/Penumbra-Sync/server 2023-01-18 19:46:36 +01:00
rootdarkarchon
fe80faab6b potentially fix stuck uploads 2023-01-18 19:46:03 +01:00
rootdarkarchon
e97f4cb6d6 enqueue user if they somehow lost the queue but got no positive reply from the server 2023-01-18 11:06:30 +01:00
rootdarkarchon
9b4e298b66 refactor server auth on files server, add checking request queue 2023-01-18 10:20:24 +01:00
rootdarkarchon
20d8970a15 return in RemoveFromQueue always when not in queue 2023-01-15 18:32:48 +01:00
rootdarkarchon
4bd71a5889 Download rework (#22)
* rework server to send download ready back via signalr

* adjust queue handling for removal

* adjust api to main

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-15 16:00:38 +01:00
rootdarkarchon
5e0e21ef68 parallel for the queue processing, up request semaphore, remove queue position (unused), bump api version 2023-01-15 01:44:10 +01:00
rootdarkarchon
e968adb7be actually start the queue processing timer 2023-01-15 01:12:46 +01:00
rootdarkarchon
60f6bb5829 ignore queue semaphore when processing queue 2023-01-15 01:10:35 +01:00
rootdarkarchon
b230f12508 decrease parallel request handling 2023-01-15 01:08:44 +01:00
rootdarkarchon
cf6ad890cd try processing queue with timer instead of task 2023-01-15 01:07:45 +01:00
rootdarkarchon
3fc6b01df9 adjust try/catch/finally for semaphore release 2023-01-15 00:52:21 +01:00
rootdarkarchon
b806ef8b7b temporary test limiting parallel requests to 500 2023-01-15 00:48:32 +01:00