Commit Graph

97 Commits

Author SHA1 Message Date
rootdarkarchon
989046da13 add geoip service for file shard matching
fix bug

more logging

fix logging wtf is going on even

handle lists in config log output

do not set "*" as default continent

do not rely on "*" being present in configuration when picking file shard
2024-08-27 14:11:23 +00:00
rootdarkarchon
7667b74734 bugfix 2024-08-27 13:42:03 +00:00
rootdarkarchon
566634776b clean up downloads on shards 2024-08-27 13:41:08 +00:00
rootdarkarchon
9eec562fdd use maredbcontext from controller 2024-08-27 13:28:18 +00:00
Stanley Dimant
72df676c9d update server to net 8
up conn semaphore

add http logging to files

update prometheus?

downgrade again to net7?

temp downgrade to net7 again?

net8 for static file server attempt #2

loporrit: MareAPI .NET8 update
2024-06-11 07:31:20 +00:00
rootdarkarchon
8121b8c1f6 fix upload getting stuck
fix disposed semaphores
2024-03-14 19:06:58 +00:00
rootdarkarchon
b2e4b99b10 use maredbcontext from controller 2024-03-14 18:39:08 +00:00
Loporrit
3cfe6fbdee Disable high priority queue 2024-03-14 18:37:52 +00:00
rootdarkarchon
701a5763b5 add high priority queue 2024-03-14 18:36:37 +00:00
rootdarkarchon
3b77a179c5 expire requests regardless of queue presence of entries 2024-03-14 18:35:53 +00:00
Loporrit
8cf4f50091 Use streamable compression (needs file cache clear) 2023-12-18 12:51:36 +00:00
Loporrit
676c5316f6 Avoid buffering file download bundles in to memory 2023-08-24 18:31:11 +00:00
Loporrit
09a6dbfca0 Fix launching under systemd 2023-08-24 18:29:44 +00:00
rootdarkarchon
dd74903eff fix handling for finishrequest 2023-08-02 11:48:07 +02:00
rootdarkarchon
ba37a25869 adjust queue processing 2023-08-02 11:37:34 +02:00
rootdarkarchon
255798c0c6 add gauges for queue free/active/inactive 2023-08-02 10:14:27 +02:00
rootdarkarchon
4024754b47 fix counters 2023-08-01 22:15:15 +02:00
rootdarkarchon
32e9cf7795 add request size counters 2023-08-01 22:09:45 +02:00
rootdarkarchon
fd0327b2c4 Single file transfer (#26)
* move to single file transfer for server

* fix cache get

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-08-01 16:48:08 +02:00
rootdarkarchon
3444834fca potentially fix discrepancy between db and uploaded file status 2023-05-11 01:36:36 +02:00
rootdarkarchon
1c0c213c93 update dependencies 2023-05-09 13:04:21 +02:00
rootdarkarchon
abda79a15a potentially fix staticfileserver crashes 2023-04-08 13:59:20 +02:00
rootdarkarchon
89a384005e fix uploading state for forbidden files, add raw upload 2023-04-05 00:24:28 +02:00
rootdarkarchon
51dc445af0 adjust locking for uploadfile 2023-03-29 23:49:00 +02:00
rootdarkarchon
7b0ac34623 add mare profiles 2023-03-19 18:57:55 +01:00
rootdarkarchon
2cfd005fed remove explicit prom aspnetcore 2023-03-15 11:36:22 +01:00
rootdarkarchon
48323d68b0 [Draft] Update 0.8 (#25)
* get rid of file handling through grpc and signalr

* fix upload on controller

* adapt usersetpairpermissions

* send user perms

* server-side fixes

* rework file upload

* adjust log level to debug in docker standalone json

* update dependencies

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-03-14 19:46:59 +01:00
rootdarkarchon
aa03d400d4 - reload configs on change
- remove grpc config service replace with http
- add messaging to channel
2023-02-25 12:20:59 +01:00
rootdarkarchon
6f9bacab5b Messagepack (#24)
* add messagepack to signalr

* add resolvers to messagepack

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-02-10 12:30:03 +01:00
rootdarkarchon
674387a26a updates to dependencies 2023-02-05 12:49:05 +01:00
rootdarkarchon
ca16b08a2f Server rework for API change and paradigm shift (#23)
* start with group permissions implementation

* some minor refactoring

* adjust hub for api changes

* fixes and database migration

* fixes sending online/offline message to clients stuff

* remove admin stuff from server

* fixes get server permissions

* send group pair info to client on joining a group

* send online only on sending connection dto

---------

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-29 15:15:02 +01:00
rootdarkarchon
0c3bb89456 remove time from linq query 2023-01-27 02:53:00 +01:00
rootdarkarchon
6560b1d70d try catch on cleanup task 2023-01-27 02:46:13 +01:00
rootdarkarchon
91b98d060a do not use request semaphore for check queue requests 2023-01-22 00:11:21 +01:00
rootdarkarchon
d7e664477f Merge branch 'main' of https://github.com/Penumbra-Sync/server 2023-01-18 19:46:36 +01:00
rootdarkarchon
fe80faab6b potentially fix stuck uploads 2023-01-18 19:46:03 +01:00
rootdarkarchon
e97f4cb6d6 enqueue user if they somehow lost the queue but got no positive reply from the server 2023-01-18 11:06:30 +01:00
rootdarkarchon
9b4e298b66 refactor server auth on files server, add checking request queue 2023-01-18 10:20:24 +01:00
rootdarkarchon
20d8970a15 return in RemoveFromQueue always when not in queue 2023-01-15 18:32:48 +01:00
rootdarkarchon
4bd71a5889 Download rework (#22)
* rework server to send download ready back via signalr

* adjust queue handling for removal

* adjust api to main

Co-authored-by: rootdarkarchon <root.darkarchon@outlook.com>
2023-01-15 16:00:38 +01:00
rootdarkarchon
5e0e21ef68 parallel for the queue processing, up request semaphore, remove queue position (unused), bump api version 2023-01-15 01:44:10 +01:00
rootdarkarchon
e968adb7be actually start the queue processing timer 2023-01-15 01:12:46 +01:00
rootdarkarchon
60f6bb5829 ignore queue semaphore when processing queue 2023-01-15 01:10:35 +01:00
rootdarkarchon
b230f12508 decrease parallel request handling 2023-01-15 01:08:44 +01:00
rootdarkarchon
cf6ad890cd try processing queue with timer instead of task 2023-01-15 01:07:45 +01:00
rootdarkarchon
3fc6b01df9 adjust try/catch/finally for semaphore release 2023-01-15 00:52:21 +01:00
rootdarkarchon
b806ef8b7b temporary test limiting parallel requests to 500 2023-01-15 00:48:32 +01:00
rootdarkarchon
aa177583e0 sanitize queue processing 2023-01-14 12:57:34 +01:00
rootdarkarchon
9605be8d4a minor stylefixes 2023-01-14 12:54:11 +01:00
rootdarkarchon
a0cea2432f fixes for activate/finishrequest 2023-01-11 17:22:04 +01:00