server migration on 20.04.2021: TODO-list

server migration on 20.04.2021: TODO-list

For the discussion of infrastructure improvements and changes.

Moderator: Moderators

Post Reply
abma
Spring Developer
Posts: 3754
Joined: 01 Jun 2009, 00:08

server migration on 20.04.2021: TODO-list

Post by abma »

all data is migrated, dns is changed and some services are running. we didn't copy the whole server 1:1 as migrations are always a good time to cleanup stuff and refactor it. this is more work but will make future maintenance much easier and maybe fixes some issues.

some services have to be reconfigured / reenabled. this thread is to report issues because of the migration / the todo list:

- some matrix services (discord, etc?!)
- spring buildbot
- springlobby buildbot
- crontab for rapid
- matrix service
- mumble
- spambot registration doesn't work
- replays.springrts.com (dns entry still invalid)
- certbot
- rapid download service
- login to replays.springrts.com
- matrix appservice (bridge uberserver <-> matrix
- logs.springrts.com
User avatar
Beherith
Moderator
Posts: 5076
Joined: 26 Oct 2007, 16:21

Re: server migration on 20.04.2021: TODO-list

Post by Beherith »

Rapid seems to fail with:

Same error happens if I try a new, empty filesystem-writepath.

Code: Select all

/usr/local/bin/pr-downloader --filesystem-writepath /home/user/spads/var/spring/data --download-game byar:test
pr-downloader 0.7-546-ge171ed5
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:188:setWritePath():Using filesystem-writepath: /home/user/spads/var/spring/data
[Info] /home/user/spads/pr-downloader/src/pr-downloader.cpp:173:DownloadSetConfig():Free disk space: 4123027 MB
[Info] /home/user/spads/pr-downloader/src/Downloader/CurlWrapper.cpp:60:DumpVersion():libcurl 7.58.0 OpenSSL/1.1.1

[Info] /home/user/spads/pr-downloader/src/Downloader/Rapid/RapidDownloader.cpp:192:ParseFD():Found 50 repos in /home/user/spads/var/spring/data/rapid/repos.springrts.com/repos.gz


[Info] /home/user/spads/pr-downloader/src/Downloader/Rapid/RapidDownloader.cpp:192:ParseFD():Found 50 repos in /home/user/spads/var/spring/data/rapid/repos.springrts.com/repos.gz

[Info] /home/user/spads/pr-downloader/src/Downloader/Rapid/RapidDownloader.cpp:68:download_name():[Download] Beyond All Reason test-16081-05f07a4
[Info] /home/user/spads/pr-downloader/src/Downloader/Rapid/Sdp.cpp:324:downloadStream():Using rapid
[Info] /home/user/spads/pr-downloader/src/Downloader/Rapid/Sdp.cpp:325:downloadStream():http://repos.springrts.com/byar/streamer.cgi?387141e832afa99238918d86e9e5b8e2
[Info] /home/user/spads/pr-downloader/src/FileSystem/IHash.cpp:31:compare():compare failed(): b28e1515e955af31d7d4218d0cd6d83e 5548f74674358409d221f80c95d6193b
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:543:validateSDP():Removing invalid file: /home/user/spads/var/spring/data/pool/55/48f74674358409d221f80c95d6193b.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/16/890f76d49d577301b26864c93a5215.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/0e/9a85004f7906865bec5cab463b47d2.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/2b/c6bf66301f640ea53021dfc6a3a8c0.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/22/6119c2ff72479d2041005fe748487b.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/2a/44992f336ca256c485f4cd6546b187.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/77/bce8d98c698b9cc2e357946dd58eb3.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/71/ff4c2a41b2176d4a76c7acc9f3840d.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/fb/255464680247519df97dd310939c76.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/0b/2781fa9d883a13bc3c649383f1318c.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/b6/ec110be3ad26423e0e9d73801123e9.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/a6/ebb43bf84f9730a76052c97ed648f4.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/38/93ea081dddc1dac16c026914163aad.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/b3/d9aadcb9303ba610db6c1b25ed9724.gz
[Info] /home/user/spads/pr-downloader/src/FileSystem/FileSystem.cpp:540:validateSDP():Missing file: /home/user/spads/var/spring/data/pool/84/e325a28090982d6775256fb70d4b0b.gz
[Error] /home/user/spads/pr-downloader/src/Downloader/Rapid/Sdp.cpp:123:download():Validation failed
[Error] /home/user/spads/pr-downloader/src/main.cpp:240:main():Error occurred while downloading: 2
abma
Spring Developer
Posts: 3754
Joined: 01 Jun 2009, 00:08

Re: server migration on 20.04.2021: TODO-list

Post by abma »

the rapid problem should be fixed: cgi wasn't enabled. please try downloading again!
User avatar
Beherith
Moderator
Posts: 5076
Joined: 26 Oct 2007, 16:21

Re: server migration on 20.04.2021: TODO-list

Post by Beherith »

Works now, thank you!

Deleting spam is now super fast on forum :D much much <3 <3
abma
Spring Developer
Posts: 3754
Joined: 01 Jun 2009, 00:08

Re: server migration on 20.04.2021: TODO-list

Post by abma »

IMHO the migration is finished, all services should be up and running again.

Thanks a lot to Dansan, Turboss and Tim!
Post Reply

Return to “Infrastructure Development”