FOSSBotsWiki:Server admin log/Archive 1

    From FOSSBotsWiki

    2020-12-30

    • <RhinosF1> deployed Phab update, CI will hate me --22:35, 30 December 2020 (UTC)
    • <MacFan4000> restart prod --18:29, 30 December 2020 (UTC)
    • <MacFan4000> restart -test and stop prod for config change --18:27, 30 December 2020 (UTC)
    • <MacFan4000> stop -test for config change --18:25, 30 December 2020 (UTC)
    • <MacFan4000> restart sigmabot --17:58, 30 December 2020 (UTC)
    • <Zppix> update tzdata and python-apt-common and python3-apt using apt full-upgrade on all servers --16:41, 30 December 2020 (UTC)
    • <RhinosF1> reloaded beta x2 --10:42, 30 December 2020 (UTC)

    2020-12-27

    • <MacFan4000> restart prod --13:38, 27 December 2020 (UTC)
    • <MacFan4000> restart -test and stop prod for config change --13:36, 27 December 2020 (UTC)
    • <MacFan4000> stop -test for config change --13:33, 27 December 2020 (UTC)
    • <MacFan4000> updated MirahezeBots BotPassword --13:33, 27 December 2020 (UTC)
    • <MacFan4000> changed on-wiki password for MirahezeBots --13:29, 27 December 2020 (UTC)

    2020-12-26

    • <MacFan4000> update mail password on tools1 and restart apache --23:20, 26 December 2020 (UTC)
    • <MacFan4000> changed password for bots-noreply@mh.o --23:18, 26 December 2020 (UTC)

    2020-12-25

    • <RhinosF1> **servers i meant --22:42, 25 December 2020 (UTC)
    • <RhinosF1> confirmed https://git.io/JL1hG deployed on all versions --22:41, 25 December 2020 (UTC)

    2020-12-24

    • <MacFan4000> updated consumer secret on phab for MediaWiki auth --18:48, 24 December 2020 (UTC)

    2020-12-23

    • <MacFan4000> updating ping lists for sigmabot and restarting --19:20, 23 December 2020 (UTC)
    • <MacFan4000> uninstalling travis and dependabot-preview from @MirahezeBots org --18:13, 23 December 2020 (UTC)
    • <MacFan4000> restart both mhbot instances --02:10, 23 December 2020 (UTC)

    2020-12-22

    • <MacFan4000> updated AntiSpamSopel repo on bots1 to use access token rather then password --20:37, 22 December 2020 (UTC)
    • <RhinosF1> install mtr earlier via apt on bots1 to help John debug American cache proxy being slow --15:34, 22 December 2020 (UTC)

    2020-12-21

    • <MacFan4000> restart -test --01:45, 21 December 2020 (UTC)
    • <MacFan4000> restart streambot and icingabot --01:06, 21 December 2020 (UTC)

    2020-12-19

    • <RhinosF1> applied commandCharecters config on discordirc*@bots1 per Zppix conv and requests --22:01, 19 December 2020 (UTC)

    2020-12-17

    • <MacFan4000> added dmehus to Sygnal ping list for #miraheze and -overflow --00:55, 17 December 2020 (UTC)

    2020-12-15

    • <RhinosF1> cleaned up old certs on bots1 --22:24, 15 December 2020 (UTC)
    • <MacFan4000> restart phd --22:21, 15 December 2020 (UTC)
    • <RhinosF1> cleaned up old certs on tools1 --22:21, 15 December 2020 (UTC)
    • <MacFan4000> manually generate a cert for bots.miraheze.wiki --22:10, 15 December 2020 (UTC)
    • <MacFan4000> macfan@100:~$ sudo apt-get update && sudo apt-get upgrade --21:54, 15 December 2020 (UTC)
    • <MacFan4000> macfan@113:~$ sudo apt-get update && sudo apt-get upgrade --21:52, 15 December 2020 (UTC)
    • <RhinosF1> reboot tools1 --21:51, 15 December 2020 (UTC)
    • <RhinosF1> apt-get update&upgrade on tools1 --21:51, 15 December 2020 (UTC)

    2020-12-09

    • <MacFan4000> phabricator upgrade done --23:34, 9 December 2020 (UTC)
    • <MacFan4000> upgrading phabricator --23:33, 9 December 2020 (UTC)
    • <RhinosF1> blocked BWM from MHBots --18:30, 9 December 2020 (UTC)

    2020-12-08

    • <MacFan4000> restart discord-relay (mh) --18:43, 8 December 2020 (UTC)
    • <Reception123> restarted discord bot --16:05, 8 December 2020 (UTC)
    • <Reception123> restarted streambot --15:54, 8 December 2020 (UTC)
    • <Reception123> retarted mirahezebot and sigmabot --15:54, 8 December 2020 (UTC)
    • <Reception123> reboot bots1 --15:50, 8 December 2020 (UTC)

    2020-11-29

    • <MacFan4000> restart prod --00:37, 29 November 2020 (UTC)
    • <MacFan4000> macfan@100:/srv/pip$ sudo pip3 install -r requirements.txt --upgrade --00:36, 29 November 2020 (UTC)

    2020-11-28

    • <RhinosF1> 9.1.0 update is blocked on https://github.com/actions/virtual-environments/issues/1691#issuecomment-735280960b and GitHub support ticker #922621 --20:12, 28 November 2020 (UTC)
    • <MacFan4000> restart -test --19:19, 28 November 2020 (UTC)
    • <RhinosF1> update core protection rule --18:27, 28 November 2020 (UTC)
    • <MacFan4000> deleted master branch protection rule and added release branch protection rule --17:36, 28 November 2020 (UTC)
    • <MacFan4000> updated default branch for @MirahezeBots/MirahezeBots from master to dev --17:34, 28 November 2020 (UTC)
    • <MacFan4000> updated branch protection rule for bots-web for new ci --16:49, 28 November 2020 (UTC)
    • <MacFan4000> added branch protection rules for sopel-pingpong/sopel-adminlist/sopel-channelmgnt/sopel-joinall/jsonparser to require build jobs to pass before pushing to release --15:45, 28 November 2020 (UTC)
    • <MacFan4000> updated branch protection rule on bots-pip-auto to account for new ci check and no longer require travis --15:29, 28 November 2020 (UTC)

    2020-11-27

    • <MacFan4000> updated default branch for @MirahezeBots/jsonparser from master to dev --22:38, 27 November 2020 (UTC)
    • <MacFan4000> updated default branch for @MirahezeBots/sopel-joinall from main to dev --20:23, 27 November 2020 (UTC)
    • <MacFan4000> updated default branch for @MirahezeBots/sopel-adminlist from main to dev --16:18, 27 November 2020 (UTC)

    2020-11-23

    • <MacFan4000> add mhbots pypi token as an org secret --14:44, 23 November 2020 (UTC)

    2020-11-20

    • <MacFan4000> restart streambot --19:42, 20 November 2020 (UTC)

    2020-11-15

    • <RhinosF1> all maintenance by me is over --22:52, 15 November 2020 (UTC)
    • <RhinosF1> sudo apt install libcairo2-dev pkg-config on tools1. pip3 install pycairo --22:43, 15 November 2020 (UTC)
    • <RhinosF1> Successfully installed SQLAlchemy-1.3.19 --22:39, 15 November 2020 (UTC)
    • <RhinosF1> sopel-modules.youtube-0.3.2 sqlalchemy-1.3.20 typing-extensions-3.7.4.3 update-checker-0.18.0 uritemplate-3.0.1 urllib3-1.26.2 xmltodict-0.12.0 yarl-1.6. --22:38, 15 November 2020 (UTC)
    • <RhinosF1> Successfully installed aiohttp-3.7.2 async-timeout-3.0.1 attrs-20.3.0 cachetools-4.1.1 certifi-2020.11.8 chardet-3.0.4 dnspython-2.0.0 geoip2-4.1.0 google-api-python-client-1.7.12 google-auth-1.23.0 google-auth-httplib2-0.0.4 httplib2-0.18.1 idna-2.10 maxminddb-2.0.3 multidict-5.0.2 praw-5.4.0 prawcore-0.14.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pytz-2020.4 requests-2.25.0 rsa-4.6 setuptools-50.3.2 six-1.15.0 sopel-7.0.7 --22:38, 15 November 2020 (UTC)
    • <RhinosF1> Successfully installed google-api-core-1.23.0 google-api-python-client-1.12.5 googleapis-common-protos-1.52.0 httplib2-0.18.1 protobuf-3.14.0 six-1.15.0 urllib3-1.26.2 TOOLS1 --22:37, 15 November 2020 (UTC)
    • <RhinosF1> restart productin --22:29, 15 November 2020 (UTC)
    • <RhinosF1> restarted beta --22:23, 15 November 2020 (UTC)
    • <RhinosF1> Successfully installed requests-2.25.0 on bots1 dev --22:22, 15 November 2020 (UTC)
    • <RhinosF1> Successfully installed SecretStorage-3.2.0 pytz-2020.4 requests-2.25.0 on bots1 production --22:17, 15 November 2020 (UTC)
    • <MacFan4000> ran puppet on bots1 --21:08, 15 November 2020 (UTC)
    • <MacFan4000> apt upgrade on all servers --15:55, 15 November 2020 (UTC)
    • <MacFan4000> fixed permissions for certain files in /etc/icinga2 on tools1 --15:14, 15 November 2020 (UTC)
    • <MacFan4000> messing a bunch with icinga --14:48, 15 November 2020 (UTC)

    2020-11-09

    • <RhinosF1> allows admins to ignore CI on bots-pip-auto --15:18, 9 November 2020 (UTC)

    2020-11-01

    • <RhinosF1> Deleted production users using sopel-dbclean in /home/rhinosf1/delnov.txt as older than 2019-05-01 --22:49, 1 November 2020 (UTC)

    2020-10-28

    • <MacFan4000> start -test --16:19, 28 October 2020 (UTC)
    • <MacFan4000> run puppet --16:16, 28 October 2020 (UTC)
    • <MacFan4000> stop -test --16:14, 28 October 2020 (UTC)

    2020-10-27

    • <MacFan4000> restart prod --13:17, 27 October 2020 (UTC)
    • <MacFan4000> apply schema change on prod --13:16, 27 October 2020 (UTC)
    • <MacFan4000> stop prod --13:15, 27 October 2020 (UTC)
    • <MacFan4000> restart -test --13:12, 27 October 2020 (UTC)
    • <MacFan4000> applied schema change to -test db --13:12, 27 October 2020 (UTC)
    • <MacFan4000> stop -test --13:09, 27 October 2020 (UTC)

    2020-10-26

    • <Spookreeeno> [bots1] Successfully installed GitPython-3.1.11 Pygments-2.7.2 aiohttp-3.7.1 attrs-20.2.0 ipython-7.18.1 keyrings.alt-4.0.0 multidict-5.0.0 pbr-5.5.1 pyxdg-0.27 sopel-modules.quotes-1.2.1 sopel-modules.youtube-0.3.2 vcrpy-4.1.1 yarl-1.6.2 after rhinosf1@100:/etc/puppet/code$ sudo /usr/bin/pip3 install -U -r /srv/pip/requirements.txt --08:02, 26 October 2020 (UTC)

    2020-10-25

    • <Spookreeeno> that's on MirahezeBotBeta --13:28, 25 October 2020 (UTC)
    • <Spookreeeno> fixed responses --13:28, 25 October 2020 (UTC)
    • <Reception123> ran puppet and restarted beta bot --13:26, 25 October 2020 (UTC)
    • <Spookreeeno> Reception123: ran updates and restarted beta --13:19, 25 October 2020 (UTC)
    • <Spookreeeno> fix PyPi list and poke Dependabot for dev venv --13:11, 25 October 2020 (UTC)

    2020-10-24

    • <MacFan4000> restart -test --16:27, 24 October 2020 (UTC)

    2020-10-23

    • <MacFan4000> removing dependabot-preview from bots-web --21:03, 23 October 2020 (UTC)
    • <MacFan4000> MariaDB [phabricator_daemon]> UPDATE daemon_log SET status = 'exit' where pid = 7428 and status = 'unknown'; --20:56, 23 October 2020 (UTC)
    • <MacFan4000> run puppet and restart phd --20:46, 23 October 2020 (UTC)
    • <MacFan4000> unset mariadb read-only --20:42, 23 October 2020 (UTC)
    • <MacFan4000> setting mariadb to read-only --19:56, 23 October 2020 (UTC)
    • <MacFan4000> restart mariadb --19:52, 23 October 2020 (UTC)
    • <MacFan4000> stopping mariadb on db1 --19:46, 23 October 2020 (UTC)
    • <Spookreeeno> added bots@ to fosshost status emails --16:47, 23 October 2020 (UTC)
    • <MacFan4000> messed with phabricator permissions to get them working again --13:09, 23 October 2020 (UTC)

    2020-10-21

    • <MacFan4000> restart -test again --16:45, 21 October 2020 (UTC)
    • <MacFan4000> restart -test again --16:32, 21 October 2020 (UTC)
    • <MacFan4000> restart -test --16:29, 21 October 2020 (UTC)
    • <MacFan4000> run puppet on bots1 --16:25, 21 October 2020 (UTC)

    2020-10-20

    • <MacFan4000> removed Dependabot-preview from bots-pip-auto --14:21, 20 October 2020 (UTC)

    2020-10-12

    • <MacFan4000> prod --20:19, 12 October 2020 (UTC)
    • <MacFan4000> start --20:18, 12 October 2020 (UTC)
    • <Spookreeeno> channelmgnt 1.0.2 & 9.0.1 core yanked in PyPi --20:08, 12 October 2020 (UTC)
    • <MacFan4000> stop both bots again --19:27, 12 October 2020 (UTC)
    • <MacFan4000> restarting both bots --19:24, 12 October 2020 (UTC)

    2020-10-08

    • <MacFan4000> restart -test --02:23, 8 October 2020 (UTC)
    • <MacFan4000> restart -test --02:11, 8 October 2020 (UTC)
    • <MacFan4000> macfan@100:/srv/sopelbots/devcode/sopel-channelmgnt$ sudo /srv/sopelbots/devvenv/bin/pip3 install . --force-reinstall --02:10, 8 October 2020 (UTC)
    • <MacFan4000> restart -test --02:06, 8 October 2020 (UTC)
    • <MacFan4000> run puppet twice --02:05, 8 October 2020 (UTC)

    2020-10-07

    • <Spookreeeno> wikimgnt has been undeployed --15:45, 7 October 2020 (UTC)
    • <MacFan4000> restart -test --15:44, 7 October 2020 (UTC)
    • <MacFan4000> upgrade complete --13:28, 7 October 2020 (UTC)
    • <MacFan4000> upgrading phabricator --13:25, 7 October 2020 (UTC)

    2020-10-06

    • <Spookreeeno> created devcodebackup-20201006.tar.gz of pre-today state, all done and sucessful --21:46, 6 October 2020 (UTC)
    • <Spookreeeno> installs complete, restarting Beta --21:37, 6 October 2020 (UTC)
    • <Spookreeeno> adminlist is done, awaiting core now --21:21, 6 October 2020 (UTC)
    • <Spookreeeno> puppet running fine and code location switched --21:02, 6 October 2020 (UTC)
    • <Spookreeeno> running puppet twice --20:56, 6 October 2020 (UTC)
    • <Spookreeeno> starting sopeldev changes --20:52, 6 October 2020 (UTC)
    • <Spookreeeno> all git repos ready for dev switch for jp + adminlist. Adminlist update coming shortly then deploying code changes. --20:37, 6 October 2020 (UTC)
    • <MacFan4000> updated mail password in private hiera and ran puppet --20:10, 6 October 2020 (UTC)
    • <MacFan4000> restart -test --16:26, 6 October 2020 (UTC)
    • <MacFan4000> sudo /srv/sopelbots/devvenv/bin/pip3 install . --force-reinstall --16:26, 6 October 2020 (UTC)
    • <MacFan4000> restart -test --16:17, 6 October 2020 (UTC)
    • <MacFan4000> start -test --15:59, 6 October 2020 (UTC)
    • <MacFan4000> run puppet --15:57, 6 October 2020 (UTC)
    • <MacFan4000> macfan@100:~$ sudo rm -rf /srv/sopelbots/devcode --15:57, 6 October 2020 (UTC)
    • <MacFan4000> run puppet --15:52, 6 October 2020 (UTC)
    • <MacFan4000> macfan@100:~$ sudo rm -rf /srv/sopelbots/devcode --15:51, 6 October 2020 (UTC)
    • <MacFan4000> stop -test --15:51, 6 October 2020 (UTC)

    2020-09-29

    • <MacFan4000> restart prod --11:48, 29 September 2020 (UTC)
    • <MacFan4000> restart -test and stop prod for config change --11:47, 29 September 2020 (UTC)
    • <MacFan4000> stop -test for config change --11:42, 29 September 2020 (UTC)

    2020-09-24

    • <MacFan4000> (repo) --17:39, 24 September 2020 (UTC)
    • <MacFan4000> setup jsonparser (today and yesterday) and enable notification notifications --17:39, 24 September 2020 (UTC)

    2020-09-23

    • <RhinosF1> DO NOT START PHD AS ROOT. USE WWW-DATA --20:52, 23 September 2020 (UTC)
    • <RhinosF1> rhinosf1@112:/var/phabricator$ sudo -u www-data bin/phd start --force --20:51, 23 September 2020 (UTC)
    • <RhinosF1> rhinosf1@112:/var/phabricator$ sudo -u www-data bin/phd restart --20:51, 23 September 2020 (UTC)
    • <RhinosF1> Notice: /Stage[main]/Phabricator/File[/var/phabricator/conf/local/local.json]/content: content changed '{md5}c0b703256aa74d419e744958b6e45fb4' to '{md5}be1d9f58a6c82373863da5a9013ed037' --20:47, 23 September 2020 (UTC)
    • <RhinosF1> update password:mail:phab on tools1 --20:46, 23 September 2020 (UTC)
    • <RhinosF1> update K4 email on phab --20:44, 23 September 2020 (UTC)

    2020-09-16

    • <MacFan4000> macfan@100:~$ sudo service streambot restart --15:06, 16 September 2020 (UTC)

    2020-09-15

    • <MacFan4000> added notifico for 2 repos --16:58, 15 September 2020 (UTC)

    2020-09-01

    • <Voidwalker> /discord-irc$ sudo npm run build --23:47, 1 September 2020 (UTC)
    • <RhinosF1> I mean bots1 --21:28, 1 September 2020 (UTC)
    • <RhinosF1> libisccfg163 liblwres161 libopenexr23 nodejs php-icinga --21:28, 1 September 2020 (UTC)
    • <RhinosF1> icingaweb2-module-monitoring libdns-export1104 libdns1104 libgs9 libgs9-common libirs161 libisc-export1100 libisc1100 libisccc161 --21:28, 1 September 2020 (UTC)
    • <RhinosF1> apache2 apache2-bin apache2-data apache2-utils ghostscript icingacli icingaweb2 icingaweb2-common icingaweb2-module-doc --21:27, 1 September 2020 (UTC)
    • <RhinosF1> update npm + apt on tools1 --21:27, 1 September 2020 (UTC)
    • <RhinosF1> and start up again --14:53, 1 September 2020 (UTC)
    • <RhinosF1> killing streambot due to high lag --14:52, 1 September 2020 (UTC)

    2020-08-24

    • <MacFan4000> restart icingabot --16:58, 24 August 2020 (UTC)
    • <MacFan4000> prod config change done, starting up --11:58, 24 August 2020 (UTC)
    • <MacFan4000> stop prod bot for config change --11:57, 24 August 2020 (UTC)
    • <MacFan4000> -test config change done, starting up --11:56, 24 August 2020 (UTC)
    • <MacFan4000> stop -test for config change --11:54, 24 August 2020 (UTC)

    2020-08-22

    • <MacFan4000> restart prod MirahezeBot --00:15, 22 August 2020 (UTC)

    2020-08-21

    • <MacFan4000> config update done, starting up --18:33, 21 August 2020 (UTC)
    • <MacFan4000> stop prod mhbot to update config --18:32, 21 August 2020 (UTC)

    2020-08-19

    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo pip3 uninstall autopep8 --13:00, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo pip3 uninstall configparser --12:59, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo pip3 uninstall requests-oauthlib --12:58, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo pip3 uninstall oauthlib --12:58, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo pip3 uninstall mwclient --12:55, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ /srv/sopelbots/devvenv/bin/pip3 install pipdeptree --12:54, 19 August 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/pip$ sudo /usr/bin/pip3 install -U -r /srv/pip/requirements.txt END - Successfully installed SQLAlchemy-1.3.19 --12:50, 19 August 2020 (UTC)

    2020-08-18

    • <RhinosF1> add zppix to PyPi --22:12, 18 August 2020 (UTC)
    • <Zppix> prune default.tell.db --19:13, 18 August 2020 (UTC)
    • <Zppix> update discord-irc to 2.9.0 & and run npm outdated & npm update, and update npm to 6.14.8 --18:06, 18 August 2020 (UTC)

    2020-08-17

    • <RhinosF1> MariaDB [phabricator_daemon]> UPDATE daemon_log SET status = 'exit' where pid = 24640 and status = 'unknown'; --14:50, 17 August 2020 (UTC)
    • <RhinosF1> reboot tools1 (all done noow) --14:22, 17 August 2020 (UTC)
    • <RhinosF1> phab+db1 out of read only --14:19, 17 August 2020 (UTC)
    • <RhinosF1> tools1 done --14:19, 17 August 2020 (UTC)
    • <RhinosF1> db1 done --14:16, 17 August 2020 (UTC)
    • <RhinosF1> rolling apt update and restart across db1,tools1,bots1 --14:10, 17 August 2020 (UTC)
    • <RhinosF1> phab+db1 to read only --14:10, 17 August 2020 (UTC)
    • <MacFan4000> fix perms on /var/repo --12:59, 17 August 2020 (UTC)
    • <RhinosF1> applying apt update --10:23, 17 August 2020 (UTC)
    • <RhinosF1> scp a backup of #miraheze & #miraheze-cvt's logs to bots1@/var/sopel/log --09:05, 17 August 2020 (UTC)

    2020-08-16

    • <MacFan4000> stopping MirahezeBotBeta to edit wikimgnt config --17:25, 16 August 2020 (UTC)

    2020-08-15

    • <MacFan4000> restart phab daemons --23:45, 15 August 2020 (UTC)

    2020-08-13

    • <RhinosF1> enable v2 phab config on test --12:26, 13 August 2020 (UTC)
    • <RhinosF1> tweak phab config --10:37, 13 August 2020 (UTC)

    2020-08-12

    • <RhinosF1> fix config of beta --11:47, 12 August 2020 (UTC)
    • <RhinosF1> reboot MirahezeBotBeta after sudo git pulling dev --10:00, 12 August 2020 (UTC)
    • <RhinosF1> apply config for #277 --08:17, 12 August 2020 (UTC)

    2020-08-11

    • <MacFan4000> restart -test --14:49, 11 August 2020 (UTC)

    2020-08-10

    • <MacFan4000> phabricator updated --13:00, 10 August 2020 (UTC)
    • <MacFan4000> updating phabricator --12:58, 10 August 2020 (UTC)

    2020-08-06

    • <RhinosF1> sudo /srv/sopelbots/devvenv/bin/pip3.7 uninstall mwclient 14:35, 6 August 2020 (UTC)
    • <RhinosF1> sudo /srv/sopelbots/devvenv/bin/pip3.7 uninstall requests-oauthlib 14:35, 6 August 2020 (UTC)
    • <RhinosF1> sudo /srv/sopelbots/devvenv/bin/pip3.7 uninstall oauthlib 14:35, 6 August 2020 (UTC)

    2020-08-04

    • <MacFan4000> fix perms on sygnal db --00:49, 4 August 2020 (UTC)

    2020-08-03

    • <MacFan4000> restart streambot --18:34, 3 August 2020 (UTC)
    • <RhinosF1> all servers rebooted for apt upgrade --10:35, 3 August 2020 (UTC)
    • <RhinosF1> reboot db1 --10:35, 3 August 2020 (UTC)
    • <RhinosF1> reboot tools1 --10:31, 3 August 2020 (UTC)
    • <RhinosF1> reboot bots1 due to apt update --10:30, 3 August 2020 (UTC)
    • <RhinosF1> tar+gz backups --10:18, 3 August 2020 (UTC)
    • <RhinosF1> delete git artifacts and Sygnal.db from prod --10:14, 3 August 2020 (UTC)

    2020-08-02

    • <RhinosF1> restart again as none of our plugins have loaded --23:45, 2 August 2020 (UTC)
    • <RhinosF1> start mirahezebotprod --23:37, 2 August 2020 (UTC)
    • <RhinosF1> Successfully installed MirahezeBot-Plugins-8.0.2 feedparser-5.2.1 pytest-6.0.0 sopel-modules.quotes-1.1.1 --23:36, 2 August 2020 (UTC)
    • <MacFan4000> add RhinosF1 and MacFan4000 as collaborators on MirahezeBot-Plugins PyPi project --22:57, 2 August 2020 (UTC)
    • <RhinosF1> copied Sygnal.db back to prod modules folder from backup, removed all git artifcats --22:14, 2 August 2020 (UTC)
    • <RhinosF1> back prod up --22:05, 2 August 2020 (UTC)
    • <RhinosF1> expect downtime in next 60 mins lasting ~5 mins twice --22:03, 2 August 2020 (UTC)

    2020-08-01

    • <RhinosF1> cut 8.0.0 branch --11:36, 1 August 2020 (UTC)

    2020-07-31

    • <RhinosF1> manually start discordirc and mirahezebotprod --08:42, 31 July 2020 (UTC)
    • <RhinosF1> reboot bots1 via promox --08:40, 31 July 2020 (UTC)
    • <RhinosF1> restart icinga2,apache2 and networking on bots1 as it keeps reporting strange network issues --08:35, 31 July 2020 (UTC)

    2020-07-30

    • <RhinosF1> https://git.io/JJgQN is non impacting, dev-requirements aren't applied (only devs need them) but ensured it was deployed and compilied --13:05, 30 July 2020 (UTC)
    • <RhinosF1> 'sudo git pull' to refresh /srv/sopelbots/devcode build --10:38, 30 July 2020 (UTC)

    2020-07-29

    • <MacFan4000> restart test instance --16:14, 29 July 2020 (UTC)
    • <RhinosF1> refresh devcode --13:02, 29 July 2020 (UTC)
    • <RhinosF1> rebooting beta to apply a change & refreshing devcode --09:43, 29 July 2020 (UTC)
    • <RhinosF1> refresh /srv/sopelbots/devcode --09:23, 29 July 2020 (UTC)
    • <RhinosF1> refresh /srv/sopelbots/devcode --09:13, 29 July 2020 (UTC)
    • <RhinosF1> removed remnants of old git clone from /srv/sopelbots/test --09:11, 29 July 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/sopelbots$ tar -zcvf test-backup.tar.gz test-backup + rm test-backup --09:03, 29 July 2020 (UTC)

    2020-07-28

    • <MacFan4000> restart both instances --19:49, 28 July 2020 (UTC)
    • <MacFan4000> restart main instance --14:12, 28 July 2020 (UTC)
    • <MacFan4000> restart test instance --14:11, 28 July 2020 (UTC)
    • <RhinosF1> cut release-8-0-0 branch --09:55, 28 July 2020 (UTC)
    • <RhinosF1> applied c81e128 to /devcode --09:51, 28 July 2020 (UTC)

    2020-07-27

    • <MacFan4000> restart sigmabot --23:25, 27 July 2020 (UTC)
    • <RhinosF1> restart test bot service --21:47, 27 July 2020 (UTC)
    • <RhinosF1> Successfully installed MirahezeBot-Plugins-8.0.0 (on devvenv via /srv/../devcode) --21:46, 27 July 2020 (UTC)
    • <RhinosF1> remove .git,.github and modules from test --21:41, 27 July 2020 (UTC)
    • <RhinosF1> backed up beta to test-backup --21:39, 27 July 2020 (UTC)
    • <RhinosF1> stop beta for maint --21:37, 27 July 2020 (UTC)
    • <RhinosF1> add enforced CI for non-admins to bot code master branch. All admins can override this but it's much easier to make the check pass. --13:43, 27 July 2020 (UTC)
    • <RhinosF1> MirahezeBotBeta is now using a venv --13:32, 27 July 2020 (UTC)
    • <RhinosF1> point MirahezeBotBeta @ devvenv --13:28, 27 July 2020 (UTC)
    • <RhinosF1> Successfully installed wheel-0.34.2 --13:28, 27 July 2020 (UTC)
    • <RhinosF1> sopel-7.0.5 sopel-modules.quotes-1.1.0 sopel-modules.stocks-1.1.2 sopel-modules.twitter-0.3.2 sopel-modules.weather-1.2.2 sopel-modules.youtube-0.3.1 sqlalchemy-1.3.18 typing-extensions-3.7.4.2 update-checker-0.17 uritemplate-3.0.1 urllib3-1.25.10 xmltodict-0.12.0 yarl-1.5.0 --13:27, 27 July 2020 (UTC)
    • <RhinosF1> Successfully installed aiohttp-3.6.2 async-timeout-3.0.1 attrs-19.3.0 cachetools-4.1.1 certifi-2020.6.20 chardet-3.0.4 dnspython-2.0.0 geoip2-4.0.1 google-api-python-client-1.7.12 google-auth-1.19.2 google-auth-httplib2-0.0.4 httplib2-0.18.1 idna-2.10 maxminddb-2.0.1 multidict-4.7.6 oauth2-1.9.0.post1 praw-5.4.0 prawcore-0.14.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pymysql-0.10.0 pytz-2020.1 requests-2.24.0 rsa-4.6 six-1.15.0 --13:27, 27 July 2020 (UTC)
    • <RhinosF1> on devvenv --13:27, 27 July 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/srv/sopelbots$ python3 -m venv /srv/sopelbots/devvenv --12:21, 27 July 2020 (UTC)
    • <RhinosF1> start MirahezeBot back up after sanity checking everything --12:03, 27 July 2020 (UTC)
    • <RhinosF1> stop MirahezeBotProd --11:59, 27 July 2020 (UTC)
    • <MacFan4000> restart both instances for update --11:58, 27 July 2020 (UTC)
    • <RhinosF1> deploy 7.2 to beta --10:22, 27 July 2020 (UTC)

    2020-07-26

    • <RhinosF1> sudo service mirahezebot* restart --06:20, 26 July 2020 (UTC)
    • <RhinosF1> Successfully installed aiohttp-3.6.2 async-timeout-3.0.1 geoip2-4.0.1 maxminddb-2.0.1 sopel-7.0.5 --06:19, 26 July 2020 (UTC)
    • <RhinosF1> Successfully installed PyMySQL-0.10.0 cryptography-3.0 dnspython-2.0.0 google-auth-1.19.2 jedi-0.17.2 parso-0.7.1 urllib3-1.25.10 --06:18, 26 July 2020 (UTC)

    2020-07-25

    • <RhinosF1> me@my-pc MirahezeBots % travis encrypt "<K2>" -add deploy.password --com (logged in to my GitHub) --22:42, 25 July 2020 (UTC)
    • <RhinosF1> PyPi Password is in K2 --22:31, 25 July 2020 (UTC)
    • <RhinosF1> delete branch RhinosF1-patch-* on MirahezeBots repo --22:03, 25 July 2020 (UTC)
    • <MacFan4000> restart main instance --18:39, 25 July 2020 (UTC)

    2020-07-24

    • <RhinosF1> Blocked JohnBishop95 from Git Org --17:30, 24 July 2020 (UTC)

    2020-07-23

    • <MacFan4000> disable py module on both instances and restart --13:47, 23 July 2020 (UTC)

    2020-07-21

    • <MacFan4000> install and configure ufw on tools1 and db1 --11:58, 21 July 2020 (UTC)

    2020-07-20

    • <MacFan4000> move done, fixing setup issues --14:00, 20 July 2020 (UTC)
    • <MacFan4000> backup phab database on bots1 and import on db1 --13:43, 20 July 2020 (UTC)
    • <MacFan4000> set phabricator to readonly --13:25, 20 July 2020 (UTC)
    • <MacFan4000> copy vhost config for phab to tools1 --13:03, 20 July 2020 (UTC)
    • <MacFan4000> remove http checks in icinga for db1 --11:25, 20 July 2020 (UTC)
    • <MacFan4000> comment out bind-address in MariaDB config --11:16, 20 July 2020 (UTC)
    • <RhinosF1> fail osticket over to db1 and add grants --08:35, 20 July 2020 (UTC)
    • <RhinosF1> backup osticket on bots1 and restore on db1 --08:31, 20 July 2020 (UTC)
    • <RhinosF1> set osticket to read only --08:21, 20 July 2020 (UTC)

    2020-07-19

    • <RhinosF1> start mysql on db1 --22:21, 19 July 2020 (UTC)
    • <RhinosF1> add db1 to icinga --21:50, 19 July 2020 (UTC)
    • <MacFan4000> restart phab daemons --21:47, 19 July 2020 (UTC)
    • <RhinosF1> add address6 to bots1 icinga config --21:47, 19 July 2020 (UTC)
    • <RhinosF1> enable usePAM on sshd --21:35, 19 July 2020 (UTC)
    • <RhinosF1> enable ipv6 on bots1 --21:25, 19 July 2020 (UTC)
    • <Zppix> restart discord irc relay to make sure it uses new nodejs/npm versions --16:00, 19 July 2020 (UTC)
    • <Zppix> upgrade nodejs to v14, and npm to 6.14 --15:59, 19 July 2020 (UTC)
    • <Zppix> install htop for a better user friendly "top" command --15:58, 19 July 2020 (UTC)
    • <RhinosF1> reboot bots1 --11:54, 19 July 2020 (UTC)

    2020-07-18

    • <RhinosF1> "sudo /etc/init.d/networking restart" --23:24, 18 July 2020 (UTC)
    • <RhinosF1> revert ivp6 addition --23:17, 18 July 2020 (UTC)
    • <RhinosF1> restart discordirc & mirahezebotprod manually --23:12, 18 July 2020 (UTC)
    • <RhinosF1> reboot via promox --23:07, 18 July 2020 (UTC)
    • <RhinosF1> add ipv6 on bots1 and restart networking --22:44, 18 July 2020 (UTC)
    • <RhinosF1> set RestartSec to 15 on streambot.service (bots1) --22:21, 18 July 2020 (UTC)
    • <RhinosF1> test some more fixes --21:45, 18 July 2020 (UTC)
    • <RhinosF1> apply streambot security patch --21:33, 18 July 2020 (UTC)

    2020-07-17

    • <MacFan4000> updated MirahezeBot profile on MH phab and link GitHub MirahezeBot account --21:49, 17 July 2020 (UTC)
    • <MacFan4000> on tools1 --12:19, 17 July 2020 (UTC)
    • <MacFan4000> installed necessary php packages for osticket --12:19, 17 July 2020 (UTC)
    • <MacFan4000> edited MariaDB connection to allow remote connections --12:15, 17 July 2020 (UTC)
    • <RhinosF1> create mysql user 'support' and grant privileges on osticket.* --12:11, 17 July 2020 (UTC)
    • <RhinosF1> this is on tools1 --08:25, 17 July 2020 (UTC)
    • <RhinosF1> install OSTicket in /var/support and make support.bots.miraheze.wiki use it --08:24, 17 July 2020 (UTC)

    2020-07-16

    • <MacFan4000> restart icingabot --23:46, 16 July 2020 (UTC)
    • <MacFan4000> updated welcome message for tools1 to match bots1 --11:43, 16 July 2020 (UTC)
    • <RhinosF1> also switched ipv4 on bots1 icinga to external ip over 127.0.0.1 --10:27, 16 July 2020 (UTC)
    • <RhinosF1> switched icinga config to using 'bots1' and 'tools1' rather than 100/112 and added relevant checks. --10:27, 16 July 2020 (UTC)
    • <RhinosF1> restart apache2 on tools1 for http fix --10:01, 16 July 2020 (UTC)
    • <RhinosF1> tweaking icinga config --09:58, 16 July 2020 (UTC)
    • <RhinosF1> made puppet summary world rwe --09:31, 16 July 2020 (UTC)
    • <RhinosF1> issue bots.miraheze.wiki cert on tools1 --08:53, 16 July 2020 (UTC)
    • <MacFan4000> adding tools1 to icinga --01:10, 16 July 2020 (UTC)
    • <RhinosF1> fixed f***ed up file perms --00:16, 16 July 2020 (UTC)

    2020-07-15

    • <MacFan4000> disable password auth on tools1 --23:21, 15 July 2020 (UTC)
    • <RhinosF1> ssh keys have been set via puppet on bots1. All logged in sessions WILL FAIL. --23:08, 15 July 2020 (UTC)
    • <RhinosF1> revoke all ssh keys on bots1 and fallback to puppet --22:57, 15 July 2020 (UTC)
    • <Zppix> restart relay, reverting config change til i have more time --16:35, 15 July 2020 (UTC)
    • <Zppix> restart discord irc relay --16:23, 15 July 2020 (UTC)
    • <RhinosF1> loaded stocks on * --15:36, 15 July 2020 (UTC)
    • <RhinosF1> revert previous --12:05, 15 July 2020 (UTC)
    • <RhinosF1> restart mirahezebot* to deploy sopel.modules-stocks --11:48, 15 July 2020 (UTC)
    • <RhinosF1> drop www-data cron (now root) --10:49, 15 July 2020 (UTC)
    • <RhinosF1> add stocks config --10:47, 15 July 2020 (UTC)
    • <RhinosF1> puppet running on web --09:57, 15 July 2020 (UTC)

    2020-07-14

    • <RhinosF1> start apache --21:22, 14 July 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/var$ sudo chmod -R 0775 www --21:21, 14 July 2020 (UTC)
    • <RhinosF1> rhinosf1@100:/var$ sudo chown -R root:root www --21:21, 14 July 2020 (UTC)
    • <RhinosF1> removed web deploy cron --21:20, 14 July 2020 (UTC)
    • <RhinosF1> stop apache for web maint --21:17, 14 July 2020 (UTC)
    • <MacFan4000> restart -test --16:52, 14 July 2020 (UTC)
    • <RhinosF1> install puppet --13:31, 14 July 2020 (UTC)
    • <RhinosF1> root@100:/# sudo sync; echo 3 > /proc/sys/vm/drop_caches --12:33, 14 July 2020 (UTC)
    • <MacFan4000> restart for config/code changes --12:30, 14 July 2020 (UTC)
    • <MacFan4000> restart -test for config/code changes --12:20, 14 July 2020 (UTC)
    • <MacFan4000> restart -test for config/code changes --12:17, 14 July 2020 (UTC)
    • <RhinosF1> release 7.1 --09:28, 14 July 2020 (UTC)

    2020-07-13

    • <RhinosF1> reboot mariadb --21:52, 13 July 2020 (UTC)
    • <RhinosF1> deployed https://git.io/JJO51 & https://git.io/JJO7h --13:07, 13 July 2020 (UTC)
    • <RhinosF1> Successfully installed GitPython-3.1.7 --12:27, 13 July 2020 (UTC)
    • <RhinosF1> updating gitpython via pip3 then running update.py for https://git.io/JJOXT --12:26, 13 July 2020 (UTC)

    2020-07-12

    • <RhinosF1> fix dependabot config --10:14, 12 July 2020 (UTC)

    2020-07-10

    • <MacFan4000> tweaking SSL settings to be even more secure --16:09, 10 July 2020 (UTC)

    2020-07-09

    • <MacFan4000> phab update complete --17:30, 9 July 2020 (UTC)
    • <MacFan4000> updating phabricator --17:28, 9 July 2020 (UTC)
    • <Zppix> restart both mirahezebot instance to pick up config change --16:20, 9 July 2020 (UTC)
    • <MacFan4000> migrating MirahezeBots and bots-web repos to newer Travis implementation --13:31, 9 July 2020 (UTC)
    • <MacFan4000> disabled password auth for ssh --12:13, 9 July 2020 (UTC)
    • <RhinosF1> killed a stuck session of mine --11:59, 9 July 2020 (UTC)
    • <RhinosF1> restart both bots --09:59, 9 July 2020 (UTC)
    • <RhinosF1> Successfully installed PyHamcrest-2.0.2 PyMySQL-0.9.3 PyYAML-5.3.1 SQLAlchemy-1.3.18 Twisted-20.3.0 pyOpenSSL-19.1.0 pytest-5.4.3 pytz-2020.1 pyxdg-0.26 service-identity-18.1.0 sopel-7.0.4 sopel-modules.quotes-1.1.0 sopel-modules.twitter-0.3.2 sopel-modules.weather-1.2.2 sopel-modules.youtube-0.3.1 urllib3-1.25.9 vcrpy-4.0.2 wrapt-1.12.1 xmltodict-0.12.0 yarl-1.4.2 zope.interface-5.1.0 --09:57, 9 July 2020 (UTC)
    • <RhinosF1> fix CI --09:21, 9 July 2020 (UTC)

    2020-07-08

    • <MacFan4000> reinstalled pygments and regenerated ssl cert --11:49, 8 July 2020 (UTC)

    2020-07-07

    • <MacFan4000> macfan@100:~$ sudo python3 /srv/pip/update.py --19:55, 7 July 2020 (UTC)
    • <MacFan4000> transfered phab GitHub oauth to @MirahezeBots org --19:29, 7 July 2020 (UTC)
    • <MacFan4000> macfan@100:~$ sudo python3 /srv/pip/update.py --18:53, 7 July 2020 (UTC)
    • <MacFan4000> macfan@100:/srv/sopelbots$ sudo chown www-data:www-data test --18:02, 7 July 2020 (UTC)
    • <MacFan4000> macfan@100:/srv/sopelbots$ sudo chown www-data:www-data prod --18:02, 7 July 2020 (UTC)
    • <RhinosF1> macfan now a bot-user so removed redundant access --17:10, 7 July 2020 (UTC)
    • <MacFan4000> restart both instances --16:54, 7 July 2020 (UTC)
    • <MacFan4000> restart main bot for new module --16:12, 7 July 2020 (UTC)
    • <MacFan4000> restart -test for new module --15:50, 7 July 2020 (UTC)
    • <MacFan4000> restart -test for new module --15:49, 7 July 2020 (UTC)
    • <RhinosF1> Installing collected packages: pycparser, cffi, cryptography, josepy, parsedatetime, distro, certbot, jeepney, keyring --09:05, 7 July 2020 (UTC)

    2020-07-06

    • <RhinosF1> add auto-pip to diffusion repos --23:08, 6 July 2020 (UTC)
    • <RhinosF1> add cron for pip auto update --22:17, 6 July 2020 (UTC)
    • <RhinosF1> update pip --21:47, 6 July 2020 (UTC)
    • <RhinosF1> add "0,10,20,30,40,50 0,1,6-23 * * * python3 /var/www/deploy.py > /var/log/deploy.log" to www-data's cron --21:27, 6 July 2020 (UTC)
    • <Zppix> git reset --hard & git pull in /sopelbots/prod --18:02, 6 July 2020 (UTC)
    • <MacFan4000> instance restarted --17:16, 6 July 2020 (UTC)
    • <MacFan4000> stopping testbot to test icinga --17:14, 6 July 2020 (UTC)
    • <MacFan4000> added ssl check to icinga --16:35, 6 July 2020 (UTC)
    • <MacFan4000> added icingabot irc bot --16:22, 6 July 2020 (UTC)
    • <MacFan4000> restart test --15:22, 6 July 2020 (UTC)

    2020-07-05

    • <RhinosF1> fix some canonical urls and trick google, add icinga to search console --22:34, 5 July 2020 (UTC)
    • <MacFan4000> fix statusbot on both instances and restart --15:02, 5 July 2020 (UTC)
    • <Zppix> requested a global rename onwiki --13:48, 5 July 2020 (UTC)

    2020-07-04

    • <RhinosF1> add #miraheze-offtopic->#off-topic to discord relay map and add #miraheze-cvt-private + #miraheze-offtopic to the IRC Channel list then restart service x2 --22:32, 4 July 2020 (UTC)
    • <RhinosF1> manually deploy web change to add ToU+PP --21:55, 4 July 2020 (UTC)

    2020-07-03

    • <MacFan4000> removing sury php and using default Debian php --22:15, 3 July 2020 (UTC)
    • <RhinosF1> start 'mirahezebotprod' service --21:53, 3 July 2020 (UTC)
    • <RhinosF1> set permissions and synced db for mirahezebot --21:51, 3 July 2020 (UTC)
    • <Zppix> run ./repository update BotsWeb to fix error --18:44, 3 July 2020 (UTC)
    • <RhinosF1> enforce CI on bots-web repo --16:17, 3 July 2020 (UTC)
    • <MacFan4000> created icinga account for Voidwalker --15:57, 3 July 2020 (UTC)
    • <MacFan4000> created icinga accounts for Zppix and Reception123 (credentials sent via PM) --13:31, 3 July 2020 (UTC)
    • <MacFan4000> set metamta.default-address to noreply@miraheze.org --13:06, 3 July 2020 (UTC)

    2020-07-02

    • <RhinosF1> disabled root login --22:25, 2 July 2020 (UTC)
    • <RhinosF1> created 'reception' shell user with full sudo --22:22, 2 July 2020 (UTC)
    • <RhinosF1> "rhinosf1@100:/var/phabricator$ sudo bin/garbage set-policy --collector user.logs --days 27" so I never have to enforce GDPR on it --22:02, 2 July 2020 (UTC)
    • <RhinosF1> added 'void' shell account with sudo --21:52, 2 July 2020 (UTC)
    • <RhinosF1> added 'discordirc' service --21:37, 2 July 2020 (UTC)
    • <Zppix> create ssh account for zppix and setup ssh keys --16:08, 2 July 2020 (UTC)
    • <MacFan4000> add zppix to /etc/sudoers --15:57, 2 July 2020 (UTC)
    • <RhinosF1> created account 'rhinosf1' and gave sudo --13:01, 2 July 2020 (UTC)
    • <RhinosF1> reboot complete, worked fine - all services restored --10:39, 2 July 2020 (UTC)
    • <RhinosF1> reboot server to test reaction of icinga etc --10:37, 2 July 2020 (UTC)
    • <RhinosF1> registered nick MirahezeBot and made it ACCOUNTNAME --09:13, 2 July 2020 (UTC)

    2020-07-01

    • <RhinosF1> <macfan> setup icinga with no checks active --23:00, 1 July 2020 (UTC)
    • <RhinosF1> update github link --22:41, 1 July 2020 (UTC)
    • <MacFan4000> added macfan+void to bots@ and set redirect for mirahezebots@ phab gmai --16:31, 1 July 2020 (UTC)
    • <RhinosF1> <macfan> set phab to use var/phabstatic --15:36, 1 July 2020 (UTC)
    • <RhinosF1> phab back --15:27, 1 July 2020 (UTC)
    • <RhinosF1> phab down due to path switch --15:08, 1 July 2020 (UTC)
    • <MacFan4000> restart phd daemons --13:13, 1 July 2020 (UTC)
    • <RhinosF1> locked auth --13:07, 1 July 2020 (UTC)
    • <MacFan4000> UPDATE user SET isEmailVerified = 1 WHERE userName = 'Sario528'; --12:39, 1 July 2020 (UTC)
    • <RhinosF1> set meetbot to /var/www/public_html/meetbot/ --09:21, 1 July 2020 (UTC)
    • <RhinosF1> enabled phabricator.show-prototypes --09:03, 1 July 2020 (UTC)
    • <RhinosF1> synced database from -test and start --08:57, 1 July 2020 (UTC)
    • <RhinosF1> stopping for db migration --08:52, 1 July 2020 (UTC)
    • <RhinosF1> apt-get update && apt-get upgrade --08:42, 1 July 2020 (UTC)

    2020-06-30

    • <RhinosF1> set phab timezone to Europe/London --22:36, 30 June 2020 (UTC)
    • <Voidwalker> setup Void-bot for logging to this page from #miraheze-bots --22:35, 30 June 2020 (UTC)
    • <MacFan4000> phabricator set up --22:33, 30 June 2020 (UTC)
    • <RhinosF1> added all previous users to search console for new site and pushed index requests through --22:29, 30 June 2020 (UTC)
    • <Voidwalker> test --22:27, 30 June 2020 (UTC)
    • RhinosF1: test