Infrastructure issueshttps://gitlab.xiph.org/xiph/Infrastructure/-/issues2020-07-13T16:20:45Zhttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/2232mf5 requirements2020-07-13T16:20:45ZRalph Gilesmf5 requirements# Xiph.Org Service Requirements
With the failure of mf4, we have a decision to make about where we want to run our services.
Most essential things have been migrated to catfish. For remaining bits, please add to the list below and help...# Xiph.Org Service Requirements
With the failure of mf4, we have a decision to make about where we want to run our services.
Most essential things have been migrated to catfish. For remaining bits, please add to the list below and help prioritize.
Several options going forward
- re-install mf4 from scratch, have backups for when it fails again.
- Buy a replacement server (or several).
- Must have remote console support.
- osuosl prefers Dell PowerEdge.
- Use osuosl's openstack cluster.
- Redundant storage (but no geographical replication)
- Don't have to maintain underlying hosts.
- Can still contribute, probably by buying drives for the Ceph cluster.
The raid failure demonstrates we've not been doing a good job with administration. Whatever we do going forward, we need to make sure we have automated offsite backups and that it's much easier to configure and upgrade our various services, ideally from deployment templates stored in version control. We should periodically practice service migration and restoration.
## static sites 🔶
- Partially restored from git or older svn backup + archive.org.
- Served as static html or shtml from catfish.
- Working on auto-deployment from gitlab ci.
- Should move remaining sites from svn to git.
- media.xiph.org is served from beaufish, and wasn't affected.
## dynamic websites
- gitlab.xiph.org ✅
- vm already on catfish
- wiki.xiph.org ✅
- vm aleady on catfish
- dir.xiph.org ✅
- switched to beta vm on catfish
- awcy ✅
- vm already on catfish
- svn.xiph.org
- down, lost data
- ftp.osuosl.org has a current snapshot of releases and websites
- people.xiph.org ❌
- down, lost data.
- planet.xiph.org
- anyone still blogging?
- jenkins ❌
- down, lost data.
- should replace with gitlab-ci.
- munin ❌
- down, not high priority.
- Better replacements?
- review.xiph.org 🔶
- down, have a recent backup.
- not actively used: not planning to restore.
## releases 🔶
- downloads.xiph.org redirects from catfish to ftp.osuosl.org
- ftp site has current files.
- was backed by svn, lost recent history.
- restore svn and re-populate from ftp.osuosl.org?
- alternate: git? gitlab artifacts? Some other object store?
## shell server
- Several people used shell accounts on mf4.
- Do we need to keep providing this?
- Alternate: per-user containers? kubernetes?
## email ✅
- mail and lists already on a catfish vm.
## dns 🔶
- catfish temporarily authoritative
- Need another machine to be secondary
- alternate: Use registrar or osuosl.https://gitlab.xiph.org/xiph/Infrastructure/-/issues/2230Restore vorbis.com redirects2020-05-26T03:44:29ZRalph GilesRestore vorbis.com redirectsIIRC the vorbis.com website was full of obsolete information, so before the server crash we had it redirecting to xiph.org/vorbis. We should restore that.IIRC the vorbis.com website was full of obsolete information, so before the server crash we had it redirecting to xiph.org/vorbis. We should restore that.https://gitlab.xiph.org/xiph/Infrastructure/-/issues/2229re-create planet.xiph.org snippet2020-05-07T02:34:13ZRalph Gilesre-create planet.xiph.org snippet[xiph.org](https://www.xiph.org/) loads a teaser of recent links from planet.xiph.org. IIRC this was generated by some script connected to the planet website, and needs to be re-created now that mf4 is gone.[xiph.org](https://www.xiph.org/) loads a teaser of recent links from planet.xiph.org. IIRC this was generated by some script connected to the planet website, and needs to be re-created now that mf4 is gone.https://gitlab.xiph.org/xiph/Infrastructure/-/issues/52broken link in /about/2018-05-14T02:23:59ZJan Starybroken link in /about/The http://www.news.com.com/SpecialFeatures/0,5,34963,00.html link on
the About page http://xiph.org/about/ is broken, and it's not just
the ".com.com".
The http://www.news.com.com/SpecialFeatures/0,5,34963,00.html link on
the About page http://xiph.org/about/ is broken, and it's not just
the ".com.com".
Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/50accessability and usability flaw due to absolute sizing.2018-05-14T02:23:59ZGitlab Botaccessability and usability flaw due to absolute sizing.Fonts are given a fixed size which may be smaller than the user's size, which means it may be illegible or cause difficulty: as it does for me.Fonts are given a fixed size which may be smaller than the user's size, which means it may be illegible or cause difficulty: as it does for me.Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/45xiph.org's DefaultCharset clashes with Vorbis_I_spec.html2018-05-14T02:23:59ZKyungjoon Leexiph.org's DefaultCharset clashes with Vorbis_I_spec.htmlXiph.org's installation of Apache2 has `DefaultCharset` set to UTF-8, as can be seen from wget output:
```
--19:51:38-- http://www.xiph.org/ogg/vorbis/doc/Vorbis_I_spec.html
=> `Vorbis_I_spec.html'
Resolving www.xiph.org... ...Xiph.org's installation of Apache2 has `DefaultCharset` set to UTF-8, as can be seen from wget output:
```
--19:51:38-- http://www.xiph.org/ogg/vorbis/doc/Vorbis_I_spec.html
=> `Vorbis_I_spec.html'
Resolving www.xiph.org... 195.169.149.105, 140.211.166.32
Connecting to www.xiph.org[195.169.149.105]:80... connected.
HTTP request sent, awaiting response...
1 HTTP/1.1 200 OK
2 Date: Thu, 25 Aug 2005 11:05:42 GMT
3 Server: Apache/2.0.53 (Ubuntu) DAV/2 SVN/1.1.1 PHP/4.3.10-10ubuntu4
4 Accept-Ranges: bytes
5 Content-Length: 210963
6 Keep-Alive: timeout=15, max=100
7 Connection: Keep-Alive
8 Content-Type: text/html; charset=UTF-8
```
This can cause problems with characterset autodetection in web browsers, because the actual Vorbis_I_spec.html document is in ISO-8859-1, as follows:
```
<meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1">
```
----
Proposed fixes:
* Remove `DefaultCharset` directive from Apache2 configuration
* Convert Vorbis_I_spec.html to UTF-8.Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/41Mail search not functional2018-05-14T02:23:59ZKyungjoon LeeMail search not functional```
Searching the mail archives gives you raw perl code.
also, the new page at http://lists.xiph.org/mailman/listinfo doesn't allow
searching.
``````
Searching the mail archives gives you raw perl code.
also, the new page at http://lists.xiph.org/mailman/listinfo doesn't allow
searching.
```Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/36list archives need porting2018-05-14T02:23:59ZGhost Userlist archives need porting```
The list archives need to be ported to mailman.
We used to have a hand-rolled archiving script with majordomo lists. In the most
recent server move we reconstituted everything as mailman lists. Posts are now
quietly accumulating at ...```
The list archives need to be ported to mailman.
We used to have a hand-rolled archiving script with majordomo lists. In the most
recent server move we reconstituted everything as mailman lists. Posts are now
quietly accumulating at http://lists.xiph.org/pipermail/ but this is not linked
from the usual http://xiph.org/archives/ page.
There are several parts to this.
* an mbox version of all the old list archives needs to be generated so it can
be fed to mailman, so we have complete pipermail archives.
* We need markup, ideally css, to make the mailman archive pages look like the
rest of the xiph.org site/the old archive pages.
* We need to figure out how not break and references; i.e. keep old archive
pages at the same url; or symlink.
```Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/34Allow properly linked replies in the mail archives2018-05-14T02:24:00ZDavid BalazicAllow properly linked replies in the mail archives```
Currently , when viewing a message in the xiph web mail archive, for example
http://www.xiph.org/archives/advocacy/0491.html, there is a way to reply to the
author, by clickinf the link with his name at the top , by "From:".
This a...```
Currently , when viewing a message in the xiph web mail archive, for example
http://www.xiph.org/archives/advocacy/0491.html, there is a way to reply to the
author, by clickinf the link with his name at the top , by "From:".
This automatically fill in the right subject, but does not fill in the right In-
Reply-To field, so the mail is not properly linked to the original message.
Also I miss a link for replying to the mail list. Again a proper In-Reply-To
field should be used. Otherwise the message would not be put in the right
thread in the "thread" view.
Currently I construct manually an URL for replying, like :
mailto:someone@somewhere.org&Subject=Re:Something?In-Reply-
To=<some_id.xx.yy.zzz>
I get the proper id by viweing the HTML source.
```Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/27paypal donation link not working2018-05-14T02:24:00ZGitlab Botpaypal donation link not workingOnce you click on to donate, then log in to paypay, no information is saved. The donor must enter the information manually. I am sure you will lose some donations as it is just too much trouble. The donation process needs to be as simple...Once you click on to donate, then log in to paypay, no information is saved. The donor must enter the information manually. I am sure you will lose some donations as it is just too much trouble. The donation process needs to be as simple as possible.Gitlab BotGitlab Bothttps://gitlab.xiph.org/xiph/Infrastructure/-/issues/23dead link check2018-05-14T02:24:00ZJack Moffittdead link checkA dead link check needs to be performed for all sites, and those links need to
be fixed deleted. Is there an automated commandline tool that we can run
nightly on the server to do this?A dead link check needs to be performed for all sites, and those links need to
be fixed deleted. Is there an automated commandline tool that we can run
nightly on the server to do this?Gitlab BotGitlab Bot