I recently wrote about the two day outage of our wiki and issue tracker: While this was a rather lengthy outage, it could have been much worse. We lost none of the data, after all. OSUOSL have since published their post mortem. I was really wrong about not losing any data: A further complication was that our backups were pointed at mysql2, which was out-of-date with mysql1,...

As you may have noticed, our wiki and issue tracker were unavailable from Thursday to Sunday last week. What happened? We host parts of our infrastructure at the Open Source Lab at Oregon State (OSUOSL), including the databases for these two services. So far, there’s no post mortem by OSUOSL (they expect to post one later this week), so we need to piece together what...

In continuing my infra upgrade work, this weekend I’ll be migrating JIRA to another server. This will make upgrade more manageable and testable. The service will be disrupted for a few hours. Check out our @jenkinsci on Twitter for up-to-the-minute status. Once the migration is done, the next step is to upgrade them....

+ For the past few weeks, I’ve burnt a lot of midnight oil to get Confluence containerized. The goal is to make Confluence upgrade more manageable and testable. In the process, I’ve not only containerized Confluence, but also containerized some other services, including mock LDAP server, to be able to test the copy of the production Confluence dataset against newer versions of Confluence before upgrading...

As the Jenkins project grows, the need for our infrastructure has been growing. Our Jenkins-on-Jenkins needs more build agents, we need more servers to run our infrastructure services. And it was once again Rackspace who stepped up to the plate; they have kindly donated us more cloud servers. I also use Rackspace for one of my personal servers, and when I went back to their...

We are looking for volunteers to join the small infra team here at the Jenkins project. We are the butlers of the butler that get Mr.Jenkins going. We’ve been managing our servers through puppet, and have been slowly folding pieces one at a time to puppet, but there’s still a lot of snowflake services that need proper operationalization. So to fix them up, PuppetLabs folks generously...

As reported in various places, there was an incident in early November where commits in our Git repositories have become misplaced temporarily by accident. By the mid next week we were able to resurrect all the commits and things are back to normal now. As there are many confusions and misunderstandings in people’s commentary, we wrote this post to clarify what exactly happened and what...

In the hope of streamlining account creation e-mail delivery and mailing list moderations, I have deployed SPF and DKIM over the weekend for e-mails coming out of @jenkins-ci.org, which includes account appliations, Confluence, and JIRA. I’ve also used this opportunity to switch back the sender of JIRA notifications to noreply@jenkins-ci.org. It was originally this way, then changed to jenkinsci-no-reply@googlegroups.com when someone complained (on what ground...

I’ve tweaked the website so that downloading the Windows and Mac installers will navigate the browser to "thank you/what’s next" page. These pages have links to Wiki that educate the users on where/how the installer will run Jenkins. Hopefully this makes it little easier for new users to get started on Jenkins. I’ve tested the new mechanism with IE, Safari, and Firefox, but if you...

Thanks to the kindness from Gliffy, we can now add diagrams to Wiki pages, in a way that enables collaborative edits. See more info, including a sample diagram in a Wiki page....