Skip to content

News from the staff team

Web server replaced

Web serving or: How We Learned to Stop Worrying and Love Debian

The OCF web server, which hosts http://www.ocf.berkeley.edu and hundreds of virtual hosts for group accounts, was migrated over to our newest (and fastest) server running Debian GNU/Linux on June 9.

The Good

Websites, especially with dynamic content, should be loaded (much) faster. Features might be added later down the road.

The Bad

This is possibly our most visible non-lab-related (intentional) change in the past few years, and when that happens, stuff tends to break. We made the change over summer to allow us the most time to fix things with minimal disruption, and before we are moved out of the basement of Eshleman Hall (sometime during or after August).

The Ugly

It might take us a while to fix things. Contact us if something doesn't work that worked before.

Known unresolved issues

Troubleshooting

  • Are your CGI scripts returning an "Internal Server Error"? Some users have hard coded the path to old Perl or Python interpreters. We recommend changing the first line of these scripts to "#!/usr/bin/env perl" or "#!/usr/bin/env python", respectively.
  • Does your CGI script or binary depend on a particular architecture? If so, it may need to be compiled again for amd64 (Debian squeeze).

Emergency maintenance of login server (ssh.ocf, tsunami)

Due to unforeseen issues with the server, we are taking it down for emergency maintenance. We will update you as progress happens. We apologize for the inconvenience.

Update 4:30 PM: The maintenance has been completed successfully. Thank you for you patience.

MySQL migration

MySQL is being migrated to a new server. All MySQL databases will be locked to prevent editing while the migration is happening. However, all data will still be in read-only mode. Once the migration is done, we will post an update. Thank you for your patience.

Update 7:15 AM: The migration has been completed successfully.

RAID Failure tonight

Hello OCF Users,

Tonight our back-end file server had a RAID failure that initially looked like full swap space.  We hard-rebooted after a few minutes wait for the server to reboot itself.

It's lucky that this RAID failure took place during off hours so we can begin maintenance immediately.  Expect a post again when the RAID issues are fully resolved.

Update March 11: This RAID failure was on a drive that did not have user data on it. There are no problems at all. Sorry for the delayed post. This problem was solved the same day as the RAID failure.

Web Server Downtime

Tonight, the web server ran out of swap space and is currently experiencing downtime.

Since there are updates pending on the server, rebooting it runs the risk of it not booting up properly afterwards.

Work on the (much more powerful) virtual machine that will become the new web server began a week ago, and staff will meet this Saturday to finish it.

Update Jan 26 8pm: Fixed, but there may be downtime on Saturday as web hosting is migrated to a new server.

Intermittent downtime for maintenance

On December 16, we rewired parts of our network between 5pm and 7pm, resulting in intermittent unavailability for OCF services. We believe that the end of the semester would be a less intrusive time to make changes, especially since the lab is closed until spring semester.

OCF, as with other student groups in Eshleman Hall, will be moved out of the building in August before it is demolished as part of Bears Initiative. We are aggressively consolidating our hardware (reducing the number of physical servers), since space for our hardware after the move will be limited, and working to prevent these changes from having an adverse effect on performance and reliability. We apologize for the inconvenience.

See also: Lab and printing services uncertain after Spring 2012

Lab and printing services uncertain after Spring 2012

Dilbert.com



From: OCF announcements
To: All OCF members
Subject: OCF lab and printing ending after Spring 2012
Date: Wed, Dec 7, 2011 01:31p PST

Hello OCF members,

Last night OCF's volunteer staff unanimously decided to close lab services, including free printing, after Spring 2012.

OCF, as with other student groups in Eshleman Hall, will be moved out of the building in August before it is demolished as part of Bears Initiative. Until new space is obtained elsewhere on campus, we have been allocated temporary space in Hearst Gymnasium basement for the duration of Lower Sproul construction, which is projected to last for at least 3 years.

This area is limited both in space and technical resources, and we feel that it would be a disservice to all OCF members to provide an unreliable and inadequate level of service, in both quality and quantity. We would not be able to fit much of our computing and printing equipment into the space allotted to us, and time constraints limit what can be set up before the fall semester begins.

We understand and share your concern for the OCF. We too are students and members of the OCF. This is a drastic change for the organization, which has had a lab since 1989.

We want to restore the lab and its services as soon as possible, but we must also keep in mind the process of our last two moves (to Heller Lounge in the MLK Student Union, and to our present location in Eshleman). It would be dishonest if we were not to give notice of lab downtime, which has been unavoidable and
excessive during each move. Furthermore, the compressed space and needs of other student groups constrain us more than in the past.

We hope that by shifting resources, we will be able to compensate by expanding our other services, including currently web hosting, disk space, email, and shell accounts, and ensure that they would not be disrupted by a move as they have been before. We are looking at our options for negotiating server space and we will continue hosting websites, including those of student groups. We will better assist other students and student groups as a technical resource given our close proximity in the temporary space, and encourage you to make use of what we would be able to offer.

We will be considering all options, including other space if available, and appreciate any feedback or advice you can offer. We don't want to let you down...

Good luck on finals guys,
OCF staff members,
Eshleman basement

P.S. One of the printers is broken, so printing might be slower than we'd hope, but please, enjoy our lab while it lasts. 9am-9pm hours during dead week and finals, see our website for more info.

You have received this announcement to update you about important changes to the OCF. The Open Computing Facility is an all-volunteer student organization providing free shell accounts, disk space, web hosting, email, and printing from a lab, lounge, and server room in Eshelman Hall.

Update Dec 8: Daily Cal has published an article: Computing facility in Eshleman Hall to close after next semesterUpdate Dec 17: To clarify, OCF is not going away, but staff felt that, given our constraints, it would not be possible to guarantee a public lab next fall, and misleading if we did not inform members. The post's title has been updated to reflect that lab and printing services are uncertain, since no decision is made in stone, and the constraints which led to our decision can (and hopefully will) change. Sorry about the confusion.Two years ago OCF completed its 15-month move from Heller Lounge in MLK to the larger space in Eshleman, with excessive lab and server downtime (caused in part by the discovery of asbestos and later a failed pump flooding the new lab, then a pipe burst dropping raw sewage, then a network and later power outage which was prolonged). The current move leaves us two weeks (Aug 1 to Aug 15) to move and bring the lab up in a much smaller space before the semester begins. That also includes getting rid of desktops, servers, and equipment that would not fit in the space, since Moore's Law makes the storage of aging computer hardware uneconomical.We also hoped that by not committing ourselves to the lab immediately, we would leave ourselves time to ensure that non-lab services, like web hosting, would not be disrupted by the move. During the last move our web hosting, used by many student groups, was down for several months, and the complaints were not pretty. To this day we hear about OCF "unreliability" based on that downtime.And lastly, we have every intent to restore our lab when it is possible and when we have the logistics of the space worked out. To quote an ex-staff member: "The group's choice to focus on back-end makes a lot of sense given the uncertainty with construction and space."And yes, this makes us very unhappy.













Networking maintenance downtime

Downtime is scheduled between 8pm and midnight tonight.

Update 4:00am


We replaced some wiring and networking equipment between 11:30pm and 01:15am. Most services were only briefly affected. Web, mail, SSH, and dependent services were temporarily moved to another switch during the rewiring.

We thank a generous donor for two new gigabit switches.

Networking maintenance

There will be one day of downtime during the days of November 18-20 for networking maintenance. The anticipated downtime should be much less than one day. The exact date will be confirmed as the day approaches.