Interactive Learning Center Diliman

ILC Diliman

Announcement

We would like to provide an update regarding the ongoing service interruption affecting UVLe ’22. For transparency, here is a timeline of events and diagnosis so far.

Last Friday, we received reports from users and observed that UVLe ’22 had become unavailable. Upon investigation, our team identified that one of the servers supporting the platform is currently turned off. After a thorough investigation, it was due to an issue affecting its RAID controller. The RAID controller is a critical hardware component responsible for managing communication and access between the server and its storage drives. As a result of its degraded condition, system availability is significantly affected.

As part of our immediate response efforts, we conducted some quick response measures that would have possibly fixed the issue last Saturday, including reseating the RAID controller into an alternative PCIe slot, in case it was a slot error, as well as cold booting the server in case the raid controller had failed some initialization steps due to a stuck process. However, these measures did not resolve the issue. Based on our current technical assessment, replacing the RAID controller with an identical model is expected to preserve the integrity of the existing data. Nevertheless, replacement, validation, and recovery activities may require approximately two weeks to complete. Do note that there might be some further interruptions in other services hosted in the OVCAA servers as we try to get a similar RAID controller from a different server, as procurement is not a feasible option in the short term.

Our technical team continues to work diligently to restore services at the earliest possible opportunity. However, do expect that some files would be inaccessible as we are only running a backup of the storage. The backup has some of the files in it, but there have been some sync issues over the past few months that went unnoticed. Unfortunately, the other storage backup is on the same server, which was only meant as a means to optimize data transfer rates.

In the meantime, we are evaluating all feasible recovery paths and contingency measures to accelerate restoration efforts while maintaining data integrity.

What to do in before full restoration:
For those who have not yet finished grading, the preliminary restoration will not include the files submitted by your students, but the record of their submission as well as when they submitted would be included in the restored version. We hope that you could request your students to submit the work again. The quizzes and other activities that do not require file submission will also be in the restored version.
 

For those who would want new courses, the UVLe ‘26 is in a different set of servers will be online within the week. We already had plans to open it this week but is pushed back due to the current circumstances.

We know how important UVLe is to you every single day, and we are so truly sorry for how much this disruption is messing up your classes and schedules. Our team is working as hard and as fast as we can to get everything fixed and fully running again.

Your patience and understanding right now mean everything to us. We are doing everything we can to get UVLe back to normal so you can get back to your work without any more stress.

– ILC Diliman Team