Partial System Outage

About This Site

Welcome to Georgia Tech's OIT Service Status Page

Don't see your issue posted here? Let us know!


Technology Support Center
Email: support@oit.gatech.edu
Phone: 404-894-7173
Location: Clough Building Room 215

Academic Services Operational
Banner and Oscar   ? Operational
Buzzport   ? Operational
PACE   ? Operational
T-square   ? Operational
DMI   ? Operational
VLAB   Operational
Campus Services Major Outage
Dropbox   Operational
EMS/GT Events   ? Operational
Enterprise Backup   Operational
Enterprise Storage   Operational
GitHub Enterprise   Major Outage
GT Reports   ? Operational
LANDesk   ? Operational
OMSCS   ? Operational
OneDrive for Business   Operational
Print & Copy   ? Operational
SCCM   ? Operational
Service Desk   ? Operational
SharePoint   Operational
Skype for Business   Operational
Software Distribution   ? Operational
Techworks   ? Operational
Virtual Server Hosting   Operational
ctr.gatech.edu   Operational
Email Operational
Mailing Lists   ? Operational
Office 365 Outlook   Operational
Identity Operational
GTED   ? Operational
Login   ? Operational
Passport   ? Operational
Network Operational
BigIP and GTM   ? Operational
Campus Network   ? Operational
DHCP   ? Operational
DNS   ? Operational
Firewall   ? Operational
LAWN   ? Operational
Resnet   ? Operational
Telecommunications   ? Operational
VPN   ? Operational
Web Hosting   ? Operational
Other   ? Operational
Campus Services - ITG ? Operational
BuzzCard - 3rd Party Retail Merchants   Operational
BuzzCard - Card Production   Operational
BuzzCard - Copier Readers   Operational
BuzzCard - Laundry Readers   Operational
BuzzCard - Online Deposits   Operational
BuzzCard - Pay for Print   Operational
BuzzCard - SmartPark   Operational
BuzzCard - Value Transfer Stations   Operational
BuzzCard - Vending Readers   Operational
Door Access - Andover   Operational
Door Access - Avilgilon   Operational
Door Access - Blackboard   Operational
Door Access - Doorman   Operational
Door Access - S2   Operational
Door Access - Middleman   Operational
Point of Sale - Athletics (Sequoia)   Operational
Point of Sale - Campus (Sequoia)   Operational
ITG Data Integrations   Operational
ITG Sharepoint Websites   Operational
ITG Virtual Machines   Operational
Meal plan Signups   Operational
Vendor Profile   Operational
Timeout   ? Operational
EDM ? Operational
Tableau   ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Scheduled Maintenance
The Backbone team has scheduled an emergency maintenance reboot of the North Interconnect router that will affect network connectivity to a number of buildings in the North side of campus.

WHEN IS IT HAPPENING?
The router in the North Interconnect will be rebooted at 10:00PM on Saturday, November 18. Since the appliance has experienced persistently high CPU loads, posing a risk of imminent network outages in buildings on the North side of the main campus, the vendor has recommended that the router be rebooted, which will cause a 20-minute loss of network connectivity in the buildings listed below.

WHO IS AFFECTED BY THIS INTERRUPTION?
Tenants of the following buildings: 500 Tech Pkwy, 505 10th St., 575 14th St., 711 Marietta St., Aware Home, AWPL, Beringause, Biltmore, BME, Brock, Bunger-Henry, Caddell, CCB, Chemistry Annex, Cherry Emerson, Coliseum, Couch, CRB, EBB, Facilities, GCATT, Howey Physics, IBB, IPST, King, Klaus, MARC, Mason, MiRC, MRDC, MSE, Nano, O’Keefe, President’s House, SAC/CRC, SEB, Softball Complex, Student Health Center, Tennis Center, Van Leer.

Also, functionality of the following parking gates will be affected: Center St., North Deck, Howey, 10th & Home, North Deck meter, North Parking Deck.

WHAT DO YOU NEED TO DO?
Nothing. Connectivity will be reestablished once the router is completely rebooted.

WHAT IF YOU HAVE QUESTIONS?
If you have any questions concerning this maintenance please send e-mail to support@oit.gatech.edu or call 404-894-7173.
Posted on Nov 17, 18:48 EST
Past Incidents
Nov 22, 2017

No incidents reported today.

Nov 21, 2017

No incidents reported.

Nov 20, 2017
Completed - Maintenance is complete, and the Vendor Profile application is back online.
Nov 20, 16:17 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 20, 15:30 EST
Scheduled - The Vendor Profile Application could experience up to 30 minutes of downtime as we complete regular maintenance.
Nov 20, 13:26 EST
Nov 19, 2017

No incidents reported.

Nov 18, 2017
Completed - T-Square - The Maintenance is complete. Spring 2018 Course sites and Instructor load is complete. The service is returned to a normal production state.
Nov 18, 16:34 EST
Update - T-Square - Course load ran until 3:17 - Instructor load is now underway and should take 1.5 - 2 hours.
Nov 18, 15:34 EST
Update - T-Square - The work to remove the instructor and course load from the Spring 2018 Term in T-Square is complete. Courses are now being reloaded. Course load should complete by 2 pm - instructor load by 3:30 pm.
Nov 18, 12:08 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 18, 06:00 EST
Scheduled - T-Square - We have planned a maintenance widow for this service.

Work Being Done:
[Note: This work will not affect access to T-Square. Only faculty access to Spring 2018 term work sites will be affected]
This week, we discovered a significant nonrecoverable issue in T-Square that resulted in all Spring 2018 courses needing to be reloaded. Please do not begin building your Spring 2018 course shell or continue development on your course. We have tested the fix for this issue and plan to execute it on Nov 18th starting at 6am. The majority of the content will be still be in place and not be removed. If you are still missing content or courses on Nov 19th, please email tsquare@gatech.edu and we will assist you. We apologize for this issue and thank you for your patience in this matter. If you need any assistance with T-Square, please send your request to tsquare@gatech.edu.

If you wish to migrate to Canvas, Spring 2018 courses have been created successfully and you are welcome to work on your Spring course now. For more Canvas information, please go to http://canvas.gatech.edu/.

Thank You
Office of Information Technology
Nov 17, 20:18 EST
Nov 17, 2017

No incidents reported.

Nov 16, 2017
Resolved - The LAWN team was able to get all affected access points back up and working by 1200 on 11/16.
Nov 16, 12:02 EST
Identified - The LAWN team has found a solution to the outage and is working on restoring service to the access points in Resnet.
Nov 16, 11:15 EST
Investigating - Resnet Housing is currently experiencing a LAWN outage. The LAWN team is working to resolve the issue.
Nov 16, 10:50 EST
Nov 15, 2017

No incidents reported.

Nov 14, 2017

No incidents reported.

Nov 13, 2017
Completed - The scheduled maintenance has been completed.
Nov 13, 08:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 10, 17:00 EST
Scheduled - WHAT IS HAPPENING?
The Banner production (BPROD) database supporting Banner/Oscar/Imaging and integrated Student Information Systems will be unavailable in order to perform system upgrades and database patching.

WHEN IS IT HAPPENING?
The maintenance will occur between the following days and times:
From: Friday, November 10th, 05:00 PM
To: Monday, November 13th, 08:00 AM

WHO IS AFFECTED BY THIS INTERRUPTION?
All Banner services will be affected as well as any integrated service.

WHAT DO YOU NEED TO DO?
OIT will notify selected functional users for acceptance testing on Sunday, November 12th.

WHAT IF YOU HAVE QUESTIONS?
If you have any questions concerning this maintenance please send e-mail to support@oit.gatech.edu or call 404-894-7173.
Nov 9, 02:28 EST
Resolved - This incident has been resolved.
Nov 13, 06:12 EST
Monitoring - T-Square experienced an unscheduled outage for some users at 2020 this evening, 11/12 due to a load balancer issue. OIT has restored service as of 2220 but some users may still see an issue later on. Many users are still able to use the service, and OIT is monitoring the situation. If you have issues or concerns, please send e-mail to support@oit.gatech.edu or call 404-894-7173.
Nov 12, 23:42 EST
Nov 11, 2017

No incidents reported.

Nov 9, 2017
Resolved - Microsoft has marked the issue resolved. If you are still experiencing any of these symptoms, please let us know.

Status: Service restored

User impact: Users may have experienced issues while using Outlook on the web.

More info: Users may have encountered one or more of the following symptoms:
- Opening up a new Reply message resulted in a blank page/pane
- Opening a new message resulted in a wheel while searching for a contact
- Contacts may have not have been displayed
- The reading pane may have not been displayed

While we were focused on remediation, users may have been able to access the service or content using the Outlook client as an alternative method.

Final status: We've reverted the update and confirmed that impact has been remediated.

Scope of impact: This issue could have potentially affected any of your users if they were routed through the affected infrastructure.

Preliminary root cause: A recent update intended to improve data collection introduced a code issue that caused issues while using Outlook on the web.

Next steps:
- We're reviewing our update procedures to better identify similar issues during our development and testing cycles.
- We're reviewing our monitoring services to look for ways to reduce detection time and more quickly restore service.

This is the final update for the event.
Nov 9, 05:13 EST
Monitoring - Microsoft has published an update.

Status: Restoring service

User impact: Users may experience issues while using Outlook on the web.

More info: This is an incremental update to provide the latest status on the issue.

Current status: We have reverted the update for approximately 50 percent of the affected infrastructure. While we continue this process, users may begin to access Outlook on the web as expected.

Prior Status: We've identified that a recent update may have potentially caused the issue, and we're reverting the update in an effort to restore service. We're anticipating that the reversion should complete within the next 60 to 90 minutes; however, we're also investigating other mitigation options to expedite service restoration.


Georgia Tech will continue to monitor and post updates as we receive them.
Nov 8, 21:27 EST
Identified - We have received reports of Office 365 mail problems with OWA and some instances Outlook. Microsoft has published an incident:

Status: Investigating
User impact: Users may experience issues while using Outlook on the web.

Title: Outlook on the web email messaging issue

User Impact: Users may be unable to view, create, or reply to email messages from within Outlook on the web.

More info: Users may encounter one or more of the following symptoms:
- Opening up a new Reply message results in a blank page/pane
- Opening a new message results in a wheel while searching for a contact
- Contacts may not be displayed
- The reading pane may not be displayed

While we're focused on remediation, users may be able to access the service or content using the Outlook client as an alternative method.

Current status: We're analyzing system logs, network traces, and recent updates to determine the source of the issue.

Scope of impact: This issue could potentially affect any of your users if they are routed through the affected infrastructure.
Nov 8, 18:05 EST