Active Incident

Updated a few seconds ago

Incident Status

Operational

Components

Campus Services, Identity

Services

Techworks, SingleSignOn (SSO), Passport



September 18, 2020 2:29PM EDT
[Investigating] We are seeing slow two factor logins, and are investigating. This could show as a slow login that is successful, or as a login that works, but doesn't ask for a 2nd factor like it normally would.

Incident Status

Operational

Components

Enterprise Data Management

Services

LITE Reporting Portal, Reporting and Analytics Tools



September 18, 2020 9:26AM EDT
[Monitoring] Tableau prod is back up and running. We will continue to monitor the environment throughout the day.

September 18, 2020 9:06AM EDT
[Investigating] Our production Tableau environment is currently experiencing issues. EDM Systems Support is looking at it now and will report back shortly.

Incident Status

Degraded Performance

Components

GTPE

Services

Kaltura Video Service



September 10, 2020 11:14AM EDT
[Identified] Uploads and Transcoding--Users may experience upload errors or longer than expected upload times. Users may also experience longer than expected processing time to encode entries that have been successfully uploaded. The root cause has been identified and Kaltura engineers are working on the solution as a top priority. An update will be posted Thursday evening. This affects My Media, Media Gallery, and Kaltura Capture.

September 9, 2020 5:24PM EDT
[Identified] Users may experience longer than expected processing time to encode entries that have been successfully uploaded. The root cause has been identified and Kaltura engineers are working on the solution as a top priority. An update will be posted Thursday morning. This affects My Media, Media Gallery, and Kaltura Capture.

Incident Status

Operational

Components

VideoConferencing

Services

Microsoft Teams



September 14, 2020 11:41AM EDT
[Monitoring] We have received reports of degradation of features in Microsoft Teams. To date, this includes Microsoft Forms, Hand Raise, and Polly. Upon investigation and confirming with Microsoft, these issues appear to be limited to users who have enabled the "new meeting experience" (e.g. the Large Gallery and Together Mode). We have also confirmed the new meeting experience is currently still in "preview" and could cause other features to not work. While Microsoft is resolving these bugs as they receive them, we are asking: 1. If you find an issue, report a bug to Microsoft directly in Teams by pressing the Feedback button in the lower left corner. This goes straight to Microsoft's Support team. 2. Disable "new meeting experience" and restart Microsoft Teams. This will remove the Large Gallery and Together Mode until you re-enable that feature. (https://gatech.service-now.com/home?id=kb_article_view&sysparm_article=KB0025940) We will keep KB KB0026096 (https://gatech.service-now.com/home?id=kb_article_view&sysparm_article=KB0026096) updated with any new reported features that do not work if you do wish to keep the new experience enabled.

September 3, 2020 7:29PM EDT
[Monitoring] We have received reports of degradation of features in Microsoft Teams. To date, this includes Microsoft Forms, Hand Raise, and Polly. Upon investigation and confirming with Microsoft, these issues appear to be limited to users who have enabled the "new meeting experience" (e.g. the Large Gallery and Together Mode). We have also confirmed the new meeting experience is currently still in "preview" and could cause other features to not work. While Microsoft is resolving these bugs as they receive them, we are asking: 1. If you find an issue, report a bug to Microsoft directly in Teams by pressing the Feedback button in the lower left corner. This goes straight to Microsoft's Support team. 2. Disable "new meeting experience" and restart Microsoft Teams. This will remove the Large Gallery and Together Mode until you re-enable that feature. (https://gatech.service-now.com/home?id=kb_article_view&sysparm_article=KB0025940) We will keep KB KB0026096 (https://gatech.service-now.com/home?id=kb_article_view&sysparm_article=KB0026096) updated with any new reported features that do not work if you do wish to keep the new experience enabled.

Incident Status

Operational

Components

Network

Services

LAWN



September 9, 2020 1:14PM EDT
[Identified] Network Services has identified the cause of Google Chrome and Chromium-based application crashes to be a bug in the Chromium browser framework related to mDNS. mDNS device discovery is utilized for various functionalities in Chromium including discovery of Google Cast-enabled devices for purposes of screen sharing, media playback, and device control. The large number of devices advertising via mDNS on LAWN is triggering a bug in the browser framework which causes the crashes. As mentioned previously, a known temporary workaround for this issue is to completely quit Google Chrome and other Chromium-based applications then re-open them to resume browsing and other activities. Network Services is currently evaluating next steps towards resolving this issue. Further information will be provided as it becomes available.

September 2, 2020 1:48PM EDT
[Investigating] OIT Network Services is aware of issues affecting Google Chrome and Chromium-based applications (such as Microsoft Teams, Slack, Spotify, and others) on computers running macOS when connected to the eduroam wireless network. After being connected to the network for some time, users may experience a loss of network connectivity for some or all applications on their computer. Some users have reported success with restoring connectivity by restarting Google Chrome (or the Chromium-based applications), disconnecting and re-connecting to eduroam, or restarting their computer. The team is actively investigating this issue. Further updates will be provided as additional information becomes available.

Incident Status

Degraded Performance

Components

Web Hosting

Services

Plesk



September 3, 2020 10:03AM EDT
[Investigating] [Web Hosting - Plesk] We are still seeing some browser time outs from off campus for hosted sites. We are working with the WAF vendor to investigate and mitigate the issue.

September 1, 2020 8:08AM EDT
[Investigating] We continue to have reports and evidence that indicate there may be an issue with off campus access to sites hosted on Plesk service servers. If a customer is able to get on VPN or the GT network the issue is resolved. There is not an issue with the site or service but there is an issue with traffic making it from and to off campus browsers. This is intermittent.

Incident Status

Operational

Components

Campus Services

Services

Cable TV (GTCN)



July 25, 2020 9:35AM EDT
[Monitoring] Facilities has continued to work on the water main break but all work is not fully completed yet. As of 7/14 water was restored to Love MaRC MRDC CRC Fire Suppression As of 7/25 significant progress has been made but not fully completed.

July 14, 2020 12:20PM EDT
[Monitoring] As an update, the expected date of resolution for the water main break is now Friday 7/17/2020. In the interim, all IT services have not been affected by the water main break as a workaround was put in place when the event initially occurred.

July 4, 2020 9:07AM EDT
[Monitoring] As an update, the water main will not be fixed until sometime Monday 7/6 at the earliest. OIT has been able to function business as usual but will continue to monitor the water main break and respond accordingly if there are any problems.

June 29, 2020 10:53AM EDT
[Monitoring] As of Saturday ( 6/27) evening, the water main break was not fixed, but it was isolated. This meant that water pressure for campus was returned close to normal which in turn allowed OIT to restore HPC 's ( High Performance Computing ) services close to 100% with one research cluster still remaining off as of today, Monday 6/29. These services had been proactively shut down in order to reduce the amount of cooling needed to support the datacenters and all of OIT services. HPC's service restoration was done on Sunday 6/28 starting at 0900 in the morning and completed as of noon that day. OIT was also able to return CATV back to normal service as well on Saturday 6/27. No IT services other than HPC and CATV were affected by the water main break. This includes but is not limited to mail, Canvas, www.gatech.edu, Banner, enterprise backups, Endpoint, Vlab, and Buzzport, All of these services remained functional and are still functional. The BCDC and Coda datacenters were not affected either. Going forward, the water main break is expected to be fixed on Friday, July 3rd during the holiday weekend. OIT will continue to monitor our datacenter temperatures 24x7 and respond accordingly as needed. If you have questions, please submit a ticket here https://gatech.service-now.com/technology?id=sc_cat_item&sys_id=360bf344db574050391b9837db9619a0&sysparm_category=05009bc4db934050391b9837db961957 and select Datacenters for the service you are having an issue with Or you may call 404-894-4669 to reach OIT Datacenter Operations

June 27, 2020 6:13PM EDT
[Identified] Around 1400 today, there was a major water main break at the intersection of Hemphill and Ferst Dr. near the MaRC Building. This caused a significant amount of flooding for the area and threatened damage to buildings in the immediate vicinity such as Center St., the Baker building, and other buildings that are close by. GTPD and Facilities responded immediately and began working with Atlanta Watershed to address the situation. So, far no major services have been affected other than HPC and CATV. OIT in an effort to proactively avoid the loss of any IT services has shut down a significant portion of the HPC ( High Performance Compute ) load in Rich as well as most of CATV. This was done to reduce the amount of cooling required to support IT services in an effort to lessen the demand on the campus cooling supply ( campus loop ). While HPC is down, many research jobs will not run and access to existing research will not be available. We apologize for the inconvenience and are working to avoid any further loss of services. Other IT services have remained up such as Office365 and mail, the Campus Network, www.gatech.edu, Buzzport, Oscar, Banner, Financials, vCenter, Vlab, enterprise networking, enterprise backups , Passport, Identity Management, storage, and others have all remained in service. If you have questions or concerns please call 404-894-4669 or file a ticket via https://gatech.service-now.com/technology?id=sc_cat_item&sys_id=360bf344db574050391b9837db9619a0&sysparm_category=05009bc4db934050391b9837db961957 and select "Data Centers" for the Service

Academic Services

Operational

Campus Services

Operational

Campus Services - ITG

Operational

Campus Audio Visual Services

Operational

Email and Calendaring

Operational

Identity

Operational

Network

Operational

Web Hosting

Operational

Enterprise Data Management

Operational

IT Service Management

Operational

VideoConferencing

Operational

GTPE

Degraded Performance

Cloud Storage

Operational

External Services

Scheduled Maintenance

Schedule

September 19, 2020 7:00PM - 9:00PM EDT

Components

Network

Services

VPN

Description

In a continuing effort to improve the stability of this service, we will be moving the GlobalProtect VPN Portal, vpn.gatech.edu, to different equipment. During this maintenance window, the portal will be unavailable for approximately 15 minutes. Existing connections to the clientless portal will be dropped and no new connections to the clientless portal nor with the GlobalProtect VPN Client will be available. Existing VPN Client connections will not be affected.

Welcome to Georgia Tech's IT Service Status Page Don't see your issue posted here? Let us know! Enterprise Service Desk Email: support@oit.gatech.edu Phone: 404-385-5555 Location: Atlanta Campus, Clough Building Room 215