Oct 5, 16:24:45 GMT+0
Identified -
We have identified the problem and will have a fix in place very shortly..
Oct 5, 16:56:37 GMT+0
Identified -
We are still working on the fix which is taking a bit longer than we anticipated..
Oct 5, 17:07:33 GMT+0
Monitoring -
The fix is in place and we are currently monitoring..
Oct 5, 18:49:13 GMT+0
Resolved -
Systems have been working fine for nearly 2 hours so this incident is now marked resolved..
Jun 29, 16:58:34 GMT+0
Investigating -
We are currently investigating this incident..
Jun 29, 17:08:05 GMT+0
Resolved -
This incident has been resolved..
May 28, 04:00:00 GMT+0
Identified -
We are planning for a scheduled maintenance during that time..
May 28, 04:00:01 GMT+0
Identified -
Maintenance is now in progress.
May 28, 06:03:19 GMT+0
Completed -
Maintenance has completed successfully..
May 27, 17:09:15 GMT+0
Investigating -
We are restarting some services and expect the API to be fully down for a few minutes..
May 27, 17:30:33 GMT+0
Resolved -
This incident has been resolved..
Apr 2, 13:44:23 GMT+0
Investigating -
This only affects the legacy SS API (the new API is working well). The fix we had put in place for the legacy SS API last week is working, but has apparently increased the need for system resources so we are increasing server instances and monitoring as they come online. .
Apr 2, 14:16:40 GMT+0
Monitoring -
The extra servers are helping and the API is usually responding, but performance is still poor as we are in the heaviest of Sunday morning load. Once again, this only impacts the legacy SS API, and the new API is performing well. Customers may download resources directly from SongSelect or upgrade partner software if it yet supports the new API..
Apr 2, 14:26:07 GMT+0
Resolved -
This incident appears to be resolved..
Mar 31, 10:36:33 GMT+0
Resolved -
We are considering this incident resolved. However, we will continue to monitor closely; especially Sunday under heavy load. .
Mar 26, 14:28:05 GMT+0
Monitoring -
This ONLY affects partners on our legacy SongSelect API. A known issue started last Monday with our infrastructure for our legacy SongSelect API which is failing. Services are automatically restarted when they go down, but this solution can fail entirely under heavy load. We continue to anticipate partial outages, but we are working on a complete fix which we hope to deploy Tuesday Mar 28. Users can always go direct to SongSelect to download their resources, and then import them to partner software. Or, if a partner software upgrade is available that uses the new CCLI API, then customers can upgrade to bypass the problem entirely..
Mar 28, 15:25:04 GMT+0
Monitoring -
Within the next few hours, we will be deploying a fix to the legacy SongSelect API and then will update this status. This will resolve the partial outages that have occurred over the past week. This fix was extensive and we have worked diligently to minimize the chances of negatively impacting partner software..
Mar 28, 18:30:00 GMT+0
Monitoring -
We have deployed a fix to the legacy SongSelect API. This appears to have resolved the partial outages that have occurred over the past week. We will be closely monitoring. This fix was extensive and we have worked diligently to minimize the chances of impacting partner software. For partners, if you believe this is causing a breaking change in your software, please email details to partner@ccli.com. Once again, this only affects our legacy SongSelect API which is being retired soon, and customers can always go directly to SongSelect to download CCLI resources until partner software fully supports our new API.
.
Mar 20, 15:45:00 GMT+0
Investigating -
We are currently investigating this incident. This ONLY affects the legacy SongSelect API. For partners who have converted over to our new API, there are no issues..
Mar 20, 21:31:34 GMT+0
Identified -
This is a stubborn issue, and we are continuing to work on a fix for this incident. Again, this only impacts the legacy SongSelect API so if you are on our newer API you are not affected by this outage. We are hoping to have a temporary fix in place by end-of-day today so it will be up and working..
Mar 21, 02:22:29 GMT+0
Monitoring -
We implemented a fix and are currently monitoring the result..
Mar 21, 04:16:33 GMT+0
Resolved -
This incident has been resolved..
Mar 16, 11:51:44 GMT+0
Identified -
Some of our systems are intermittently returning errors. Our cloud service, Microsoft Azure, is reporting that they have identified an issue and are working on a hotfix to resolve it..
Mar 16, 12:00:49 GMT+0
Monitoring -
Microsoft is working on the issue with their Azure cloud service. The problem appear to have stopped and CCLI systems appear to be working again. We will continue to monitor..
Mar 16, 12:06:56 GMT+0
Resolved -
This incident appears to have been resolved by Microsoft and CCLI solutions are operational..
Feb 26, 23:10:00 GMT+0
Investigating -
We are aware of the problem and implementing a solution now..
Feb 26, 23:23:47 GMT+0
Monitoring -
We implemented a fix and are currently monitoring the result..
Feb 26, 23:30:49 GMT+0
Resolved -
This incident has been resolved..
Feb 12, 15:10:45 GMT+0
Investigating -
We are currently investigating this incident..
Feb 12, 15:26:58 GMT+0
Monitoring -
We implemented a fix and currently monitoring the result..
Feb 12, 15:56:30 GMT+0
Resolved -
We just resolved the issue!.
Jan 29, 23:10:00 GMT+0
Investigating -
We are currently investigating this incident..
Jan 30, 00:26:53 GMT+0
Monitoring -
We implemented a fix and currently monitoring the result..
Jan 30, 00:32:49 GMT+0
Resolved -
We are considering the issue resolved!.
Dec 4, 15:52:00 GMT+0
Investigating -
We are currently investigating this incident..
Dec 4, 16:10:08 GMT+0
Monitoring -
We implemented a fix and currently monitoring the result..
Dec 4, 16:21:02 GMT+0
Resolved -
The issue is resolved..
Dec 15, 15:40:00 GMT+0
Monitoring -
Amazon Web Services (AWS) has reported a problem serving the West Coast, and this is impacting some CCLI applications. We are monitoring and awaiting AWS to respond..
Dec 15, 16:02:52 GMT+0
Resolved -
AWS resolved their issue and SongSelect is back up..
Dec 8, 00:00:00 GMT+0
Investigating -
We are currently investigating this incident..
Dec 8, 00:30:00 GMT+0
Resolved -
AWS platform has had reported problems today, and this may have impacted the SongSelect API. However, the API appears to be working normally again..
Jul 29, 21:35:13 GMT+0
Investigating -
We are currently investigating this incident..
Jul 29, 23:37:10 GMT+0
Identified -
We have identified the problem and are working on a fix for this incident..
Jul 30, 00:01:05 GMT+0
Monitoring -
We implemented a fix and currently monitoring the result..
Jul 30, 00:54:15 GMT+0
Resolved -
Monitoring has shown no more problems. The issue appears to be resolved..
Apr 25, 13:39:10 GMT+0
Investigating -
We are currently investigating this incident..
Apr 25, 13:52:45 GMT+0
Monitoring -
We implemented a fix about 10 minutes ago and and are currently monitoring the result. The API is returning to normal response times..
Apr 25, 14:12:18 GMT+0
Resolved -
The issue appears to be resolved, but we will continue to monitor on further into the morning..
Apr 25, 14:31:38 GMT+0
Investigating -
We are still seeing problems and are investigating further. SongSelect is running fine, so customers can download what they need directly from SongSelect until the API issue is resolved..
Apr 25, 15:46:23 GMT+0
Resolved -
The SongSelect API is operating normally..
Apr 18, 13:57:27 GMT+0
Investigating -
We are currently investigating this incident..
Apr 18, 14:41:49 GMT+0
Monitoring -
We have added more servers and the problems are diminishing. We are continuing to monitor closely. If customers are continuing to have issues downloading information through the API, the SongSelect application is working fine and songs can be downloaded from there..
Apr 18, 15:01:57 GMT+0
Resolved -
The issues are resolved and the platform is responding normally..
Apr 11, 13:20:00 GMT+0
Investigating -
We are currently investigating this incident..
Apr 11, 15:20:00 GMT+0
Resolved -
The issue is resolved and the SongSelect API is responding to requests normally..
Jan 21, 14:48:52 GMT+0
Investigating -
We are currently investigating this incident..
Jan 21, 15:02:16 GMT+0
Identified -
We are continuing to work on a fix for this incident..
Jan 21, 15:24:00 GMT+0
Monitoring -
We implemented a fix and are currently monitoring the result..
Jan 21, 15:30:00 GMT+0
Resolved -
We have been monitoring, and are considering this issue resolved..
Oct 22, 18:42:09 GMT+0
Investigating -
We are investigating this incident..
Oct 22, 18:48:15 GMT+0
Resolved -
We are considering the issue resolved..
Oct 22, 18:45:20 GMT+0
Monitoring -
The latency is resolving itself after only a few minutes, and we will continue to monitor..
Oct 14, 15:15:00 GMT+0
Monitoring -
We identified and resolved it, and are monitoring the result..
Oct 14, 15:35:41 GMT+0
Resolved -
The issue appears to be resolved!.
Oct 4, 13:40:00 GMT+0
Investigating -
We are currently investigating this incident..
Oct 4, 15:20:00 GMT+0
Resolved -
We just resolved the issue!.