tag:status.ccli.com,2005:/history CCLI Status - Incident history 2025-04-15T17:35:37.007+00:00 CCLI tag:status.ccli.com,2005:Incident/cm9is9zu8003zmzg1zhdxm5uq 2025-04-15T17:35:37.007+00:00 2025-04-15T17:35:37.007+00:00 SongSelect may be intermittently and briefly down for maintenance. Type: Incident

Duration: 9 minutes

Affected Components: songselect.ccli.com

Apr 15, 17:35:37 GMT+0
Monitoring - We will keep downtime to a minimum..

Apr 15, 17:44:44 GMT+0
Resolved - Maintenance has been completed..

]]> tag:status.ccli.com,2005:Incident/cm6yprqco0041gupcr8u3tues 2025-02-10T04:30:00.000+00:00 2025-02-10T04:30:00.000+00:00 Generating PDF sheet music is failing intermittently in SongSelect and Partner API Type: Incident

Duration: 1 day, 10 hours and 46 minutes

Affected Components: api.ccli.com, songselect.ccli.com

Feb 10, 04:30:00 GMT+0
Investigating - We are currently investigating this incident..

Feb 10, 07:11:51 GMT+0
Identified - We have identified the problem area and are working on a fix for this incident..

Feb 10, 14:01:48 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Feb 10, 14:25:31 GMT+0
Monitoring - After significant investigation, it appears the partner API was NOT negatively affected by this. It only affected our SongSelect application..

Feb 10, 15:24:42 GMT+0
Identified - Althought the partner API was not affected from the prior issue, we are now seeing some new issues with the partner API. We are working on it..

Feb 10, 16:29:53 GMT+0
Monitoring - At the moment, the system appears to be operating normal again. We will continue to monitor..

Feb 10, 16:50:02 GMT+0
Resolved - We believe this incident is resolved, but we will continue to monitor over the coming days..

Feb 10, 19:06:29 GMT+0
Identified - As we are monitoring, the problem has returned so we are reopening this incident. We are working on a solution. This is now likely also affecting the ability for Partners to get chord sheets, and it is impacting SongSelect ability to view Lead and Vocal sheets. .

Feb 10, 21:56:23 GMT+0
Monitoring - Things seem to have stabilized since 11:20am Pacific Time and things have been operational since then. We are continuing to monitor closely..

Feb 11, 15:16:29 GMT+0
Resolved - The system is stable. This incident has been marked resolved, but we will continue to monitor closely over the coming weeks..

]]> tag:status.ccli.com,2005:Incident/cm3yxpiyq0006vvukrhb7emk8 2024-11-26T20:53:44.724+00:00 2024-11-26T20:53:44.724+00:00 We have a report of some partner's customers being unable to login. Type: Incident

Duration: 57 minutes

Affected Components: api.ccli.com

Nov 26, 20:53:44 GMT+0
Investigating - We are currently investigating this incident. This is likely limited to partners with installed client applications..

Nov 26, 21:28:53 GMT+0
Identified - We have identified the issue and hope to have a fix out shortly..

Nov 26, 21:40:32 GMT+0
Monitoring - A fix has been deployed and tested. We will continue to monitor..

Nov 26, 21:50:38 GMT+0
Resolved - A partner has confirmed this issue is resolved..

]]> tag:status.ccli.com,2005:Incident/cm0qv2eut000fdca4lf7g588t 2024-09-06T15:18:31.106+00:00 2024-09-06T15:18:31.106+00:00 Problems reported for CCLI API and SongSelect Type: Incident

Duration: 12 days, 20 hours and 45 minutes

Affected Components: api.ccli.com, songselect.ccli.com

Sep 6, 15:18:31 GMT+0
Investigating - There are reported issues with CCLI API and SongSelect. We are currently investigating this incident..

Sep 6, 16:05:36 GMT+0
Identified - We have identified the problem and are working towards a resolution..

Sep 6, 18:02:20 GMT+0
Identified - We are continuing to work on a fix for this incident. We are awaiting resolution from an underlying service provider..

Sep 6, 20:27:15 GMT+0
Resolved - The incident has been resolved. We will continue to monitor our systems to assure they are operating normally again. .

]]> tag:status.ccli.com,2005:Incident/clnde1j8b14312blmzvhtj68cm 2023-10-05T16:24:45.290+00:00 2023-10-05T16:24:45.290+00:00 CCLI API is down and some features in SongSelect are not working Type: Incident

Duration: 2 hours and 24 minutes

Affected Components: api.ccli.com, songselect.ccli.com

Oct 5, 16:24:45 GMT+0
Identified - We have identified the problem and will have a fix in place very shortly..

Oct 5, 16:56:37 GMT+0
Identified - We are still working on the fix which is taking a bit longer than we anticipated..

Oct 5, 17:07:33 GMT+0
Monitoring - The fix is in place and we are currently monitoring..

Oct 5, 18:49:13 GMT+0
Resolved - Systems have been working fine for nearly 2 hours so this incident is now marked resolved..

]]> tag:status.ccli.com,2005:Incident/cljhe3jkh80590azoh9fblq1u4 2023-06-29T16:58:34.788+00:00 2023-06-29T16:58:34.788+00:00 Unable to sign into SongSelect Type: Incident

Duration: 10 minutes

Affected Components: songselect.ccli.com

Jun 29, 16:58:34 GMT+0
Investigating - We are currently investigating this incident..

Jun 29, 17:08:05 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.ccli.com,2005:Maintenance/cli6j470c791776b3mwpor6wgps 2023-05-28T04:00:00.000+00:00 2023-05-28T04:00:00.000+00:00 CCLI API and Legacy API Maintenance Type: Maintenance

Duration: 2 hours and 3 minutes

Affected Components: api.ccli.com

May 28, 04:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time..

May 28, 06:03:19 GMT+0
Completed - Maintenance has completed successfully..

May 28, 04:00:01 GMT+0
Identified - Maintenance is now in progress.

]]> tag:status.ccli.com,2005:Incident/cli68y6f0720385bamwl2brf573 2023-05-27T17:09:15.930+00:00 2023-05-27T17:09:15.930+00:00 API is intermittently returning errors Type: Incident

Duration: 21 minutes

Affected Components: api.ccli.com

May 27, 17:09:15 GMT+0
Investigating - We are restarting some services and expect the API to be fully down for a few minutes..

May 27, 17:30:33 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.ccli.com,2005:Incident/clfzgeuyl255749vdoi24dpqv7s 2023-04-02T13:44:23.488+00:00 2023-04-02T13:44:23.488+00:00 Legacy SS API is struggling with Sunday morning load Type: Incident

Duration: 42 minutes

Apr 2, 13:44:23 GMT+0
Investigating - This only affects the legacy SS API (the new API is working well). The fix we had put in place for the legacy SS API last week is working, but has apparently increased the need for system resources so we are increasing server instances and monitoring as they come online. .

Apr 2, 14:16:40 GMT+0
Monitoring - The extra servers are helping and the API is usually responding, but performance is still poor as we are in the heaviest of Sunday morning load. Once again, this only impacts the legacy SS API, and the new API is performing well. Customers may download resources directly from SongSelect or upgrade partner software if it yet supports the new API..

Apr 2, 14:26:07 GMT+0
Resolved - This incident appears to be resolved..

]]> tag:status.ccli.com,2005:Incident/clfphw3ew159470hgon96ndfots 2023-03-26T14:28:05.487+00:00 2023-03-31T10:36:33.415+00:00 The Legacy SongSelect API will have partial outages until a fix is deployed around Tuesday, Mar 28. Type: Incident

Duration: 4 days, 20 hours and 8 minutes

Mar 31, 10:36:33 GMT+0
Resolved - We are considering this incident resolved. However, we will continue to monitor closely; especially Sunday under heavy load. .

Mar 26, 14:28:05 GMT+0
Monitoring - This ONLY affects partners on our legacy SongSelect API. A known issue started last Monday with our infrastructure for our legacy SongSelect API which is failing. Services are automatically restarted when they go down, but this solution can fail entirely under heavy load. We continue to anticipate partial outages, but we are working on a complete fix which we hope to deploy Tuesday Mar 28. Users can always go direct to SongSelect to download their resources, and then import them to partner software. Or, if a partner software upgrade is available that uses the new CCLI API, then customers can upgrade to bypass the problem entirely..

Mar 28, 15:25:04 GMT+0
Monitoring - Within the next few hours, we will be deploying a fix to the legacy SongSelect API and then will update this status. This will resolve the partial outages that have occurred over the past week. This fix was extensive and we have worked diligently to minimize the chances of negatively impacting partner software..

Mar 28, 18:30:00 GMT+0
Monitoring - We have deployed a fix to the legacy SongSelect API. This appears to have resolved the partial outages that have occurred over the past week. We will be closely monitoring. This fix was extensive and we have worked diligently to minimize the chances of impacting partner software. For partners, if you believe this is causing a breaking change in your software, please email details to partner@ccli.com. Once again, this only affects our legacy SongSelect API which is being retired soon, and customers can always go directly to SongSelect to download CCLI resources until partner software fully supports our new API. .

]]> tag:status.ccli.com,2005:Incident/clfh65yxl45440dqokp81bp3ua 2023-03-20T15:45:00.000+00:00 2023-03-20T15:45:00.000+00:00 Legacy SongSelect API searching is not working Type: Incident

Duration: 12 hours and 32 minutes

Mar 20, 15:45:00 GMT+0
Investigating - We are currently investigating this incident. This ONLY affects the legacy SongSelect API. For partners who have converted over to our new API, there are no issues..

Mar 20, 21:31:34 GMT+0
Identified - This is a stubborn issue, and we are continuing to work on a fix for this incident. Again, this only impacts the legacy SongSelect API so if you are on our newer API you are not affected by this outage. We are hoping to have a temporary fix in place by end-of-day today so it will be up and working..

Mar 21, 02:22:29 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Mar 21, 04:16:33 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.ccli.com,2005:Incident/clfb1whxc1297114jmvlr30szek 2023-03-16T11:51:44.306+00:00 2023-03-16T11:51:44.306+00:00 Some of our solutions have intermittent outage due to our cloud service being in the midst of an outage incident Type: Incident

Duration: 15 minutes

Affected Components: profile.ccli.com, reporting.ccli.com, api.ccli.com, songselect.ccli.com, rights.ccli.com

Mar 16, 11:51:44 GMT+0
Identified - Some of our systems are intermittently returning errors. Our cloud service, Microsoft Azure, is reporting that they have identified an issue and are working on a hotfix to resolve it..

Mar 16, 12:00:49 GMT+0
Monitoring - Microsoft is working on the issue with their Azure cloud service. The problem appear to have stopped and CCLI systems appear to be working again. We will continue to monitor..

Mar 16, 12:06:56 GMT+0
Resolved - This incident appears to have been resolved by Microsoft and CCLI solutions are operational..

]]> tag:status.ccli.com,2005:Incident/clem0osju377348g1ot8pvqbk5b 2023-02-26T23:10:00.000+00:00 2023-02-26T23:23:47.280+00:00 Usage Reporting API call is returning an error. Type: Incident

Duration: 21 minutes

Affected Components: api.ccli.com

Feb 26, 23:23:47 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Feb 26, 23:30:49 GMT+0
Resolved - This incident has been resolved..

Feb 26, 23:10:00 GMT+0
Investigating - We are aware of the problem and implementing a solution now..

]]> tag:status.ccli.com,2005:Incident/cle1ix6ii317360kamx4b73pgn8 2023-02-12T15:10:45.907+00:00 2023-02-12T15:10:45.907+00:00 Automatic alerts have notified us of some errors on api.ccli.com. Type: Incident

Duration: 46 minutes

Affected Components: api.ccli.com

Feb 12, 15:10:45 GMT+0
Investigating - We are currently investigating this incident..

Feb 12, 15:26:58 GMT+0
Monitoring - We implemented a fix and currently monitoring the result..

Feb 12, 15:56:30 GMT+0
Resolved - We just resolved the issue!.

]]> tag:status.ccli.com,2005:Incident/cldi1glt018682bvohs2xwa36r 2023-01-29T23:10:00.000+00:00 2023-01-29T23:10:00.000+00:00 SongSelect search is failing for some users Type: Incident

Duration: 1 hour and 23 minutes

Affected Components: songselect.ccli.com

Jan 29, 23:10:00 GMT+0
Investigating - We are currently investigating this incident..

Jan 30, 00:26:53 GMT+0
Monitoring - We implemented a fix and currently monitoring the result..

Jan 30, 00:32:49 GMT+0
Resolved - We are considering the issue resolved!.

]]> tag:status.ccli.com,2005:Incident/clb9jklx10507hrln26y9cr04 2022-12-04T15:52:00.847+00:00 2022-12-04T16:10:08.224+00:00 The Legacy SongSelect API is slow or unresponsive (the new API is not affected). Type: Incident

Duration: 29 minutes

Dec 4, 16:10:08 GMT+0
Monitoring - We implemented a fix and currently monitoring the result..

Dec 4, 16:21:02 GMT+0
Resolved - The issue is resolved..

Dec 4, 15:52:00 GMT+0
Investigating - We are currently investigating this incident..

]]> tag:status.ccli.com,2005:Incident/ckx7pqvfj33678glmt1bxw6tz 2021-12-15T15:40:00.000+00:00 2021-12-15T15:40:00.000+00:00 Some systems unresponsive due to AWS reported outage Type: Incident

Duration: 23 minutes

Affected Components: songselect.ccli.com

Dec 15, 15:40:00 GMT+0
Monitoring - Amazon Web Services (AWS) has reported a problem serving the West Coast, and this is impacting some CCLI applications. We are monitoring and awaiting AWS to respond..

Dec 15, 16:02:52 GMT+0
Resolved - AWS resolved their issue and SongSelect is back up..

]]> tag:status.ccli.com,2005:Incident/ckwwstfb2105517lop3fps19uc 2021-12-08T00:00:00.000+00:00 2021-12-08T00:30:00.000+00:00 Performance issue Type: Incident

Duration: 30 minutes

Dec 8, 00:30:00 GMT+0
Resolved - AWS platform has had reported problems today, and this may have impacted the SongSelect API. However, the API appears to be working normally again..

Dec 8, 00:00:00 GMT+0
Investigating - We are currently investigating this incident..

]]> tag:status.ccli.com,2005:Incident/ckrpftgp14861639xn4zl70afdl 2021-07-29T21:35:13.522+00:00 2021-07-29T21:35:13.522+00:00 Chord sheet retrieval via the Partner API is not working Type: Incident

Duration: 3 hours and 19 minutes

Jul 29, 21:35:13 GMT+0
Investigating - We are currently investigating this incident..

Jul 29, 23:37:10 GMT+0
Identified - We have identified the problem and are working on a fix for this incident..

Jul 30, 00:54:15 GMT+0
Resolved - Monitoring has shown no more problems. The issue appears to be resolved..

Jul 30, 00:01:05 GMT+0
Monitoring - We implemented a fix and currently monitoring the result..

]]> tag:status.ccli.com,2005:Incident/cknx7y44m640886egoliq5u03am 2021-04-25T13:39:10.547+00:00 2021-04-25T13:52:45.855+00:00 SongSelect API is returning errors to partner software Type: Incident

Duration: 5 days, 7 hours and 13 minutes

Apr 25, 13:52:45 GMT+0
Monitoring - We implemented a fix about 10 minutes ago and and are currently monitoring the result. The API is returning to normal response times..

Apr 25, 15:46:23 GMT+0
Resolved - The SongSelect API is operating normally..

Apr 25, 14:12:18 GMT+0
Resolved - The issue appears to be resolved, but we will continue to monitor on further into the morning..

Apr 25, 14:31:38 GMT+0
Investigating - We are still seeing problems and are investigating further. SongSelect is running fine, so customers can download what they need directly from SongSelect until the API issue is resolved..

Apr 25, 13:39:10 GMT+0
Investigating - We are currently investigating this incident..

]]> tag:status.ccli.com,2005:Incident/cknn8j59b50868imoe2p1bblx4 2021-04-18T13:57:27.599+00:00 2021-04-18T13:57:27.599+00:00 SongSelect API is returning errors to partner software Type: Incident

Duration: 2 days, 16 hours and 30 minutes

Apr 18, 13:57:27 GMT+0
Investigating - We are currently investigating this incident..

Apr 18, 15:01:57 GMT+0
Resolved - The issues are resolved and the platform is responding normally..

Apr 18, 14:41:49 GMT+0
Monitoring - We have added more servers and the problems are diminishing. We are continuing to monitor closely. If customers are continuing to have issues downloading information through the API, the SongSelect application is working fine and songs can be downloaded from there..

]]> tag:status.ccli.com,2005:Incident/ckney544m95143d9orcacga9d5 2021-04-11T13:20:00.000+00:00 2021-04-11T15:20:00.000+00:00 SongSelect API is returning errors to partner software Type: Incident

Duration: 5 days

Apr 11, 15:20:00 GMT+0
Resolved - The issue is resolved and the SongSelect API is responding to requests normally..

Apr 11, 13:20:00 GMT+0
Investigating - We are currently investigating this incident..

]]> tag:status.ccli.com,2005:Incident/ckk6z1e7lh3el0707tk9btqn2 2021-01-21T14:48:52.535+00:00 2021-01-21T15:24:00.000+00:00 Problem reporting activity Type: Incident

Duration: 1 day, 17 hours and 8 minutes

Affected Components: reporting.ccli.com

Jan 21, 15:24:00 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Jan 21, 15:30:00 GMT+0
Resolved - We have been monitoring, and are considering this issue resolved..

Jan 21, 14:48:52 GMT+0
Investigating - We are currently investigating this incident..

Jan 21, 15:02:16 GMT+0
Identified - We are continuing to work on a fix for this incident..

]]> tag:status.ccli.com,2005:Incident/ckgl6b7yytlba0771pkheroci 2020-10-22T18:42:09.841+00:00 2020-10-22T18:42:09.841+00:00 Some latency detected Type: Incident

Duration: 6 hours and 6 minutes

Oct 22, 18:42:09 GMT+0
Investigating - We are investigating this incident..

Oct 22, 18:48:15 GMT+0
Resolved - We are considering the issue resolved..

Oct 22, 18:45:20 GMT+0
Monitoring - The latency is resolving itself after only a few minutes, and we will continue to monitor..

]]> tag:status.ccli.com,2005:Incident/ckg9k2bmwc0q90772kxi7qdto 2020-10-14T15:15:00.000+00:00 2020-10-14T15:35:41.896+00:00 Degraded performance detected Type: Incident

Duration: 20 hours and 42 minutes

Oct 14, 15:35:41 GMT+0
Resolved - The issue appears to be resolved!.

Oct 14, 15:15:00 GMT+0
Monitoring - We identified and resolved it, and are monitoring the result..

]]> tag:status.ccli.com,2005:Incident/ckgtpg3ue0inq07800nj3vebg 2020-10-04T13:40:00.000+00:00 2020-10-04T15:20:00.000+00:00 SS API Partial Outage Type: Incident

Duration: 4 days and 4 hours

Oct 4, 15:20:00 GMT+0
Resolved - We just resolved the issue!.

Oct 4, 13:40:00 GMT+0
Investigating - We are currently investigating this incident..

]]>