tag:status.clevertap.com,2005:/historyCleverTap System Status - Incident History2024-03-28T22:22:55-07:00CleverTap Systemtag:status.clevertap.com,2005:Incident/201547552024-03-04T00:18:25-08:002024-03-04T00:18:25-08:00Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup<p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>00:18</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>00:08</var> PST</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring the situation and will update here when all delay is cleared.</p><p><small>Mar <var data-var='date'> 3</var>, <var data-var='time'>23:45</var> PST</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our IN (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />Dashboard queries will be slow/not working for a few customers. <br />We are currently investigating the incident and will update here in the next 30 minutes.</p>tag:status.clevertap.com,2005:Incident/201045092024-02-29T00:31:12-08:002024-02-29T00:31:12-08:00Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup<p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>00:31</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Feb <var data-var='date'>29</var>, <var data-var='time'>00:19</var> PST</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring the situation and will update here when all delay is cleared.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>23:48</var> PST</small><br><strong>Update</strong> - We are upgrading the issue to impact: Major as this is affecting the dashboard logins, trigger campaigns and delayed ingestion.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>23:35</var> PST</small><br><strong>Investigating</strong> - We are experiencing degraded performance on some of our IN (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />Dashboard queries will be slow. <br />We are currently investigating the incident and will update here in the next 30 minutes.</p>tag:status.clevertap.com,2005:Incident/187291422023-10-09T03:21:43-07:002023-10-09T03:21:43-07:00Unplanned maintenance triggered on one of the data store for one IN Cluster<p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>03:21</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all our systems are stable and normal. We are closing the incident.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>02:56</var> PDT</small><br><strong>Monitoring</strong> - The affected node is back to normal. All our systems are back to normal. <br />We are currently monitoring the services. We will close the incident in a few minutes.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>01:34</var> PDT</small><br><strong>Update</strong> - We are continuing to work with the infrastructure team to fix the issue. We are expecting a slight delay in getting this node back online.<br />We will keep updating the status regularly here.</p><p><small>Oct <var data-var='date'> 9</var>, <var data-var='time'>00:21</var> PDT</small><br><strong>Identified</strong> - We are currently facing a hardware issue with one the the underlying nodes of one of our IN clusters. <br />The customers on this cluster are facing delayed ingestion, slow/delayed campaign deliveries, and delays in import/exports/reports. <br /><br />We have identified the issue and working with the infrastructure team to bring the node back. We are expecting approximately 2 hours for the systems to get back to normal. We will keep updating the status here.</p>tag:status.clevertap.com,2005:Incident/186855412023-10-04T02:58:12-07:002023-10-04T02:58:12-07:00Unplanned maintenance triggered on one of the data store in EU region<p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>02:58</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all our systems are working as expected.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>02:39</var> PDT</small><br><strong>Update</strong> - The affected system is back to normalcy. We are currently monitoring this for some time before closing the incident.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>Update</strong> - The data store is back up now and we are verifying the instance(s) before moving into monitoring status.</p><p><small>Oct <var data-var='date'> 4</var>, <var data-var='time'>00:03</var> PDT</small><br><strong>Identified</strong> - We needed unplanned maintenance on one of the data stores. This has resulted in a partial outage for a few of our customers. <br />The campaign deliveries/data exports are partially unavailable for these customers. <br /><br />Currently, we have identified the issue and fixing it. We are bringing up the data store and backup systems and monitoring the performance.<br />The expected time is 1 hour to resolve.</p>tag:status.clevertap.com,2005:Incident/185086552023-09-15T01:23:32-07:002023-09-15T01:23:32-07:00We are experiencing downtime on our Europe SDK endpoint<p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>01:23</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and SDK ingestion has resumed to normal.</p><p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>01:16</var> PDT</small><br><strong>Monitoring</strong> - We have deployed the changes which resolved the issue with our Europe SDK endpoint. The ingestion is back to normal and we are currently monitoring the system. <br />We will observe this for some time before closing the incident.</p><p><small>Sep <var data-var='date'>15</var>, <var data-var='time'>00:47</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing outage on our Europe SDK Endpoint.<br />Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. <br /><br />We will provide further updates in 30 minutes.</p>tag:status.clevertap.com,2005:Incident/183352932023-08-31T09:08:50-07:002023-08-31T09:08:50-07:00Some of the accounts/users are not able to login to EU1 dashboard<p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>09:08</var> PDT</small><br><strong>Resolved</strong> - All user information and account information is synced. All users can login and conduct their operations normally. <br />This incident is resolved and all components are working as expected.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>07:48</var> PDT</small><br><strong>Monitoring</strong> - Update: We have completed the data sync for 90% of the accounts and users. We will be completing the remaining set of users in the next 30 minutes. We will post the update here.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>06:45</var> PDT</small><br><strong>Identified</strong> - We are currently facing a user information sync issue. A few accounts/users are not able to login to our EU1 dashboard. <br />We are currently fixing the sync issue. The users will be able to login as soon as their information is synced up. <br />We will update here with the progress.<br /><br />As an alternative measure, users/accounts who are facing issues can access the following page to perform their activities:<br />https://eu1.dashboard.clevertap.com/old-login.html<br /><br />All other components of the platform are working fine:<br />1) Ingestion (SDK/API) is working fine<br />2) Scheduled campaigns/live campaigns are running fine<br />3) Import/Export functionality is working fine</p>tag:status.clevertap.com,2005:Incident/166178352023-03-23T06:43:56-07:002023-03-23T06:43:56-07:00We are experiencing slowness on EU1 dashboard<p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>06:43</var> PDT</small><br><strong>Resolved</strong> - This incident is marked as resolved and all systems are back to normal.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>06:33</var> PDT</small><br><strong>Monitoring</strong> - We have identified the issue and fixed it. The systems are back to their normal status. We are currently monitoring the platform and would update here in some time.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>05:29</var> PDT</small><br><strong>Identified</strong> - We are upgrading the issue to critical as the following things are affected:<br />1) Ingestion of data is delayed (SDK/API/sFTP import)<br />2) Dashboard operations are affected/degraded<br />3) Campaign delivery is affected<br /><br />We are currently working on bringing the services up. The estimated time is approximately 120 minutes or lesser. <br />We will update the status in the next 30 minutes. We apologize for the inconvenience caused.</p><p><small>Mar <var data-var='date'>23</var>, <var data-var='time'>04:59</var> PDT</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing slowness on the EU1 dashboard. We are investigating this issue and would update the status soon.</p>tag:status.clevertap.com,2005:Incident/163108752023-02-28T20:57:34-08:002023-02-28T20:57:34-08:00We are experiencing downtime on our Europe SDK endpoint<p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>20:57</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and SDK ingestion has resumed to normal.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>20:44</var> PST</small><br><strong>Monitoring</strong> - We have deployed the changes which resolved the issue with our Europe sdk endpoint. The ingestion is coming back to normal and we are currently monitoring the system. <br />We will observe this for some time before closing the incident.</p><p><small>Feb <var data-var='date'>28</var>, <var data-var='time'>20:08</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing outage on our Europe SDK Endpoint.<br />Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. <br /><br />We will provide further updates in 30 minutes.</p>tag:status.clevertap.com,2005:Incident/158710682023-01-18T04:56:14-08:002023-01-18T04:56:14-08:00We are experiencing downtime on our API endpoints for Europe region<p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>04:56</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved. Our Europe API endpoint is back to normal.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>04:12</var> PST</small><br><strong>Monitoring</strong> - A fix has been implemented and all our Europe API endpoints are up and running. <br />We are monitoring the situation.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>03:12</var> PST</small><br><strong>Update</strong> - We are continuing to work on this issue. We have identified some of the possible causes and working on addressing those. <br />We will update this space in the next 30 minutes with further updates.</p><p><small>Jan <var data-var='date'>18</var>, <var data-var='time'>02:00</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing degraded performance/outage on our Europe API Endpoints.<br />Our customers will see an increased rate of errors during this period. Please allow us some time to diagnose and fix the issue. <br />We appreciate your patience and we will continue to update the status here.</p>tag:status.clevertap.com,2005:Incident/156634322022-12-20T11:59:34-08:002022-12-20T11:59:34-08:00We are experiencing downtime on our SDK and API endpoints for regions (Europe and India)<p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>11:59</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and all endpoints are back to normal. Data ingestion has resumed to normal.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>11:16</var> PST</small><br><strong>Monitoring</strong> - Our India API endpoints are back to normal and we are monitoring the system for some time.<br /><br />Status update: All our endpoints (SDK as well as API) are up for India and Europe. <br />We will observe this for some time before closing the incident.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>10:46</var> PST</small><br><strong>Update</strong> - We are continuing to work on a fix for this issue.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>10:45</var> PST</small><br><strong>Update</strong> - India SDK endpoints are back to normal and the data is getting processed.<br /><br />We are currently working on India API endpoints and the service is partially back to normal and currently exhibiting degraded performance. <br />We are working on this and will update the status here soon</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>09:18</var> PST</small><br><strong>Update</strong> - We are taking more time to identify the exact issue with India endpoints that is causing the downtime.<br />Thank you for your patience and we will continue to update the progress here.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>08:29</var> PST</small><br><strong>Update</strong> - Europe endpoints are back to normal and the data is getting processed.<br /><br />We are currently working on India Endpoints and will update the status here soon.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>07:54</var> PST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented. <br />We will update the progress in the next few minutes.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>07:13</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing degraded performance/partial outage on our Europe and India SDK and API Endpoints.<br />Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. <br />This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.</p>tag:status.clevertap.com,2005:Incident/140749212022-12-01T06:15:29-08:002022-12-01T06:15:29-08:00We are experiencing downtime on our Europe SDK endpoint<p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>06:15</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and SDK ingestion has resumed to normal.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>05:48</var> PST</small><br><strong>Monitoring</strong> - We have deployed the changes and currently monitoring the system. <br />We will observe this for some time before closing the incident.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>05:33</var> PST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented. <br />We will update the progress in the next few minutes.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>03:25</var> PST</small><br><strong>Update</strong> - We are continuing to work with the Amazon AWS team to get the system back to normal.<br />Currently, this issue has affected the ingestion in the Europe region for SDK traffic. This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>02:51</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing degraded performance/partial outage on our Europe SDK Endpoint.<br />Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. <br /><br />We will provide further updates in 30 minutes.</p>tag:status.clevertap.com,2005:Incident/140525962022-12-01T03:48:23-08:002022-12-01T03:48:23-08:00We are experiencing downtime on our India SDK endpoint<p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>03:48</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and SDK ingestion has resumed to normal.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>03:24</var> PST</small><br><strong>Monitoring</strong> - We have deployed the changes and currently monitoring the system. <br />We will observe this for some time before closing the incident.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>02:48</var> PST</small><br><strong>Identified</strong> - The issue has been identified and a fix is being implemented. <br />We will update the progress in the next few minutes.</p><p><small>Dec <var data-var='date'> 1</var>, <var data-var='time'>01:25</var> PST</small><br><strong>Update</strong> - We are taking more time to identify the exact issue which is causing the downtime.<br />Thank you for your patience and we will continue to update the progress here.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>23:27</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue further. So far we have eliminated a few reasons. However, we are taking more time to identify the exact issue which is causing the downtime.<br />We appreciate your patience and we will continue to update the progress here.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>22:17</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue further. We are ruling out a few possibilities with the help of Amazon AWS.<br />We will update here as soon as possible.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>21:04</var> PST</small><br><strong>Update</strong> - We are upgrading the severity of the incident to "Major Outage" for SDK ingestion in the India region.<br />We are continuing to work with Amazon AWS team to get the system back to normal.<br /><br />Currently, this issue has affected the ingestion in the India region for SDK traffic. This will also affect the action-based (trigger) campaigns/journeys. We appreciate your patience and we will continue to update the status here.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>20:49</var> PST</small><br><strong>Update</strong> - We are continuing to investigate this issue and working with the Amazon AWS team to bring the services back to normal.<br />We appreciate your patience and we will update the status here in some time.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>20:03</var> PST</small><br><strong>Investigating</strong> - We are currently investigating an issue that is causing degraded performance/partial outage on our India SDK Endpoint.<br />Please note that our SDK has a built-in retry mechanism and the traffic will come back to normal when the issue is resolved. <br />We will provide further updates in 30 minutes.</p>tag:status.clevertap.com,2005:Incident/111084532022-09-12T08:02:21-07:002022-09-12T08:02:21-07:00Unplanned maintenance triggered on one of the data store for US Cluster<p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>08:02</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all our systems are working as expected.</p><p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>07:52</var> PDT</small><br><strong>Monitoring</strong> - All our systems are back to normalcy. We are currently monitoring this for some time before closing the incident.</p><p><small>Sep <var data-var='date'>12</var>, <var data-var='time'>07:26</var> PDT</small><br><strong>Identified</strong> - One of the datastore in the US cluster has reported a slightly degraded performance and we have taken a downtime for this cluster. <br />During this period - Dashboard reports, campaign delivery, data ingestion, and data exports will be delayed. <br /><br />We will update the progress periodically.</p>tag:status.clevertap.com,2005:Incident/109110892022-08-25T01:03:17-07:002022-08-25T01:03:17-07:00Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup<p><small>Aug <var data-var='date'>25</var>, <var data-var='time'>01:03</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Aug <var data-var='date'>25</var>, <var data-var='time'>00:22</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update here when all delay is cleared.</p><p><small>Aug <var data-var='date'>24</var>, <var data-var='time'>23:30</var> PDT</small><br><strong>Investigating</strong> - We are experiencing degraded performance on some of our IN (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />Dashboard queries will be running slow. <br />We are currently investigating the incident and will update here in next 30 minutes.</p>tag:status.clevertap.com,2005:Incident/107802712022-08-08T04:16:37-07:002022-08-08T04:16:37-07:00Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns.<p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>04:16</var> PDT</small><br><strong>Resolved</strong> - All the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>03:03</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update here when all delay is cleared.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>02:16</var> PDT</small><br><strong>Update</strong> - Further update: Some of the hosts are taking more time to boot than anticipated. <br />We will update this space in another 30-45 minutes.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>01:40</var> PDT</small><br><strong>Update</strong> - We have made progress and worked on the issue which was causing the degraded performance for this cluster. <br />We are expecting another 45-60 minutes to get all systems back to normal.</p><p><small>Aug <var data-var='date'> 8</var>, <var data-var='time'>00:24</var> PDT</small><br><strong>Update</strong> - We have encountered a few unforeseen situations and actively working on getting this issue fixed. <br />Expecting more time to complete this activity. We will update the status in another 45 minutes.</p><p><small>Aug <var data-var='date'> 7</var>, <var data-var='time'>23:38</var> PDT</small><br><strong>Update</strong> - We are continuously working on this issue to get it resolved. We are expecting another 30-40 minutes to get all systems back to normal.</p><p><small>Aug <var data-var='date'> 7</var>, <var data-var='time'>22:56</var> PDT</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our EU (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and will provide an update regularly.</p>tag:status.clevertap.com,2005:Incident/94865172022-03-07T23:20:52-08:002022-03-07T23:20:52-08:00Network connectivity to AWS EU region from India region affected. Dashboard is exhibiting slow performance on some of the networks.<p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>23:20</var> PST</small><br><strong>Resolved</strong> - This incident is marked as resolved. EU dashboard is back to normal.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:46</var> PST</small><br><strong>Monitoring</strong> - The EU dashboard is back to normal. We are currently monitoring this.</p><p><small>Mar <var data-var='date'> 7</var>, <var data-var='time'>22:18</var> PST</small><br><strong>Investigating</strong> - Some of our customers are facing slow connectivity/performance on our EU dashboard. <br />We verified from other regions that the dashboard and all other services are running fine. <br /><br />We are verifying the network connectivity issues between the Indian network providers and the AWS EU region. Users from the affected networks will experience slow performance/connectivity to our dashboard.</p>tag:status.clevertap.com,2005:Incident/90522382022-01-11T00:53:13-08:002022-01-11T00:53:13-08:00Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaign pickup<p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>00:53</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved and all the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Jan <var data-var='date'>11</var>, <var data-var='time'>00:07</var> PST</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>23:30</var> PST</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our IN (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and expecting it to come back to normal within 1 hour from now.</p>tag:status.clevertap.com,2005:Incident/86584802021-11-22T00:23:08-08:002021-11-22T00:23:08-08:00Unplanned maintenance triggered on a few of the data store(s) in SG region<p><small>Nov <var data-var='date'>22</var>, <var data-var='time'>00:23</var> PST</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>23:34</var> PST</small><br><strong>Monitoring</strong> - This maintenance window is complete now and all the services are back online. <br />We are doing the sanity check for the next few minutes before marking the incident as resolved.</p><p><small>Nov <var data-var='date'>21</var>, <var data-var='time'>23:03</var> PST</small><br><strong>Identified</strong> - We have encountered unplanned maintenance on a few of the data store(s) in the SG region. We have rebooted the affected nodes and some of the customers will be facing the following issues:<br />1) Delayed ingestion of events<br />2) Delayed/stopped delivery of campaigns<br />3) Dashboard not working for the affected customers<br /><br />The expected time to complete the maintenance is 90-120 minutes. We will keep this space updated.</p>tag:status.clevertap.com,2005:Incident/76982802021-08-06T06:14:56-07:002021-08-06T06:14:56-07:00Our dashboard is showing degraded performance<p><small>Aug <var data-var='date'> 6</var>, <var data-var='time'>06:14</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all our dashboards are back to normal.</p><p><small>Aug <var data-var='date'> 6</var>, <var data-var='time'>05:49</var> PDT</small><br><strong>Monitoring</strong> - We have taken the necessary steps to address the degraded performance of the dashboard. The dashboard is working fine along with the other components of the system. We are observing this for some more time before marking the ticket as resolved.</p><p><small>Aug <var data-var='date'> 6</var>, <var data-var='time'>05:25</var> PDT</small><br><strong>Investigating</strong> - We are currently experiencing degraded performance for our Dashboard system. Customers may observe slowness/degraded performance while conducting operations on the dashboard. We are currently investigating the issue and working towards resolving this.</p>tag:status.clevertap.com,2005:Incident/75750312021-07-22T06:48:57-07:002021-07-22T06:48:57-07:00Some of our IN instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns.<p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>06:48</var> PDT</small><br><strong>Resolved</strong> - All the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>05:57</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>04:55</var> PDT</small><br><strong>Identified</strong> - We are taking further steps and cleaning the system. The expected degraded performance is 40 minutes.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>04:51</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jul <var data-var='date'>22</var>, <var data-var='time'>04:23</var> PDT</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our IN (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and expecting it to come back to normal in 1 hour from now.</p>tag:status.clevertap.com,2005:Incident/75249072021-07-16T08:15:43-07:002021-07-16T08:15:43-07:00Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns.<p><small>Jul <var data-var='date'>16</var>, <var data-var='time'>08:15</var> PDT</small><br><strong>Resolved</strong> - All the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Jul <var data-var='date'>16</var>, <var data-var='time'>05:45</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jul <var data-var='date'>16</var>, <var data-var='time'>04:53</var> PDT</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our EU (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and will provide an update regularly.</p>tag:status.clevertap.com,2005:Incident/73016772021-06-21T23:23:18-07:002021-06-21T23:23:18-07:00Unplanned maintenance triggered on one of the data store<p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>23:23</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved and all our systems are working as expected.</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>23:07</var> PDT</small><br><strong>Monitoring</strong> - All our systems are back to normalcy. We are currently monitoring this for some time before closing the incident.</p><p><small>Jun <var data-var='date'>21</var>, <var data-var='time'>22:07</var> PDT</small><br><strong>Identified</strong> - We are currently experiencing a partial outage due to unplanned maintenance. A few customers will not be able to use the dashboard system currently. We are working on it.<br />The estimated ETA is 1 hour.</p>tag:status.clevertap.com,2005:Incident/72779462021-06-18T02:00:46-07:002021-06-18T02:00:46-07:00Unplanned maintenance triggered on one of the data store for US Cluster in the maintenance window<p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'>18</var>, <var data-var='time'>00:01</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jun <var data-var='date'>17</var>, <var data-var='time'>23:55</var> PDT</small><br><strong>Scheduled</strong> - We have a defined maintenance window for our customers in non business hours. One of the datastore in US cluster has reported a slightly degraded performance and we have taken a downtime for this cluster. <br /><br />During this period - Dashboard reports, campaign delivery, data ingestion and data exports will be delayed. <br /><br />We will update with the progress periodically.</p>tag:status.clevertap.com,2005:Incident/72418432021-06-14T04:40:39-07:002021-06-14T04:40:39-07:00Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns.<p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>04:40</var> PDT</small><br><strong>Resolved</strong> - All the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Jun <var data-var='date'>14</var>, <var data-var='time'>01:28</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jun <var data-var='date'>13</var>, <var data-var='time'>23:28</var> PDT</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our EU (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and will provide an update regularly.</p>tag:status.clevertap.com,2005:Incident/72227472021-06-11T01:16:23-07:002021-06-11T01:16:23-07:00Some of our EU instance(s) are showing degraded performance. Few customers might face delayed ingestion/campaigns.<p><small>Jun <var data-var='date'>11</var>, <var data-var='time'>01:16</var> PDT</small><br><strong>Resolved</strong> - All the services are back to normal and the delay is cleared for the affected hosts completely.</p><p><small>Jun <var data-var='date'>11</var>, <var data-var='time'>00:19</var> PDT</small><br><strong>Monitoring</strong> - The degraded performance issue is resolved. And ingestion of data is getting cleared for the affected instances. We are monitoring this and will update when all delay is cleared.</p><p><small>Jun <var data-var='date'>10</var>, <var data-var='time'>23:12</var> PDT</small><br><strong>Identified</strong> - We are experiencing degraded performance on some of our EU (instances).<br />Data ingestion will be delayed and some of the campaigns will be running slow/delayed.<br />We are currently working on this and will provide an update regularly.</p>