# Service down for a week!

**URL:** <https://community.auth0.com/t/service-down-for-a-week/8089>\
**Category:** Get Help\
**Tags:** search\
**Created:** [September 5, 2017, 1:11pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089 "2017-09-05T13:11:24Z")\
**Posts on this page:** 16\
**Page:** 1

<div class="post-metadata">

**Author:** ![tomershohet](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/tomershohet/32/7196_2.png) [@tomershohet](https://community.auth0.com/u/tomershohet)\
**Post date:** [September 5, 2017, 1:11pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/1 "2017-09-05T13:11:24Z")

</div>

The Search API is down for a week (Which mean my service that uses your service is down for a whole week!!!) and i’ve been setting patience for your promise to have it working by Monday.

We are pass monday and so far -

1. No one answer my emails
2. No one answer my tweets on your support page
3. We are pass Monday - after 7!!! days the service is down, and it is still down  
I am loosing customers any day, and no one from your side who is responsible, even let us know what is going on.

Maybe here you will find the time to update us,  
Thank you,  
Tomer

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [September 6, 2017, 8:33pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/2 "2017-09-06T20:33:41Z")

</div>

I understand your frustration around this situation and I apologize for it. As you might imagine we also wanted to have this resolved as soon as possible (it it’s not good for you it’s also not good for us), however, we needed to do so in a way that really addressed the underlying issue. As per the latest update on the [status page incident](https://status.auth0.com/incidents/71nlbr16j7ng) the migration of free accounts is also now completed.

In summary (and I will be mostly repeating what’s available through the status page in a condensed form) the situation is that production accounts associated with paying tenants identified at the start of the incident had been migrated (before any others as you will sure understand) except for a few that exhibited a metadata usage pattern that warranted individual review and were addressed/contacted individually.

The **situation for free tenants** is similar from the perspective that tenants have been migrated. However, **there were some restrictions** on the type of user searches that can be made in order to safeguard against similar issues. In the status page incident there’s more information about what to do if you are affected by those restrictions and you can also directly reference me (at least for the remainder of this week; I’ll be offline on the next ones) in any question posted in this forum related to particular issues that you still experience with user search.

---

<div class="post-metadata">

**Author:** ![tomershohet](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/tomershohet/32/7196_2.png) [@tomershohet](https://community.auth0.com/u/tomershohet)\
**Post date:** [September 6, 2017, 8:42pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/3 "2017-09-06T20:42:00Z")

</div>

Hi,  
Thank you for you response.  
I do understand you can prioritize paying customers before free once, but that is something you should have mention before and not after, at least give us a chance to change our status.

Second - Are those restriction like using app\_metadata as a part of the search should be back any time soon?

Tomer

---

<div class="post-metadata">

**Author:** ![dale.lane](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/dale.lane/32/7044_2.png) [@dale.lane](https://community.auth0.com/u/dale.lane)\
**Post date:** [September 6, 2017, 8:53pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/4 "2017-09-06T20:53:27Z")

</div>

It’s important to recognise how this incident has been perceived, in the interest of learning for future incidents.

1. Lack of communication about what was wrong with no ETA for a resolution

2. Apparent long delay in resolution (not helped by Labor Day, I’m sure)

3. “Resolution” by a breaking API change without warning

It feels like nit-picking to point out publishing an email address to enable support that didn’t work ( [Searchapi-issues@auth0.com - Auth0 Community](http://community.auth0.com/questions/8454/searchapi-issues) ) but that was certainly unfortunate!

---

<div class="post-metadata">

**Author:** ![dale.lane](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/dale.lane/32/7044_2.png) [@dale.lane](https://community.auth0.com/u/dale.lane)\
**Post date:** [September 6, 2017, 8:54pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/5 "2017-09-06T20:54:01Z")

</div>

I recognise dealing with production problems is stressful. I’m sure we’ve all been there before, so please don’t take this as angry criticism, rather a constructive contribution towards an improved future service for us all.

---

<div class="post-metadata">

**Author:** ![dale.lane](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/dale.lane/32/7044_2.png) [@dale.lane](https://community.auth0.com/u/dale.lane)\
**Post date:** [September 6, 2017, 8:54pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/6 "2017-09-06T20:54:52Z")

</div>

I use auth0 for a web app used by schools.

The start of the school year (this week) is when teachers will want to do the most user management to set up student accounts.

This was the worst possible problem happening at the worst possible time for me.

I’m sure this is bad for everyone, so I don’t claim my need is the greatest. But I’ve been tearing my hair out over this telling schools to hold off until this is fixed. And I still can’t tell them when that will be.

---

<div class="post-metadata">

**Author:** ![tomershohet](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/tomershohet/32/7196_2.png) [@tomershohet](https://community.auth0.com/u/tomershohet)\
**Post date:** [September 6, 2017, 8:42pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/7 "2017-09-06T20:42:00Z")

</div>

Hi,  
Thank you for you response.  
I do understand you can prioritize paying customers before free once, but that is something you should have mention before and not after, at least give us a chance to change our status.

Second - Are those restriction like using app\_metadata as a part of the search should be back any time soon?

Tomer

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [September 6, 2017, 9:11pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/8 "2017-09-06T21:11:17Z")

</div>

Yes, the fact that first notification sent did not clearly state that the priority would be given to paying production tenants was something that I’ve already seen debated internally. In relation to restriction, at this time, we are getting feedback on use cases and requirements from customer in order to review and see what can be made available. However, there’s no deadline set for removing the current restrictions if the decision is to remove them.

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [September 6, 2017, 9:18pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/9 "2017-09-06T21:18:11Z")

</div>

Not taken, don’t worry. As a personal opinion I believe that making mistakes is unavoidable (the opinion may be biased by the fact that I personally can’t avoid making some) so the best thing to do is at learn something from those mistakes.

---

<div class="post-metadata">

**Author:** ![tomershohet](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/tomershohet/32/7196_2.png) [@tomershohet](https://community.auth0.com/u/tomershohet)\
**Post date:** [September 6, 2017, 9:19pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/10 "2017-09-06T21:19:20Z")

</div>

Do paying customers suffer from the same restrictions as well?

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [September 6, 2017, 9:24pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/11 "2017-09-06T21:24:20Z")

</div>

We tried to centralize communication through the status page, but I do understand that one point the frequency of updates could have been greater even if there wasn’t much more to add since the last update. In relation to the breaking change it’s indeed not what we wished, but I believe at some point there needed to be a decision that would not lead to the same outcome. Considering that not doing the decision would still leave customers broken (new changes were not being indexed) the restrictions were put in place.

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [September 6, 2017, 11:13pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/12 "2017-09-06T23:13:16Z")

</div>

At this time I don’t have definitive information on how the restrictions will work in terms of scope so in order to not lead you (or anyone else that ends up reading this) in error I would recommend that if you experience the inability to query for attributes outside the ones listed in the status page incident then you should expose your use case using the email address also listed in the [incident](https://status.auth0.com/incidents/71nlbr16j7ng).

---

<div class="post-metadata">

**Author:** ![dk1](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/dk1/32/3218_2.png) [@dk1](https://community.auth0.com/u/dk1)\
**Post date:** [October 10, 2017, 1:58am UTC](https://community.auth0.com/t/service-down-for-a-week/8089/13 "2017-10-10T01:58:47Z")

</div>

@jmangelo@prashant

Sad to hear, but there is another issue  
[http://community.auth0.com/questions/9747/api-stopped-querying-by-metadata](http://community.auth0.com/questions/9747/api-stopped-querying-by-metadata)  
to be categorized as above conversation, from the beginning.

more than 4 days meta\_data not responding ok, some people started voting for the issue.  
Plese, reply. Production stuck. While DB of customers stuck.

---

<div class="post-metadata">

**Author:** ![dk1](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/dk1/32/3218_2.png) [@dk1](https://community.auth0.com/u/dk1)\
**Post date:** [October 10, 2017, 1:58am UTC](https://community.auth0.com/t/service-down-for-a-week/8089/14 "2017-10-10T01:58:47Z")

</div>

@jmangelo@prashant

Sad to hear, but there is another issue  
[http://community.auth0.com/questions/9747/api-stopped-querying-by-metadata](http://community.auth0.com/questions/9747/api-stopped-querying-by-metadata)  
to be categorized as above conversation, from the beginning.

more than 4 days meta\_data not responding ok, some people started voting for the issue.  
Plese, reply. Production stuck. While DB of customers stuck.

---

<div class="post-metadata">

**Author:** ![jmangelo](https://sea1.discourse-cdn.com/auth0/user_avatar/community.auth0.com/jmangelo/32/7923_2.png) [@jmangelo](https://community.auth0.com/u/jmangelo)\
**Post date:** [October 10, 2017, 3:34pm UTC](https://community.auth0.com/t/service-down-for-a-week/8089/15 "2017-10-10T15:34:11Z")

</div>

I replied in the other post so we can use the other one for follow-ups.

---

<div class="post-metadata">

**Author:** ![system](https://global.discourse-cdn.com/auth0/original/3X/b/5/b560f266932fcce5d57f09a6595bd50518cae3f3.jpeg) [@system](https://community.auth0.com/u/system)\
**Post date:** [March 2, 2018, 5:56am UTC](https://community.auth0.com/t/service-down-for-a-week/8089/16 "2018-03-02T05:56:19Z")

</div>


