Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

G Suite notice about SMS Backup+ becoming restricted #959

Open
ghost opened this issue Jun 14, 2019 · 367 comments
Open

G Suite notice about SMS Backup+ becoming restricted #959

ghost opened this issue Jun 14, 2019 · 367 comments
Labels
helpful provides information that may be useful to other users xoauth problems caused by lack of approval to use "sensitive" Gmail API

Comments

@ghost
Copy link

ghost commented Jun 14, 2019

[Note added by @kurahaupo, 2020-07-08]

  1. This thread does have useful information but it is somewhat buried because the thread is so long. Please read through it before adding more comments.
    If you're just looking for a quick fix, there's an explanation at the top of Google IMAP error fixed on Android #972.
  2. Although this report dates from June 2019, in July 2020 G-suite users are being notified (again) that new installations of SMS Backup+ won't get Gmail sensitive scope access; it's the same problem, just different timing.
  3. This policy change should not affect access to Calendars. If you have a problem with calendars, raise a separate ticket. (Note: do not enable Connect your Gmail account (unsupported), as that's only for Gmail, not for Calendars.)
  4. The changes to sensitive scope access are explained at https://developers.google.com/terms/api-services-user-data-policy#additional-requirements-for-specific-api-scopes
    A major use-case is being able to read SMS & MMS alongside email & hangouts messages, and that ought to be sufficient justification under term 3 of the rules "Applications that enhance the email experience for productivity purposes", but it's hard to argue that case when the name says "Backup".

[Original report follows]

I received the attached email from Google that your app will become restricted on 7/8. Thought you'd like to know.
SMS Backup.pdf

@MarkMessinger
Copy link

A similar email is being sent to ordinary users of Gmail. This one refers to a restriction commencing July 15, 2019.
SMS+ Backup.pdf

@B150n
Copy link

B150n commented Jun 25, 2019

I had the same experience as @MarkMessinger. Very worried that we'll lose THE best SMS backup app around.

@WebAddict
Copy link

Same - July 15 will stop working if "unable to meet the deadline to comply with our updated data policy requirements"

@AEFeinstein
Copy link

I have also received this email

@bwwestbrook
Copy link

Same email.

Hi,

Although you don’t need to do anything, we wanted to let you know that the following apps may no longer be able to access some data in your Google Account, including your Gmail content. If these apps are unable to meet the deadline to comply with our updated data policy requirements, they'll lose access to your Account starting July 15th, 2019.

SMS Backup+
We are making this change as part of ongoing efforts to make sure your data is protected and private.

You can always view, manage and remove apps you’ve given access to your account by visiting your Google Account.

Thanks,
The Google Accounts team

@malversan
Copy link

It seems that the app must pass a verification process to continue accessing GMail accounts the way it does.

The Google API scopes to create and read GMail messages (used by SMS Backup+ to backup and restore SMS messages) are now restricted scopes, and apps that use them need to be audited by Google to verify that they comply with the OAuth security policies and to verify that they do not make an ilegitimate use of that APIs.

And for the app to be verified, the developer must apply for that verification. There are limit dates for that too. The too-late deadline is July 15th, when the app will loose access to that APIs if nothing is done.

About restricted API scopes:
https://developers.google.com/terms/api-services-user-data-policy#additional-requirements-for-specific-api-scopes

About the verification process:
https://support.google.com/cloud/answer/9110914#restricted-scopes

We need the developer urgently.

@malversan
Copy link

Please, do not clutter this thread by repeating the same information a hundred times. We all have received the same message today, Jun 25th, so there is no need to post it more than once nor repeating ”me too” once and again.

Let's try to get a solution, not to make a whinning cry of this.

@jpellman
Copy link

It's worth pointing out that, while it will be a bit obnoxious, you don't need to use the default OAuth-based mechanism to back up your texts. As stated in the docs here you can configure the app to use plain old vanilla IMAP.

@jason-mehmel
Copy link

It's worth pointing out that, while it will be a bit obnoxious, you don't need to use the default OAuth-based mechanism to back up your texts. As stated in the docs here you can configure the app to use plain old vanilla IMAP.

We can keep backing up to gmail, just through IMAP? Would it still track the same SMS label that we've applied to the texts?

@malversan
Copy link

I think using GMail IMAP is subject to the same restrictions that require the aforementioned verification process.

Asides, using another IMAP server is a no go for me. This app is not only a backup utility, it also allows to search for specific SMSs using GMail and search for calls you issued using Google Calendar. It's not just a backup, it's much more when combined with a Google account.

The fact is that I think the app already complies with the OAuth security requirements claimed by the Google verification process. So we only need the developer to apply the app for that verification process. I have just emailed him asking for his help. I hope he has a bit of time and interest in keeping his awesome creature alive.

@KyleSanderson
Copy link

@jberkel send help

@pingu8007
Copy link

It's worth pointing out that, while it will be a bit obnoxious, you don't need to use the default OAuth-based mechanism to back up your texts. As stated in the docs here you can configure the app to use plain old vanilla IMAP.

Yes, we can fallback to vanilla IMAP. And no, Gmail won't let it happen.
According to experience from K-9 mail, Gmail will do its best to prevent you access IMAP even with "less secure apps ON" or "2-factor-authentication OFF". (See thunderbird/thunderbird-android#655)

@jberkel
Copy link
Owner

jberkel commented Jun 25, 2019

Hello everyone. I'm sorry about this situation, SMS Backup+ will no longer have access to Gmail, mainly because it's not an email reading app.

I applied for an exception but it was declined, as expected. Vanilla IMAP might work, but for how long I wonder. And it's very tricky to set up for a casual user. Unfortunately the Android platform is getting more and more closed.

I'm not sure what to do at this point, either remove the app from the store or release a new version which removes the automatic account setup, since that is broken / will be broken soon.

@Hobart
Copy link

Hobart commented Jun 25, 2019

Off topic: I took the opportunity to hit Donate in the app, thanks for years of great software @jberkel & the other committers.

Screenshot_20190625-162200

@sshaikh
Copy link

sshaikh commented Jun 25, 2019

Is it possible to use some kind of personal developer key (assuming such a thing exists)?

@ghost
Copy link
Author

ghost commented Jun 25, 2019

I was able to whitelist the app in my Google Apps domain. Do you think that will eventually stop working as well?

@YMJH
Copy link

YMJH commented Jun 25, 2019

Oh no! This is an unwelcomed shock to me.
Thank you @jberkel for your wonderful app. Like so many others, I am not happy about Google's decision. SMS Backup+ has proved invaluable to me over many years.
Please, please provide an alternative prior to 15 July 2019 if possible.
Ho hum. Google (along with Apple and Microsoft) are controlling too much (IMHO).
Please let us know if you are able to provide another app which Google deem acceptable. Thank you.

@bwwestbrook
Copy link

@jberkel Great work on the app. It has served us all so well for so long. Keep up the great work!!

@GentlyD
Copy link

GentlyD commented Jun 25, 2019

Thanks @jberkel for the help decluttering my communication. Donation done.

@ZecChelovek
Copy link

Forgive my ignorance, but what will happen to my backup of messages already on my google account?

@tomswartz07
Copy link
Contributor

What will happen to my backup of messages already on my google account?

Probably nothing. They're uploaded and currently indistinguishable (from Google's perspective) from regular email messages, save for the unique label if you used it.

@ZecChelovek
Copy link

^That is greatly relieving. Thank you.

@survivor303
Copy link

survivor303 commented Jun 26, 2019

So does that mean, that the app cannot save sms back to gmail anymore? Or just restore them from there?

Im perfectly fine, if the app can just copy them to gmail, that is why i use this application, not for restore.

@Jasonfhaught
Copy link

Jasonfhaught commented Jun 26, 2019

You will have to go to advance setting SMS Backup+ then go into customize imap and set the imap.gmail.com:993 and use you email as user ID and your password. Make sure the authinication is set to clear text and security is tls.

After that go to a PC and login to gmail, in the right hand corner click the cog then setting then goto the tab "forward and pop/imap". Under the imap access change it to enable.

Now go to you gmail account settings on the left side click security. Scroll down to less secure settings and turn it on.

Now you should be able to continue to use the app. It is just not as secure.

Google will probably not close this method down anytime soon to many developers and admins you this method for logs

@Sancus
Copy link

Sancus commented Jun 26, 2019

I'm not sure what to do at this point, either remove the app from the store or release a new version which removes the automatic account setup, since that is broken / will be broken soon.

Personally, I'm happy to keep using this app via IMAP(with gmail or any other IMAP service), so I hope you don't remove it :)

@domhnallog
Copy link

Silly question perhaps but could you fork something open like Thunderbird and add in the and backup feature as a feature of that?

I also have made a donation. Thanks very much. It was a great service while it lasted.

@TenTeypek
Copy link

Oh, that's so sad. It was the best SMS backup app. Will there be any option to backup to somewhere else, if Gmail doesn't work?

@oryz
Copy link

oryz commented Jun 26, 2019

but could you fork something open like Thunderbird and add in the and backup feature as a feature of that?

Was thinking the same thing! Happy to contribute to the effort as well.

Many thanks @jberkel and anyone else that has helped for years of really great service.

@MysticMagican
Copy link

For wich reason your application was denied, @jberkel?
Was that finally, or are there any thing d for could change or provide to them to keep the app working?

@malversoft
Copy link

Count me too: malversan@gmail.com

@eohrnberger I need to be able to provide Google support with at least six unrelated GMail account ID's of people who are "affected" by the previous decision to deny Sensitive Scopes access. I don't have time to work on it right now, but hopefully in a few weeks I will. I'll ask for people to send me their Gmail details then (so I don't lose them in the meantime).

@skrosen1
Copy link

skrosen1 commented Mar 6, 2022 via email

@eohrnberger

This comment was marked as resolved.

@ldboehm
Copy link

ldboehm commented Mar 6, 2022 via email

@shadewoodmole
Copy link

Please contact me when you need Google account IDs I use backup from two accounts.

@eohrnberger
Copy link

eohrnberger commented Mar 6, 2022

I it setup through Firefox working. Forget the steps, but it's somewhere in the thread

On Sat, Mar 5, 2022, 9:11 PM eohrnberger @.***> wrote: I remember there was a way to do two factor authentication that was published in this thread a year or two ago when we first learned about Google messing with "less secure apps". Does anyone know if that will still work after the May action is taken?

Hmm. I hadn't thought of that. My default browser on the phone is Brave. I change the default Chrome, tried the XOAUTH2 configuration, but received the same error message, 'App Blocked'. Downloaded FireFox, set to default browser, tried again, same error message result.

@arnaldop
Copy link

arnaldop commented Mar 6, 2022 via email

@cyberzen7
Copy link

cyberzen7 commented Mar 6, 2022 via email

@oohgodyeah
Copy link

Sign me up if you need more Gmail accounts, and I will provide my address privately.

@kurahaupo
Copy link
Collaborator

If replying to GitHub issues by email, please ensure that you remove all the quoted original message.

Better still, reply by logging into GitHub.

We've already had messages that included the senders own subscription control links, which would enable any recipient to impersonate them, at least for controlling their subscription to this thread, and possibly other functions as well.

@DanBlumenfeld
Copy link

I need to be able to provide Google support with at least six unrelated GMail account ID's of people who are "affected" by the previous decision to deny Sensitive Scopes access. I don't have time to work on it right now, but hopefully in a few weeks I will. I'll ask for people to send me their Gmail details then (so I don't lose them in the meantime)

I'm in: dan.blumenfeld@gmail.com

@eohrnberger
Copy link

Any further movement or change in status here?
Any way where I might be able to help support?

@timmy30274
Copy link

hi, i was using this app fine until 2 days ago when i had to dop a phone reset then just go back to using the app, only this time, its broken

Allow less secure apps: ON. it was off. i think if i turned it off, it would block this app, correct? so i turned it back on

then i go to customize:
authentication: plain
server address: imap.google.com:993
my username
my password
security: i tried all 3: tls, startttls and none

and i still cannot get in.

i wish i hadnt reset my phone

is this app been murdered by google??

or is it still possible to get it working?

Allow less secure apps: ON
On May 30, 2022, this setting will no longer be available. Learn more

@kurahaupo
Copy link
Collaborator

@timmy30274 are you using an app password or your main account password?

Google is (quite reasonably) not keen on people sharing their main account password with apps that they don't trust.

You may need to enable 2-factor authentication before you'll be allowed to create an app password, but I would strongly recommend that everyone do that anyway.

@timmy30274
Copy link

app directly. but i got it fixed. it was supposed to imap.gmail not google because hours after i posted this, i found a old conversation from several years ago on reddit which someone found the answer. this time i emailed the website to myself for future reference

my app is working again.

instead of blocking what they dont trust, the employees should have it on their phones so they can try it our themselves and say, OH WOW THIS IS AMAZING!!! then add it to the trusted apps

@eohrnberger
Copy link

I confirm the information above. Testing procedure:

1. Created a test Gmail account
2. Enabled MFA
3. Created an app password for all the apps that need access, Outlook on Windows and SMS Backup on phone
	a. This is a one-time password, so no sense in storing it
	b. It will be a 16 characters like:	tkvgrjxatvgwprzw
	c. Established an actual connection with the app, provide the app password, otherwise, Google won't remember it, and it'll be denied later
4. Connected with Outlook 2016 - works
	a. Send / Receive through the Gmail account
	b. When prompted, enter the app password
	c. Validate the email did send through the Gmail account
5. Disabled MFA
6. Test that sending in Outlook through the Gmail account would still work

This was configured and tested on 3/3/22. I tested again on 4/7/22, Outlook still has IMAP access to Gmail using the app password. Apparently, they never expire.

@skrosen1
Copy link

I have been using SMSBackup+ for many years.  I switched over to 2 factor authentication when it became necessary to do so a few years ago.  It has worked perfectly ever since.  However, I recently installed Android 13 and, while the app still works with manual backups, it will no longer backup anything automatically.  I unchecked battery optimization as was suggested but that hasn't helped.  I even used a new password in the hope that it would help, but it did not.

Any suggestions on how to fix this would be appreciated.

Thanks,

Susan

@kurahaupo
Copy link
Collaborator

@skrosen1 some devices now have separate permissions for "auto launch", "run services in the background", and "access the internet from the background".

On my phone those are accessible from the app settings (tap+hold on the Messages app icon, then:

  • App Info → Battery Usage → Allow auto launch
  • App Info → Battery Usage → Allow background activity
  • App Info → Data Usage Details → Background data

@waldyrious
Copy link

For me, the options have different names:

  • App Info → Battery Usage → Allow auto launch

I don't seem to have any option corresponding to this one 🤔

  • App Info → Battery Usage → Allow background activity

In my phone this is at App info → App battery usage → Unrestricted.

  • App Info → Data Usage Details → Background data

For me this is found at App info → Mobile data & Wi-Fi → Background data

I also have the following turned off: App info → Permissions → Pause app activity if unused.

Of the above, App battery usage → Unrestricted is the only one I hadn't toggled yet. I'll report back if that does the trick, but I suspect it won't 😞

@B150n
Copy link

B150n commented Jan 4, 2023

For me, the options have different names:

  • App Info → Battery Usage → Allow auto launch

I don't seem to have any option corresponding to this one 🤔

  • App Info → Battery Usage → Allow background activity

In my phone this is at App info → App battery usage → Unrestricted.

  • App Info → Data Usage Details → Background data

For me this is found at App info → Mobile data & Wi-Fi → Background data

I also have the following turned off: App info → Permissions → Pause app activity if unused.

Of the above, App battery usage → Unrestricted is the only one I hadn't toggled yet. I'll report back if that does the trick, but I suspect it won't 😞

I tried every option listed and looked everywhere else I could think of to allow any unrestricted option but Auto Backup is still not working. Still hoping for a workaround.

Thanks for all of the suggestions.

Update to add: Using Android 13, Samsung Galaxy Z Fold 4, Pulse SMS

@B150n
Copy link

B150n commented Feb 2, 2023

Last night I tried using a yahoo email but couldn't get it to work. It was late & I might have entered something wrong. I go back to my orig Gmail email, enter my app-specific password & still wouldn't work at all. Grrrr.

Went to my Gmail account & created a new app-specific password & entered all info. Manually backed up & went to bed.
A few minutes ago I went to manually backup & all of my texts were already backed up!

So, try creating a New app-specific password & see if it works for you too!

@kurahaupo
Copy link
Collaborator

@B150n Gmail has made a habit of suggesting that I turn off app passwords to improve the security of my account; I keep having to make a point of saying "no".

It's possible that some folk are following this recommendation and inadvertently disabling SMS-Backup+.

@B150n
Copy link

B150n commented Feb 17, 2023

@kurahaupo

That’s a good suggestion for people to check within their GMAIL accounts. I haven’t received any notifications or suggestions to stop using App-specific passwords but will keep any eye out for it.

Some things that I’ve noticed and had to do since I last posted.

  1. Within the Auto backup settings, it is a must that you ENABLE/check off the “Old backup scheduler” to get SMS Backup+ to Auto-backup whatsoever. Without it being enabled, none of my SMSs were being backed up.
  2. Only the “Regular schedule” (when to backup SMS seems to be working. I set it at 30 minutes and it has been pretty consistent with the backups.
  3. The “Incoming schedule” (when I set to 1 or 3 minutes) does not work. I miss this feature.
    I’ve been playing around with various settings and nothing will get it working.

I think I messed some setting up last night because I just looked at my gmail and SMS Backup+ had not backed anything up since yesterday. UGH! I probably forgot to re-enable the use old backup scheduler.
I just found what I believe is the last version made (1.6.0-Beta) and installed in on my phone. Testing now to see if it works. I did not do a completely clean install. I installed over version 1.5.1.1 but I did clear the app cache (not app data) and also cleared the phones system cache.

@waldyrious
Copy link

waldyrious commented Feb 17, 2023

It's possible that some folk are following this recommendation and inadvertently disabling SMS-Backup+.

For the record, I do get these prompts and I have always responded "no" to them, to keep the SMS-Backup+ app password. So that's not the reason it's not working. (In fact, if I had disabled the app password, manual backups wouldn't work either.)

Within the Auto backup settings, it is a must that you ENABLE/check off the “Old backup scheduler” to get SMS Backup+ to Auto-backup whatsoever. Without it being enabled, none of my SMSs were being backed up.

Huh! I didn't have this checkbox marked! I have now enabled it, and will report if it makes the automatic backups start happening for me again.

@apsstudio
Copy link

Hi, Has anyone figured out how to get SMS Backup+ working again? I still keep getting the App is blocked window.

@ldboehm
Copy link

ldboehm commented Dec 15, 2023 via email

@apsstudio
Copy link

Hi I've attempted this several times and set up a new gmail to test it as well. Once I click on security, I don't see an option for App passwords. How do I locate this?

@dobrin
Copy link

dobrin commented Dec 15, 2023

See this link https://support.google.com/accounts/answer/185833 .
To create an app password, you need 2-Step Verification on your Google Account.
Go to your Google Account.
Select Security.
Under "Signing in to Google," select 2-Step Verification.
At the bottom of the page, select App passwords.

@apsstudio
Copy link

Thank you, I finally got it to work! 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
helpful provides information that may be useful to other users xoauth problems caused by lack of approval to use "sensitive" Gmail API
Projects
None yet
Development

No branches or pull requests