PBAP: Do not set phonebook access to ACCESS_REJECTED automatically

The value is saved in SharedPreferences. However, it will return ACCESS_UNKNOWN in several cases. We shouldn't set it as rejected automatically. We should ask user when PBAP connect.

Bug: 230712201
Test: manual
Change-Id: Ia3f373b9799cf02c47dc782688430fb234491f61
(cherry picked from commit 5bc5f10310)

packages/SettingsLib/src/com/android/settingslib/bluetooth/CachedBluetoothDevice.java

@@ -1018,7 +1018,6 @@ public class CachedBluetoothDevice implements Comparable<CachedBluetoothDevice>
                         == BluetoothClass.Device.AUDIO_VIDEO_WEARABLE_HEADSET)) {
                     EventLog.writeEvent(0x534e4554, "138529441", -1, "");
                 }
-                mDevice.setPhonebookAccessPermission(BluetoothDevice.ACCESS_REJECTED);
             }
         }
     }