Error 23 - Android. Works in Debug but not release

Hi,

I have setup revenue cat for my flutter app. I have double checked product IDs aligned to play store and my revenue cat paywall works for debug mode on my Android emulator. It also works for my iOS device without any issues.

However, when I try testing the subscription through (Android) play store closed beta testing link and download the app, I get the error indicating a configuration issue. This is strange because if I run the app in debug mode in my android emulator it still works, and I can make test transactions. 

Error 23: There is an issue with your underlying configuration. 
Check the underlying error for more details.

Any issue why this could be happening?