I GOT IT UPGRADED Thanks to Rocco and Pavel. This is what I had to do:

1. In developer module, switch to BETA version. After that, the upgrade link should show.
2. Confirm that PHP version is 7.4. ( I did have that but it's good to confirm)
3. My issue was cron was not set correctly. I set the correct cron job path and it immediately upgraded and I got the "upgrade successful" email.

All working now :)