Is it possible for me to send different email templates for invoice due reminders with the V2 emails?

Yes, this is possible.

Just navigate to Settings > Email Notifications (under Customer-facing essentials) > Dunning for online payments(For online payments) or Dunning for offline payments(for offline payments). On this page, you can configure the email template for each reminder for a Payment Due invoice on the panel shown in the screenshot below. You can also read this document for more information.

Note that these emails will not be sent for each dunning attempt failure. They will be sent based on the number of days the invoice has been in Payment Due state.