Hi,
- Can I remove the DC's from the On Prem and just have the users validate through the on prem network into Azure and if so, will there be serious latency issues?
Yes, you risk to have a latency because the on-premise domain controllers are closest
If you still on-premise resources , it may be also impacted when you demote on-premise DCs.
- Can I do away with the On Prem AD totally and use just Azure AD in this situation?
You should before migrate all on-premise service to azure to use Azure AD account for authentication instead of on-premise AD user account.
Once on-premise services migrated or decommissioned , you can use just Azure AD and demote your on-premise domain by following those steps:
- If you don't have adconnect alreday deployed , install it to ensure the synchronization between on-promise domain and Azure AD to help user to keep the same password , login..ect
- Turnoff directory synchronisation through adconnect : Turn off directory synchronization for Microsoft 365
- Demote all domain controllers in your on-premise domain
Please don't forget to mark helpful answer as accepted