Do I need a physical SIM card to use eSIM?

No, you do not need to physical SIM card in order to use eSIM. As long your devices is eSIM compatible, you have option to either use eSIM on its own or dual SIM(if supported).